2026-02-18T00:26:15.759 INFO:root:teuthology version: 1.2.4.dev9+gfa17720d0 2026-02-18T00:26:15.773 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-18T00:26:15.848 INFO:teuthology.run:Config: archive_path: /home/teuthworker/mnt/teuthology/yuriw-2026-02-17_21:14:21-rados-20.2.1_2.17.26-baseline_2-distro-default-trial/54158 branch: 20.2.1_2.17.26-baseline_2 description: rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/misc} email: yweinste@redhat.com first_in_suite: false flavor: default job_id: '54158' kernel: branch: distro kdb: true sha1: distro ktype: distro last_in_suite: false machine_type: trial name: yuriw-2026-02-17_21:14:21-rados-20.2.1_2.17.26-baseline_2-distro-default-trial no_nested_subset: false openstack: - volumes: count: 3 size: 10 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: 20.2.1_2.17.26-baseline_2 ceph: conf: mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: debug ms: 1 debug osd: 20 flavor: default log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) sha1: adc1923395f2bcd6ae89b5d331d278364d1848ed ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: default sha1: adc1923395f2bcd6ae89b5d331d278364d1848ed workunit: branch: 20.2.1_2.17.26-baseline_2 sha1: adc1923395f2bcd6ae89b5d331d278364d1848ed owner: scheduled_yuriw@soko04.front.sepia.ceph.com priority: 69 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.x - osd.0 - osd.1 - osd.2 - client.0 seed: 1775 sha1: adc1923395f2bcd6ae89b5d331d278364d1848ed sleep_before_teardown: 0 subset: 111/120000 suite: rados suite_branch: 20.2.1_2.17.26-baseline_2 suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_adc1923395f2bcd6ae89b5d331d278364d1848ed/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: adc1923395f2bcd6ae89b5d331d278364d1848ed targets: trial069.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCr/OwPoyFOVnXBSEvoP0s29YG3bZA18uZfRuPwuBlgveTuv2Q3mjVJZ1pVPCbrnjkwn2sI2Gotat3fTq2ZIr3A= tasks: - install: null - workunit: basedir: qa/standalone clients: all: - misc teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: fa17720d0088c3ac28e473468bfc79eeaff5cd38 timestamp: 2026-02-17_21:14:21 tube: trial user: yuriw verbose: true worker_log: /home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.3682 2026-02-18T00:26:15.848 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_adc1923395f2bcd6ae89b5d331d278364d1848ed/qa; will attempt to use it 2026-02-18T00:26:15.849 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_adc1923395f2bcd6ae89b5d331d278364d1848ed/qa/tasks 2026-02-18T00:26:15.849 INFO:teuthology.run_tasks:Running task internal.check_packages... 2026-02-18T00:26:15.850 INFO:teuthology.task.internal:Checking packages... 2026-02-18T00:26:15.850 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash 'adc1923395f2bcd6ae89b5d331d278364d1848ed' 2026-02-18T00:26:15.851 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2026-02-18T00:26:15.851 INFO:teuthology.packaging:ref: None 2026-02-18T00:26:15.851 INFO:teuthology.packaging:tag: None 2026-02-18T00:26:15.851 INFO:teuthology.packaging:branch: 20.2.1_2.17.26-baseline_2 2026-02-18T00:26:15.851 INFO:teuthology.packaging:sha1: adc1923395f2bcd6ae89b5d331d278364d1848ed 2026-02-18T00:26:15.851 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=20.2.1_2.17.26-baseline_2 2026-02-18T00:26:15.975 INFO:teuthology.task.internal:Found packages for ceph version 20.2.0-670-gadc19233-1jammy 2026-02-18T00:26:15.977 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2026-02-18T00:26:15.988 INFO:teuthology.task.internal:no buildpackages task found 2026-02-18T00:26:15.988 INFO:teuthology.run_tasks:Running task internal.save_config... 2026-02-18T00:26:16.001 INFO:teuthology.task.internal:Saving configuration 2026-02-18T00:26:16.005 INFO:teuthology.run_tasks:Running task internal.check_lock... 2026-02-18T00:26:16.017 INFO:teuthology.task.internal.check_lock:Checking locks... 2026-02-18T00:26:16.073 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial069.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/yuriw-2026-02-17_21:14:21-rados-20.2.1_2.17.26-baseline_2-distro-default-trial/54158', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-18 00:22:47.717143', 'locked_by': 'scheduled_yuriw@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIG37t8ECz4wKi2arIjtNCtnMfM4+hzFUHRn42Jv3DL+w'} 2026-02-18T00:26:16.073 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2026-02-18T00:26:16.085 INFO:teuthology.task.internal:roles: ubuntu@trial069.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'osd.0', 'osd.1', 'osd.2', 'client.0'] 2026-02-18T00:26:16.085 INFO:teuthology.run_tasks:Running task console_log... 2026-02-18T00:26:16.154 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x701ad87da340>, signals=[15]) 2026-02-18T00:26:16.155 INFO:teuthology.run_tasks:Running task internal.connect... 2026-02-18T00:26:16.166 INFO:teuthology.task.internal:Opening connections... 2026-02-18T00:26:16.166 DEBUG:teuthology.task.internal:connecting to ubuntu@trial069.front.sepia.ceph.com 2026-02-18T00:26:16.167 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-18T00:26:16.232 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2026-02-18T00:26:16.244 DEBUG:teuthology.orchestra.run.trial069:> uname -m 2026-02-18T00:26:16.308 INFO:teuthology.orchestra.run.trial069.stdout:x86_64 2026-02-18T00:26:16.308 DEBUG:teuthology.orchestra.run.trial069:> cat /etc/os-release 2026-02-18T00:26:16.354 INFO:teuthology.orchestra.run.trial069.stdout:PRETTY_NAME="Ubuntu 22.04.5 LTS" 2026-02-18T00:26:16.354 INFO:teuthology.orchestra.run.trial069.stdout:NAME="Ubuntu" 2026-02-18T00:26:16.354 INFO:teuthology.orchestra.run.trial069.stdout:VERSION_ID="22.04" 2026-02-18T00:26:16.354 INFO:teuthology.orchestra.run.trial069.stdout:VERSION="22.04.5 LTS (Jammy Jellyfish)" 2026-02-18T00:26:16.354 INFO:teuthology.orchestra.run.trial069.stdout:VERSION_CODENAME=jammy 2026-02-18T00:26:16.354 INFO:teuthology.orchestra.run.trial069.stdout:ID=ubuntu 2026-02-18T00:26:16.354 INFO:teuthology.orchestra.run.trial069.stdout:ID_LIKE=debian 2026-02-18T00:26:16.354 INFO:teuthology.orchestra.run.trial069.stdout:HOME_URL="https://www.ubuntu.com/" 2026-02-18T00:26:16.354 INFO:teuthology.orchestra.run.trial069.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2026-02-18T00:26:16.354 INFO:teuthology.orchestra.run.trial069.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2026-02-18T00:26:16.354 INFO:teuthology.orchestra.run.trial069.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2026-02-18T00:26:16.354 INFO:teuthology.orchestra.run.trial069.stdout:UBUNTU_CODENAME=jammy 2026-02-18T00:26:16.355 INFO:teuthology.lock.ops:Updating trial069.front.sepia.ceph.com on lock server 2026-02-18T00:26:16.442 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2026-02-18T00:26:16.457 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2026-02-18T00:26:16.469 INFO:teuthology.task.internal:Checking for old test directory... 2026-02-18T00:26:16.469 DEBUG:teuthology.orchestra.run.trial069:> test '!' -e /home/ubuntu/cephtest 2026-02-18T00:26:16.473 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2026-02-18T00:26:16.483 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2026-02-18T00:26:16.483 DEBUG:teuthology.orchestra.run.trial069:> test -z $(ls -A /var/lib/ceph) 2026-02-18T00:26:16.519 INFO:teuthology.orchestra.run.trial069.stderr:ls: cannot access '/var/lib/ceph': No such file or directory 2026-02-18T00:26:16.520 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2026-02-18T00:26:16.618 INFO:teuthology.run_tasks:Running task kernel... 2026-02-18T00:26:16.636 INFO:teuthology.task.kernel:normalize config orig: {'branch': 'distro', 'kdb': True, 'sha1': 'distro'} 2026-02-18T00:26:16.636 INFO:teuthology.task.kernel:config {'mon.a': {'branch': 'distro', 'kdb': True, 'sha1': 'distro'}}, timeout 300 2026-02-18T00:26:16.636 DEBUG:teuthology.orchestra.run.trial069:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-18T00:26:16.640 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-18T00:26:16.640 DEBUG:teuthology.orchestra.run.trial069:> uname -r 2026-02-18T00:26:16.686 INFO:teuthology.orchestra.run.trial069.stdout:5.15.0-164-generic 2026-02-18T00:26:16.686 INFO:teuthology.task.kernel:Running kernel on trial069: 5.15.0-164-generic 2026-02-18T00:26:16.686 DEBUG:teuthology.orchestra.run.trial069:> sudo apt-get clean 2026-02-18T00:26:16.749 DEBUG:teuthology.orchestra.run.trial069:> sudo apt-get update 2026-02-18T00:26:16.944 INFO:teuthology.orchestra.run.trial069.stdout:Hit:1 https://archive.ubuntu.com/ubuntu jammy InRelease 2026-02-18T00:26:16.952 INFO:teuthology.orchestra.run.trial069.stdout:Get:2 https://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2026-02-18T00:26:16.990 INFO:teuthology.orchestra.run.trial069.stdout:Get:3 https://archive.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2026-02-18T00:26:17.005 INFO:teuthology.orchestra.run.trial069.stdout:Get:4 https://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2026-02-18T00:26:17.083 INFO:teuthology.orchestra.run.trial069.stdout:Get:5 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [3240 kB] 2026-02-18T00:26:17.150 INFO:teuthology.orchestra.run.trial069.stdout:Get:6 https://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [494 kB] 2026-02-18T00:26:17.154 INFO:teuthology.orchestra.run.trial069.stdout:Get:7 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [19.2 kB] 2026-02-18T00:26:17.155 INFO:teuthology.orchestra.run.trial069.stdout:Get:8 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1256 kB] 2026-02-18T00:26:17.164 INFO:teuthology.orchestra.run.trial069.stdout:Get:9 https://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [314 kB] 2026-02-18T00:26:17.167 INFO:teuthology.orchestra.run.trial069.stdout:Get:10 https://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [5295 kB] 2026-02-18T00:26:17.194 INFO:teuthology.orchestra.run.trial069.stdout:Get:11 https://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [1001 kB] 2026-02-18T00:26:17.198 INFO:teuthology.orchestra.run.trial069.stdout:Get:12 https://archive.ubuntu.com/ubuntu jammy-security/main amd64 Packages [2975 kB] 2026-02-18T00:26:17.207 INFO:teuthology.orchestra.run.trial069.stdout:Get:13 https://archive.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [14.1 kB] 2026-02-18T00:26:17.207 INFO:teuthology.orchestra.run.trial069.stdout:Get:14 https://archive.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [1017 kB] 2026-02-18T00:26:20.561 INFO:teuthology.orchestra.run.trial069.stdout:Fetched 16.0 MB in 1s (13.0 MB/s) 2026-02-18T00:26:21.082 INFO:teuthology.orchestra.run.trial069.stdout:Reading package lists... 2026-02-18T00:26:21.095 DEBUG:teuthology.orchestra.run.trial069:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2026-02-18T00:26:21.129 INFO:teuthology.orchestra.run.trial069.stdout:Reading package lists... 2026-02-18T00:26:21.237 INFO:teuthology.orchestra.run.trial069.stdout:Building dependency tree... 2026-02-18T00:26:21.238 INFO:teuthology.orchestra.run.trial069.stdout:Reading state information... 2026-02-18T00:26:21.323 INFO:teuthology.orchestra.run.trial069.stdout:The following packages were automatically installed and are no longer required: 2026-02-18T00:26:21.324 INFO:teuthology.orchestra.run.trial069.stdout: kpartx libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 2026-02-18T00:26:21.324 INFO:teuthology.orchestra.run.trial069.stdout: libgfxdr0 libglusterfs0 libiscsi7 libpmemobj1 libsgutils2-2 sg3-utils 2026-02-18T00:26:21.324 INFO:teuthology.orchestra.run.trial069.stdout: sg3-utils-udev 2026-02-18T00:26:21.324 INFO:teuthology.orchestra.run.trial069.stdout:Use 'sudo apt autoremove' to remove them. 2026-02-18T00:26:21.324 INFO:teuthology.orchestra.run.trial069.stdout:The following additional packages will be installed: 2026-02-18T00:26:21.324 INFO:teuthology.orchestra.run.trial069.stdout: linux-generic linux-headers-5.15.0-170 linux-headers-5.15.0-170-generic 2026-02-18T00:26:21.324 INFO:teuthology.orchestra.run.trial069.stdout: linux-headers-generic linux-image-5.15.0-170-generic 2026-02-18T00:26:21.324 INFO:teuthology.orchestra.run.trial069.stdout: linux-modules-5.15.0-170-generic linux-modules-extra-5.15.0-170-generic 2026-02-18T00:26:21.324 INFO:teuthology.orchestra.run.trial069.stdout:Suggested packages: 2026-02-18T00:26:21.324 INFO:teuthology.orchestra.run.trial069.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2026-02-18T00:26:21.337 INFO:teuthology.orchestra.run.trial069.stdout:The following NEW packages will be installed: 2026-02-18T00:26:21.337 INFO:teuthology.orchestra.run.trial069.stdout: linux-headers-5.15.0-170 linux-headers-5.15.0-170-generic 2026-02-18T00:26:21.337 INFO:teuthology.orchestra.run.trial069.stdout: linux-image-5.15.0-170-generic linux-modules-5.15.0-170-generic 2026-02-18T00:26:21.337 INFO:teuthology.orchestra.run.trial069.stdout: linux-modules-extra-5.15.0-170-generic 2026-02-18T00:26:21.337 INFO:teuthology.orchestra.run.trial069.stdout:The following packages will be upgraded: 2026-02-18T00:26:21.338 INFO:teuthology.orchestra.run.trial069.stdout: linux-generic linux-headers-generic linux-image-generic 2026-02-18T00:26:21.433 INFO:teuthology.orchestra.run.trial069.stdout:3 upgraded, 5 newly installed, 0 to remove and 53 not upgraded. 2026-02-18T00:26:21.434 INFO:teuthology.orchestra.run.trial069.stdout:Need to get 113 MB of archives. 2026-02-18T00:26:21.434 INFO:teuthology.orchestra.run.trial069.stdout:After this operation, 585 MB of additional disk space will be used. 2026-02-18T00:26:21.434 INFO:teuthology.orchestra.run.trial069.stdout:Get:1 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-170-generic amd64 5.15.0-170.180 [22.7 MB] 2026-02-18T00:26:21.605 INFO:teuthology.orchestra.run.trial069.stdout:Get:2 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-170-generic amd64 5.15.0-170.180 [11.6 MB] 2026-02-18T00:26:21.650 INFO:teuthology.orchestra.run.trial069.stdout:Get:3 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-170-generic amd64 5.15.0-170.180 [64.0 MB] 2026-02-18T00:26:21.917 INFO:teuthology.orchestra.run.trial069.stdout:Get:4 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.170.159 [1654 B] 2026-02-18T00:26:21.918 INFO:teuthology.orchestra.run.trial069.stdout:Get:5 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.170.159 [2474 B] 2026-02-18T00:26:21.918 INFO:teuthology.orchestra.run.trial069.stdout:Get:6 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-170 all 5.15.0-170.180 [12.4 MB] 2026-02-18T00:26:21.967 INFO:teuthology.orchestra.run.trial069.stdout:Get:7 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-170-generic amd64 5.15.0-170.180 [2828 kB] 2026-02-18T00:26:21.977 INFO:teuthology.orchestra.run.trial069.stdout:Get:8 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.170.159 [2316 B] 2026-02-18T00:26:22.174 INFO:teuthology.orchestra.run.trial069.stdout:Fetched 113 MB in 1s (178 MB/s) 2026-02-18T00:26:22.194 INFO:teuthology.orchestra.run.trial069.stdout:Selecting previously unselected package linux-modules-5.15.0-170-generic. 2026-02-18T00:26:22.360 INFO:teuthology.orchestra.run.trial069.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 131954 files and directories currently installed.) 2026-02-18T00:26:22.361 INFO:teuthology.orchestra.run.trial069.stdout:Preparing to unpack .../0-linux-modules-5.15.0-170-generic_5.15.0-170.180_amd64.deb ... 2026-02-18T00:26:22.362 INFO:teuthology.orchestra.run.trial069.stdout:Unpacking linux-modules-5.15.0-170-generic (5.15.0-170.180) ... 2026-02-18T00:26:22.706 INFO:teuthology.orchestra.run.trial069.stdout:Selecting previously unselected package linux-image-5.15.0-170-generic. 2026-02-18T00:26:22.712 INFO:teuthology.orchestra.run.trial069.stdout:Preparing to unpack .../1-linux-image-5.15.0-170-generic_5.15.0-170.180_amd64.deb ... 2026-02-18T00:26:22.720 INFO:teuthology.orchestra.run.trial069.stdout:Unpacking linux-image-5.15.0-170-generic (5.15.0-170.180) ... 2026-02-18T00:26:22.761 INFO:teuthology.orchestra.run.trial069.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-170-generic. 2026-02-18T00:26:22.767 INFO:teuthology.orchestra.run.trial069.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-170-generic_5.15.0-170.180_amd64.deb ... 2026-02-18T00:26:22.768 INFO:teuthology.orchestra.run.trial069.stdout:Unpacking linux-modules-extra-5.15.0-170-generic (5.15.0-170.180) ... 2026-02-18T00:26:23.879 INFO:teuthology.orchestra.run.trial069.stdout:Preparing to unpack .../3-linux-generic_5.15.0.170.159_amd64.deb ... 2026-02-18T00:26:23.880 INFO:teuthology.orchestra.run.trial069.stdout:Unpacking linux-generic (5.15.0.170.159) over (5.15.0.164.159) ... 2026-02-18T00:26:23.902 INFO:teuthology.orchestra.run.trial069.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.170.159_amd64.deb ... 2026-02-18T00:26:23.902 INFO:teuthology.orchestra.run.trial069.stdout:Unpacking linux-image-generic (5.15.0.170.159) over (5.15.0.164.159) ... 2026-02-18T00:26:23.918 INFO:teuthology.orchestra.run.trial069.stdout:Selecting previously unselected package linux-headers-5.15.0-170. 2026-02-18T00:26:23.925 INFO:teuthology.orchestra.run.trial069.stdout:Preparing to unpack .../5-linux-headers-5.15.0-170_5.15.0-170.180_all.deb ... 2026-02-18T00:26:23.926 INFO:teuthology.orchestra.run.trial069.stdout:Unpacking linux-headers-5.15.0-170 (5.15.0-170.180) ... 2026-02-18T00:26:25.311 INFO:teuthology.orchestra.run.trial069.stdout:Selecting previously unselected package linux-headers-5.15.0-170-generic. 2026-02-18T00:26:25.323 INFO:teuthology.orchestra.run.trial069.stdout:Preparing to unpack .../6-linux-headers-5.15.0-170-generic_5.15.0-170.180_amd64.deb ... 2026-02-18T00:26:25.323 INFO:teuthology.orchestra.run.trial069.stdout:Unpacking linux-headers-5.15.0-170-generic (5.15.0-170.180) ... 2026-02-18T00:26:25.904 INFO:teuthology.orchestra.run.trial069.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.170.159_amd64.deb ... 2026-02-18T00:26:25.905 INFO:teuthology.orchestra.run.trial069.stdout:Unpacking linux-headers-generic (5.15.0.170.159) over (5.15.0.164.159) ... 2026-02-18T00:26:25.930 INFO:teuthology.orchestra.run.trial069.stdout:Setting up linux-headers-5.15.0-170 (5.15.0-170.180) ... 2026-02-18T00:26:25.931 INFO:teuthology.orchestra.run.trial069.stdout:Setting up linux-headers-5.15.0-170-generic (5.15.0-170.180) ... 2026-02-18T00:26:25.933 INFO:teuthology.orchestra.run.trial069.stdout:Setting up linux-headers-generic (5.15.0.170.159) ... 2026-02-18T00:26:25.934 INFO:teuthology.orchestra.run.trial069.stdout:Setting up linux-modules-5.15.0-170-generic (5.15.0-170.180) ... 2026-02-18T00:26:26.704 INFO:teuthology.orchestra.run.trial069.stdout:Setting up linux-image-5.15.0-170-generic (5.15.0-170.180) ... 2026-02-18T00:26:27.533 INFO:teuthology.orchestra.run.trial069.stdout:I: /boot/vmlinuz is now a symlink to vmlinuz-5.15.0-170-generic 2026-02-18T00:26:27.533 INFO:teuthology.orchestra.run.trial069.stdout:I: /boot/initrd.img is now a symlink to initrd.img-5.15.0-170-generic 2026-02-18T00:26:27.539 INFO:teuthology.orchestra.run.trial069.stdout:Setting up linux-modules-extra-5.15.0-170-generic (5.15.0-170.180) ... 2026-02-18T00:26:28.332 INFO:teuthology.orchestra.run.trial069.stdout:Setting up linux-image-generic (5.15.0.170.159) ... 2026-02-18T00:26:28.333 INFO:teuthology.orchestra.run.trial069.stdout:Setting up linux-generic (5.15.0.170.159) ... 2026-02-18T00:26:28.334 INFO:teuthology.orchestra.run.trial069.stdout:Processing triggers for linux-image-5.15.0-170-generic (5.15.0-170.180) ... 2026-02-18T00:26:28.339 INFO:teuthology.orchestra.run.trial069.stdout:/etc/kernel/postinst.d/initramfs-tools: 2026-02-18T00:26:28.339 INFO:teuthology.orchestra.run.trial069.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-170-generic 2026-02-18T00:26:35.385 INFO:teuthology.orchestra.run.trial069.stdout:W: Possible missing firmware /lib/firmware/ast_dp501_fw.bin for module ast 2026-02-18T00:26:41.987 INFO:teuthology.orchestra.run.trial069.stdout:/etc/kernel/postinst.d/zz-update-grub: 2026-02-18T00:26:41.987 INFO:teuthology.orchestra.run.trial069.stdout:Sourcing file `/etc/default/grub' 2026-02-18T00:26:42.005 INFO:teuthology.orchestra.run.trial069.stdout:Sourcing file `/etc/default/grub.d/50-curtin-settings.cfg' 2026-02-18T00:26:42.006 INFO:teuthology.orchestra.run.trial069.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2026-02-18T00:26:42.008 INFO:teuthology.orchestra.run.trial069.stdout:Generating grub configuration file ... 2026-02-18T00:26:42.090 INFO:teuthology.orchestra.run.trial069.stdout:Found linux image: /boot/vmlinuz-5.15.0-170-generic 2026-02-18T00:26:42.097 INFO:teuthology.orchestra.run.trial069.stdout:Found initrd image: /boot/initrd.img-5.15.0-170-generic 2026-02-18T00:26:42.270 INFO:teuthology.orchestra.run.trial069.stdout:Found linux image: /boot/vmlinuz-5.15.0-164-generic 2026-02-18T00:26:42.275 INFO:teuthology.orchestra.run.trial069.stdout:Found initrd image: /boot/initrd.img-5.15.0-164-generic 2026-02-18T00:26:42.344 INFO:teuthology.orchestra.run.trial069.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2026-02-18T00:26:42.345 INFO:teuthology.orchestra.run.trial069.stdout:Systems on them will not be added to the GRUB boot configuration. 2026-02-18T00:26:42.345 INFO:teuthology.orchestra.run.trial069.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2026-02-18T00:26:42.347 INFO:teuthology.orchestra.run.trial069.stdout:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-18T00:26:42.355 INFO:teuthology.orchestra.run.trial069.stdout:done 2026-02-18T00:26:42.760 INFO:teuthology.orchestra.run.trial069.stdout: 2026-02-18T00:26:42.760 INFO:teuthology.orchestra.run.trial069.stdout:Pending kernel upgrade! 2026-02-18T00:26:42.760 INFO:teuthology.orchestra.run.trial069.stdout: 2026-02-18T00:26:42.760 INFO:teuthology.orchestra.run.trial069.stdout:Running kernel version: 2026-02-18T00:26:42.760 INFO:teuthology.orchestra.run.trial069.stdout: 5.15.0-164-generic 2026-02-18T00:26:42.761 INFO:teuthology.orchestra.run.trial069.stdout: 2026-02-18T00:26:42.761 INFO:teuthology.orchestra.run.trial069.stdout:Diagnostics: 2026-02-18T00:26:42.761 INFO:teuthology.orchestra.run.trial069.stdout: The currently running kernel version is not the expected kernel version 5.15.0-170-generic. 2026-02-18T00:26:42.761 INFO:teuthology.orchestra.run.trial069.stdout: 2026-02-18T00:26:42.761 INFO:teuthology.orchestra.run.trial069.stdout:Restarting the system to load the new kernel will not be handled automatically, so you should consider rebooting. [Return] 2026-02-18T00:26:42.761 INFO:teuthology.orchestra.run.trial069.stdout: 2026-02-18T00:26:42.761 INFO:teuthology.orchestra.run.trial069.stdout:The processor microcode seems to be up-to-date. 2026-02-18T00:26:42.761 INFO:teuthology.orchestra.run.trial069.stdout: 2026-02-18T00:26:42.761 INFO:teuthology.orchestra.run.trial069.stdout:No services need to be restarted. 2026-02-18T00:26:42.761 INFO:teuthology.orchestra.run.trial069.stdout: 2026-02-18T00:26:42.762 INFO:teuthology.orchestra.run.trial069.stdout:No containers need to be restarted. 2026-02-18T00:26:42.762 INFO:teuthology.orchestra.run.trial069.stdout: 2026-02-18T00:26:42.762 INFO:teuthology.orchestra.run.trial069.stdout:No user sessions are running outdated binaries. 2026-02-18T00:26:42.762 INFO:teuthology.orchestra.run.trial069.stdout: 2026-02-18T00:26:42.762 INFO:teuthology.orchestra.run.trial069.stdout:No VM guests are running outdated hypervisor (qemu) binaries on this host. 2026-02-18T00:26:43.410 DEBUG:teuthology.orchestra.run.trial069:> dpkg -s linux-image-generic 2026-02-18T00:26:43.465 INFO:teuthology.orchestra.run.trial069.stdout:Package: linux-image-generic 2026-02-18T00:26:43.465 INFO:teuthology.orchestra.run.trial069.stdout:Status: install ok installed 2026-02-18T00:26:43.465 INFO:teuthology.orchestra.run.trial069.stdout:Priority: optional 2026-02-18T00:26:43.465 INFO:teuthology.orchestra.run.trial069.stdout:Section: kernel 2026-02-18T00:26:43.465 INFO:teuthology.orchestra.run.trial069.stdout:Installed-Size: 21 2026-02-18T00:26:43.465 INFO:teuthology.orchestra.run.trial069.stdout:Maintainer: Ubuntu Kernel Team 2026-02-18T00:26:43.465 INFO:teuthology.orchestra.run.trial069.stdout:Architecture: amd64 2026-02-18T00:26:43.465 INFO:teuthology.orchestra.run.trial069.stdout:Source: linux-meta 2026-02-18T00:26:43.466 INFO:teuthology.orchestra.run.trial069.stdout:Version: 5.15.0.170.159 2026-02-18T00:26:43.466 INFO:teuthology.orchestra.run.trial069.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.6), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-170), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.6) 2026-02-18T00:26:43.466 INFO:teuthology.orchestra.run.trial069.stdout:Depends: linux-image-5.15.0-170-generic, linux-modules-extra-5.15.0-170-generic, linux-firmware, intel-microcode, amd64-microcode 2026-02-18T00:26:43.466 INFO:teuthology.orchestra.run.trial069.stdout:Recommends: thermald 2026-02-18T00:26:43.466 INFO:teuthology.orchestra.run.trial069.stdout:Description: Generic Linux kernel image 2026-02-18T00:26:43.466 INFO:teuthology.orchestra.run.trial069.stdout: This package will always depend on the latest generic kernel image 2026-02-18T00:26:43.466 INFO:teuthology.orchestra.run.trial069.stdout: available. 2026-02-18T00:26:43.466 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-164-generic Expected: 5.15.0-170-generic 2026-02-18T00:26:43.467 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-18T00:26:43.467 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-18T00:26:43.467 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2026-02-18T00:26:43.467 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial069.front.sepia.ceph.com, path=None, version=distro) 2026-02-18T00:26:43.467 DEBUG:teuthology.orchestra.run.trial069:> sudo apt-get clean 2026-02-18T00:26:43.546 DEBUG:teuthology.orchestra.run.trial069:> sudo apt-get update 2026-02-18T00:26:43.726 INFO:teuthology.orchestra.run.trial069.stdout:Hit:1 https://archive.ubuntu.com/ubuntu jammy InRelease 2026-02-18T00:26:43.730 INFO:teuthology.orchestra.run.trial069.stdout:Hit:2 https://archive.ubuntu.com/ubuntu jammy-updates InRelease 2026-02-18T00:26:43.740 INFO:teuthology.orchestra.run.trial069.stdout:Hit:3 https://archive.ubuntu.com/ubuntu jammy-security InRelease 2026-02-18T00:26:43.749 INFO:teuthology.orchestra.run.trial069.stdout:Hit:4 https://archive.ubuntu.com/ubuntu jammy-backports InRelease 2026-02-18T00:26:44.566 INFO:teuthology.orchestra.run.trial069.stdout:Reading package lists... 2026-02-18T00:26:44.580 DEBUG:teuthology.orchestra.run.trial069:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2026-02-18T00:26:44.612 INFO:teuthology.orchestra.run.trial069.stdout:Reading package lists... 2026-02-18T00:26:44.717 INFO:teuthology.orchestra.run.trial069.stdout:Building dependency tree... 2026-02-18T00:26:44.717 INFO:teuthology.orchestra.run.trial069.stdout:Reading state information... 2026-02-18T00:26:44.800 INFO:teuthology.orchestra.run.trial069.stdout:linux-image-generic is already the newest version (5.15.0.170.159). 2026-02-18T00:26:44.800 INFO:teuthology.orchestra.run.trial069.stdout:linux-image-generic set to manually installed. 2026-02-18T00:26:44.800 INFO:teuthology.orchestra.run.trial069.stdout:The following packages were automatically installed and are no longer required: 2026-02-18T00:26:44.800 INFO:teuthology.orchestra.run.trial069.stdout: kpartx libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 2026-02-18T00:26:44.800 INFO:teuthology.orchestra.run.trial069.stdout: libgfxdr0 libglusterfs0 libiscsi7 libpmemobj1 libsgutils2-2 sg3-utils 2026-02-18T00:26:44.800 INFO:teuthology.orchestra.run.trial069.stdout: sg3-utils-udev 2026-02-18T00:26:44.800 INFO:teuthology.orchestra.run.trial069.stdout:Use 'sudo apt autoremove' to remove them. 2026-02-18T00:26:44.820 INFO:teuthology.orchestra.run.trial069.stdout:0 upgraded, 0 newly installed, 0 to remove and 53 not upgraded. 2026-02-18T00:26:44.822 DEBUG:teuthology.orchestra.run.trial069:> dpkg -s linux-image-generic 2026-02-18T00:26:44.871 INFO:teuthology.orchestra.run.trial069.stdout:Package: linux-image-generic 2026-02-18T00:26:44.872 INFO:teuthology.orchestra.run.trial069.stdout:Status: install ok installed 2026-02-18T00:26:44.872 INFO:teuthology.orchestra.run.trial069.stdout:Priority: optional 2026-02-18T00:26:44.872 INFO:teuthology.orchestra.run.trial069.stdout:Section: kernel 2026-02-18T00:26:44.872 INFO:teuthology.orchestra.run.trial069.stdout:Installed-Size: 21 2026-02-18T00:26:44.872 INFO:teuthology.orchestra.run.trial069.stdout:Maintainer: Ubuntu Kernel Team 2026-02-18T00:26:44.872 INFO:teuthology.orchestra.run.trial069.stdout:Architecture: amd64 2026-02-18T00:26:44.872 INFO:teuthology.orchestra.run.trial069.stdout:Source: linux-meta 2026-02-18T00:26:44.872 INFO:teuthology.orchestra.run.trial069.stdout:Version: 5.15.0.170.159 2026-02-18T00:26:44.872 INFO:teuthology.orchestra.run.trial069.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.6), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-170), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.6) 2026-02-18T00:26:44.872 INFO:teuthology.orchestra.run.trial069.stdout:Depends: linux-image-5.15.0-170-generic, linux-modules-extra-5.15.0-170-generic, linux-firmware, intel-microcode, amd64-microcode 2026-02-18T00:26:44.872 INFO:teuthology.orchestra.run.trial069.stdout:Recommends: thermald 2026-02-18T00:26:44.872 INFO:teuthology.orchestra.run.trial069.stdout:Description: Generic Linux kernel image 2026-02-18T00:26:44.872 INFO:teuthology.orchestra.run.trial069.stdout: This package will always depend on the latest generic kernel image 2026-02-18T00:26:44.872 INFO:teuthology.orchestra.run.trial069.stdout: available. 2026-02-18T00:26:44.872 DEBUG:teuthology.orchestra.run.trial069:> mktemp 2026-02-18T00:26:44.918 INFO:teuthology.orchestra.run.trial069.stdout:/tmp/tmp.Oa2cQxlPdq 2026-02-18T00:26:44.918 DEBUG:teuthology.orchestra.run.trial069:> sudo cp /boot/grub/grub.cfg /tmp/tmp.Oa2cQxlPdq 2026-02-18T00:26:44.967 DEBUG:teuthology.orchestra.run.trial069:> sudo chmod 0666 /tmp/tmp.Oa2cQxlPdq 2026-02-18T00:26:45.065 DEBUG:teuthology.orchestra.remote:trial069:/tmp/tmp.Oa2cQxlPdq is 7KB 2026-02-18T00:26:45.074 DEBUG:teuthology.orchestra.run.trial069:> rm -fr /tmp/tmp.Oa2cQxlPdq 2026-02-18T00:26:45.078 DEBUG:teuthology.orchestra.run.trial069:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2026-02-18T00:26:45.127 DEBUG:teuthology.orchestra.run.trial069:> set -ex 2026-02-18T00:26:45.127 DEBUG:teuthology.orchestra.run.trial069:> sudo dd of=/etc/grub.d/01_ceph_kernel 2026-02-18T00:26:45.127 DEBUG:teuthology.orchestra.run.trial069:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2026-02-18T00:26:45.185 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-170-generic 2026-02-18T00:26:45.185 DEBUG:teuthology.orchestra.run.trial069:> sudo update-grub 2026-02-18T00:26:45.406 INFO:teuthology.orchestra.run.trial069.stderr:Sourcing file `/etc/default/grub' 2026-02-18T00:26:45.424 INFO:teuthology.orchestra.run.trial069.stderr:Sourcing file `/etc/default/grub.d/50-curtin-settings.cfg' 2026-02-18T00:26:45.425 INFO:teuthology.orchestra.run.trial069.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2026-02-18T00:26:45.427 INFO:teuthology.orchestra.run.trial069.stderr:Generating grub configuration file ... 2026-02-18T00:26:45.508 INFO:teuthology.orchestra.run.trial069.stderr:Found linux image: /boot/vmlinuz-5.15.0-170-generic 2026-02-18T00:26:45.514 INFO:teuthology.orchestra.run.trial069.stderr:Found initrd image: /boot/initrd.img-5.15.0-170-generic 2026-02-18T00:26:45.686 INFO:teuthology.orchestra.run.trial069.stderr:Found linux image: /boot/vmlinuz-5.15.0-164-generic 2026-02-18T00:26:45.691 INFO:teuthology.orchestra.run.trial069.stderr:Found initrd image: /boot/initrd.img-5.15.0-164-generic 2026-02-18T00:26:45.759 INFO:teuthology.orchestra.run.trial069.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2026-02-18T00:26:45.759 INFO:teuthology.orchestra.run.trial069.stderr:Systems on them will not be added to the GRUB boot configuration. 2026-02-18T00:26:45.759 INFO:teuthology.orchestra.run.trial069.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2026-02-18T00:26:45.761 INFO:teuthology.orchestra.run.trial069.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-18T00:26:45.769 INFO:teuthology.orchestra.run.trial069.stderr:done 2026-02-18T00:26:45.770 INFO:teuthology.orchestra.remote:Triggering safe hard reboot via SysRq on trial069 2026-02-18T00:26:45.771 DEBUG:teuthology.orchestra.run.trial069:> sudo bash -c ' 2026-02-18T00:26:45.771 DEBUG:teuthology.orchestra.run.trial069:> echo pci > /sys/kernel/reboot/type && echo 1 > /sys/kernel/reboot/force && sync && echo s > /proc/sysrq-trigger && echo u > /proc/sysrq-trigger && sleep 2 && echo b > /proc/sysrq-trigger 2026-02-18T00:26:45.771 DEBUG:teuthology.orchestra.run.trial069:> ' 2026-02-18T00:27:15.773 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-18T00:27:15.774 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial069.front.sepia.ceph.com' 2026-02-18T00:27:15.775 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-18T00:27:30.048 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 10.20.193.69 2026-02-18T00:27:39.057 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial069.front.sepia.ceph.com' 2026-02-18T00:27:39.058 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-18T00:28:39.120 DEBUG:teuthology.orchestra.remote:timed out 2026-02-18T00:28:51.131 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial069.front.sepia.ceph.com' 2026-02-18T00:28:51.132 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-18T00:28:51.274 DEBUG:teuthology.orchestra.run.trial069:> true 2026-02-18T00:28:51.666 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial069.front.sepia.ceph.com' 2026-02-18T00:28:51.666 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-170-generic"... 2026-02-18T00:28:51.666 DEBUG:teuthology.orchestra.run.trial069:> uname -r 2026-02-18T00:28:51.714 INFO:teuthology.orchestra.run.trial069.stdout:5.15.0-170-generic 2026-02-18T00:28:51.714 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-170-generic vs 5.15.0-170-generic 2026-02-18T00:28:51.715 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2026-02-18T00:28:51.715 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2026-02-18T00:28:52.715 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2026-02-18T00:28:52.716 DEBUG:teuthology.orchestra.run.trial069:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2026-02-18T00:28:52.733 INFO:teuthology.orchestra.run.trial069.stdout:ttyS1 2026-02-18T00:28:52.764 DEBUG:teuthology.parallel:result is None 2026-02-18T00:28:52.764 INFO:teuthology.run_tasks:Running task internal.base... 2026-02-18T00:28:52.793 INFO:teuthology.task.internal:Creating test directory... 2026-02-18T00:28:52.793 DEBUG:teuthology.orchestra.run.trial069:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-18T00:28:52.809 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2026-02-18T00:28:52.822 INFO:teuthology.run_tasks:Running task internal.archive... 2026-02-18T00:28:52.835 INFO:teuthology.task.internal:Creating archive directory... 2026-02-18T00:28:52.835 DEBUG:teuthology.orchestra.run.trial069:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-18T00:28:52.861 INFO:teuthology.run_tasks:Running task internal.coredump... 2026-02-18T00:28:52.873 INFO:teuthology.task.internal:Enabling coredump saving... 2026-02-18T00:28:52.873 DEBUG:teuthology.orchestra.run.trial069:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-18T00:28:52.907 INFO:teuthology.orchestra.run.trial069.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:28:52.913 INFO:teuthology.orchestra.run.trial069.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:28:52.915 INFO:teuthology.run_tasks:Running task internal.sudo... 2026-02-18T00:28:52.926 INFO:teuthology.task.internal:Configuring sudo... 2026-02-18T00:28:52.927 DEBUG:teuthology.orchestra.run.trial069:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-18T00:28:52.967 INFO:teuthology.run_tasks:Running task internal.syslog... 2026-02-18T00:28:52.982 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2026-02-18T00:28:52.983 DEBUG:teuthology.orchestra.run.trial069:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-18T00:28:53.014 DEBUG:teuthology.orchestra.run.trial069:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-18T00:28:53.058 DEBUG:teuthology.orchestra.run.trial069:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-18T00:28:53.102 DEBUG:teuthology.orchestra.run.trial069:> set -ex 2026-02-18T00:28:53.102 DEBUG:teuthology.orchestra.run.trial069:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-18T00:28:53.150 DEBUG:teuthology.orchestra.run.trial069:> sudo service rsyslog restart 2026-02-18T00:28:53.207 INFO:teuthology.run_tasks:Running task internal.timer... 2026-02-18T00:28:53.220 INFO:teuthology.task.internal:Starting timer... 2026-02-18T00:28:53.220 INFO:teuthology.run_tasks:Running task pcp... 2026-02-18T00:28:53.241 INFO:teuthology.run_tasks:Running task selinux... 2026-02-18T00:28:53.259 DEBUG:teuthology.task.selinux:Excluding trial069: OS 'ubuntu' does not support SELinux 2026-02-18T00:28:53.259 DEBUG:teuthology.task.selinux:Getting current SELinux state 2026-02-18T00:28:53.259 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2026-02-18T00:28:53.259 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2026-02-18T00:28:53.259 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2026-02-18T00:28:53.274 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2026-02-18T00:28:53.286 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2026-02-18T00:28:53.287 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit trial069.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2026-02-18T00:29:53.256 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@trial069.front.sepia.ceph.com')] 2026-02-18T00:29:53.258 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial069.front.sepia.ceph.com' 2026-02-18T00:29:53.260 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-18T00:29:53.370 DEBUG:teuthology.orchestra.run.trial069:> true 2026-02-18T00:29:53.613 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial069.front.sepia.ceph.com' 2026-02-18T00:29:53.613 INFO:teuthology.run_tasks:Running task clock... 2026-02-18T00:29:53.625 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2026-02-18T00:29:53.626 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-18T00:29:53.626 DEBUG:teuthology.orchestra.run.trial069:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-18T00:29:53.672 INFO:teuthology.orchestra.run.trial069.stdout:18 Feb 00:29:53 ntpd[4908]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2026-02-18T00:29:53.672 INFO:teuthology.orchestra.run.trial069.stdout:18 Feb 00:29:53 ntpd[4908]: Command line: ntpd -gq 2026-02-18T00:29:53.672 INFO:teuthology.orchestra.run.trial069.stdout:18 Feb 00:29:53 ntpd[4908]: ---------------------------------------------------- 2026-02-18T00:29:53.672 INFO:teuthology.orchestra.run.trial069.stdout:18 Feb 00:29:53 ntpd[4908]: ntp-4 is maintained by Network Time Foundation, 2026-02-18T00:29:53.672 INFO:teuthology.orchestra.run.trial069.stdout:18 Feb 00:29:53 ntpd[4908]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2026-02-18T00:29:53.672 INFO:teuthology.orchestra.run.trial069.stdout:18 Feb 00:29:53 ntpd[4908]: corporation. Support and training for ntp-4 are 2026-02-18T00:29:53.672 INFO:teuthology.orchestra.run.trial069.stdout:18 Feb 00:29:53 ntpd[4908]: available at https://www.nwtime.org/support 2026-02-18T00:29:53.673 INFO:teuthology.orchestra.run.trial069.stdout:18 Feb 00:29:53 ntpd[4908]: ---------------------------------------------------- 2026-02-18T00:29:53.673 INFO:teuthology.orchestra.run.trial069.stdout:18 Feb 00:29:53 ntpd[4908]: proto: precision = 0.020 usec (-25) 2026-02-18T00:29:53.673 INFO:teuthology.orchestra.run.trial069.stdout:18 Feb 00:29:53 ntpd[4908]: basedate set to 2022-02-04 2026-02-18T00:29:53.673 INFO:teuthology.orchestra.run.trial069.stdout:18 Feb 00:29:53 ntpd[4908]: gps base set to 2022-02-06 (week 2196) 2026-02-18T00:29:53.673 INFO:teuthology.orchestra.run.trial069.stdout:18 Feb 00:29:53 ntpd[4908]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2026-02-18T00:29:53.673 INFO:teuthology.orchestra.run.trial069.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2026-02-18T00:29:53.673 INFO:teuthology.orchestra.run.trial069.stderr:restrict ::: KOD does nothing without LIMITED. 2026-02-18T00:29:53.673 INFO:teuthology.orchestra.run.trial069.stdout:18 Feb 00:29:53 ntpd[4908]: restrict ::: KOD does nothing without LIMITED. 2026-02-18T00:29:53.673 INFO:teuthology.orchestra.run.trial069.stdout:18 Feb 00:29:53 ntpd[4908]: Listen and drop on 0 v6wildcard [::]:123 2026-02-18T00:29:53.673 INFO:teuthology.orchestra.run.trial069.stdout:18 Feb 00:29:53 ntpd[4908]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2026-02-18T00:29:53.674 INFO:teuthology.orchestra.run.trial069.stdout:18 Feb 00:29:53 ntpd[4908]: Listen normally on 2 lo 127.0.0.1:123 2026-02-18T00:29:53.674 INFO:teuthology.orchestra.run.trial069.stdout:18 Feb 00:29:53 ntpd[4908]: Listen normally on 3 enp1s0f0 10.20.193.69:123 2026-02-18T00:29:53.674 INFO:teuthology.orchestra.run.trial069.stdout:18 Feb 00:29:53 ntpd[4908]: Listen normally on 4 lo [::1]:123 2026-02-18T00:29:53.674 INFO:teuthology.orchestra.run.trial069.stdout:18 Feb 00:29:53 ntpd[4908]: Listen normally on 5 enp1s0f0 [fe80::925a:8ff:fe77:60f6%2]:123 2026-02-18T00:29:53.674 INFO:teuthology.orchestra.run.trial069.stdout:18 Feb 00:29:53 ntpd[4908]: Listening on routing socket on fd #22 for interface updates 2026-02-18T00:29:54.673 INFO:teuthology.orchestra.run.trial069.stderr:18 Feb 00:29:54 ntpd[4908]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-18T00:29:54.673 INFO:teuthology.orchestra.run.trial069.stderr:18 Feb 00:29:54 ntpd[4908]: can't open /var/log/ntpstats/rawstats.20260218: Permission denied 2026-02-18T00:29:54.673 INFO:teuthology.orchestra.run.trial069.stderr:18 Feb 00:29:54 ntpd[4908]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-18T00:29:54.673 INFO:teuthology.orchestra.run.trial069.stderr:18 Feb 00:29:54 ntpd[4908]: can't open /var/log/ntpstats/rawstats.20260218: Permission denied 2026-02-18T00:29:54.703 INFO:teuthology.orchestra.run.trial069.stderr:18 Feb 00:29:54 ntpd[4908]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-18T00:29:54.703 INFO:teuthology.orchestra.run.trial069.stderr:18 Feb 00:29:54 ntpd[4908]: can't open /var/log/ntpstats/rawstats.20260218: Permission denied 2026-02-18T00:29:54.703 INFO:teuthology.orchestra.run.trial069.stderr:18 Feb 00:29:54 ntpd[4908]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-18T00:29:54.703 INFO:teuthology.orchestra.run.trial069.stderr:18 Feb 00:29:54 ntpd[4908]: can't open /var/log/ntpstats/peerstats.20260218: Permission denied 2026-02-18T00:29:54.710 INFO:teuthology.orchestra.run.trial069.stderr:18 Feb 00:29:54 ntpd[4908]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-18T00:29:54.710 INFO:teuthology.orchestra.run.trial069.stderr:18 Feb 00:29:54 ntpd[4908]: can't open /var/log/ntpstats/rawstats.20260218: Permission denied 2026-02-18T00:29:54.710 INFO:teuthology.orchestra.run.trial069.stderr:18 Feb 00:29:54 ntpd[4908]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-18T00:29:54.710 INFO:teuthology.orchestra.run.trial069.stderr:18 Feb 00:29:54 ntpd[4908]: can't open /var/log/ntpstats/peerstats.20260218: Permission denied 2026-02-18T00:29:56.674 INFO:teuthology.orchestra.run.trial069.stderr:18 Feb 00:29:56 ntpd[4908]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-18T00:29:56.674 INFO:teuthology.orchestra.run.trial069.stderr:18 Feb 00:29:56 ntpd[4908]: can't open /var/log/ntpstats/rawstats.20260218: Permission denied 2026-02-18T00:29:56.674 INFO:teuthology.orchestra.run.trial069.stderr:18 Feb 00:29:56 ntpd[4908]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-18T00:29:56.674 INFO:teuthology.orchestra.run.trial069.stderr:18 Feb 00:29:56 ntpd[4908]: can't open /var/log/ntpstats/rawstats.20260218: Permission denied 2026-02-18T00:29:56.674 INFO:teuthology.orchestra.run.trial069.stderr:18 Feb 00:29:56 ntpd[4908]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-18T00:29:56.674 INFO:teuthology.orchestra.run.trial069.stderr:18 Feb 00:29:56 ntpd[4908]: can't open /var/log/ntpstats/rawstats.20260218: Permission denied 2026-02-18T00:29:56.674 INFO:teuthology.orchestra.run.trial069.stderr:18 Feb 00:29:56 ntpd[4908]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-18T00:29:56.674 INFO:teuthology.orchestra.run.trial069.stderr:18 Feb 00:29:56 ntpd[4908]: can't open /var/log/ntpstats/rawstats.20260218: Permission denied 2026-02-18T00:29:56.692 INFO:teuthology.orchestra.run.trial069.stderr:18 Feb 00:29:56 ntpd[4908]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-18T00:29:56.692 INFO:teuthology.orchestra.run.trial069.stderr:18 Feb 00:29:56 ntpd[4908]: can't open /var/log/ntpstats/rawstats.20260218: Permission denied 2026-02-18T00:29:56.692 INFO:teuthology.orchestra.run.trial069.stderr:18 Feb 00:29:56 ntpd[4908]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-18T00:29:56.692 INFO:teuthology.orchestra.run.trial069.stderr:18 Feb 00:29:56 ntpd[4908]: can't open /var/log/ntpstats/peerstats.20260218: Permission denied 2026-02-18T00:29:56.695 INFO:teuthology.orchestra.run.trial069.stderr:18 Feb 00:29:56 ntpd[4908]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-18T00:29:56.695 INFO:teuthology.orchestra.run.trial069.stderr:18 Feb 00:29:56 ntpd[4908]: can't open /var/log/ntpstats/rawstats.20260218: Permission denied 2026-02-18T00:29:56.695 INFO:teuthology.orchestra.run.trial069.stderr:18 Feb 00:29:56 ntpd[4908]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-18T00:29:56.695 INFO:teuthology.orchestra.run.trial069.stderr:18 Feb 00:29:56 ntpd[4908]: can't open /var/log/ntpstats/peerstats.20260218: Permission denied 2026-02-18T00:29:56.703 INFO:teuthology.orchestra.run.trial069.stderr:18 Feb 00:29:56 ntpd[4908]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-18T00:29:56.703 INFO:teuthology.orchestra.run.trial069.stderr:18 Feb 00:29:56 ntpd[4908]: can't open /var/log/ntpstats/rawstats.20260218: Permission denied 2026-02-18T00:29:56.703 INFO:teuthology.orchestra.run.trial069.stderr:18 Feb 00:29:56 ntpd[4908]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-18T00:29:56.703 INFO:teuthology.orchestra.run.trial069.stderr:18 Feb 00:29:56 ntpd[4908]: can't open /var/log/ntpstats/peerstats.20260218: Permission denied 2026-02-18T00:29:56.711 INFO:teuthology.orchestra.run.trial069.stderr:18 Feb 00:29:56 ntpd[4908]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-18T00:29:56.711 INFO:teuthology.orchestra.run.trial069.stderr:18 Feb 00:29:56 ntpd[4908]: can't open /var/log/ntpstats/rawstats.20260218: Permission denied 2026-02-18T00:29:56.711 INFO:teuthology.orchestra.run.trial069.stderr:18 Feb 00:29:56 ntpd[4908]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-18T00:29:56.711 INFO:teuthology.orchestra.run.trial069.stderr:18 Feb 00:29:56 ntpd[4908]: can't open /var/log/ntpstats/peerstats.20260218: Permission denied 2026-02-18T00:29:58.674 INFO:teuthology.orchestra.run.trial069.stderr:18 Feb 00:29:58 ntpd[4908]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-18T00:29:58.674 INFO:teuthology.orchestra.run.trial069.stderr:18 Feb 00:29:58 ntpd[4908]: can't open /var/log/ntpstats/rawstats.20260218: Permission denied 2026-02-18T00:29:58.674 INFO:teuthology.orchestra.run.trial069.stderr:18 Feb 00:29:58 ntpd[4908]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-18T00:29:58.674 INFO:teuthology.orchestra.run.trial069.stderr:18 Feb 00:29:58 ntpd[4908]: can't open /var/log/ntpstats/rawstats.20260218: Permission denied 2026-02-18T00:29:58.674 INFO:teuthology.orchestra.run.trial069.stderr:18 Feb 00:29:58 ntpd[4908]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-18T00:29:58.674 INFO:teuthology.orchestra.run.trial069.stderr:18 Feb 00:29:58 ntpd[4908]: can't open /var/log/ntpstats/rawstats.20260218: Permission denied 2026-02-18T00:29:58.675 INFO:teuthology.orchestra.run.trial069.stderr:18 Feb 00:29:58 ntpd[4908]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-18T00:29:58.675 INFO:teuthology.orchestra.run.trial069.stderr:18 Feb 00:29:58 ntpd[4908]: can't open /var/log/ntpstats/rawstats.20260218: Permission denied 2026-02-18T00:29:58.692 INFO:teuthology.orchestra.run.trial069.stderr:18 Feb 00:29:58 ntpd[4908]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-18T00:29:58.692 INFO:teuthology.orchestra.run.trial069.stderr:18 Feb 00:29:58 ntpd[4908]: can't open /var/log/ntpstats/rawstats.20260218: Permission denied 2026-02-18T00:29:58.692 INFO:teuthology.orchestra.run.trial069.stderr:18 Feb 00:29:58 ntpd[4908]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-18T00:29:58.692 INFO:teuthology.orchestra.run.trial069.stderr:18 Feb 00:29:58 ntpd[4908]: can't open /var/log/ntpstats/peerstats.20260218: Permission denied 2026-02-18T00:29:58.694 INFO:teuthology.orchestra.run.trial069.stderr:18 Feb 00:29:58 ntpd[4908]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-18T00:29:58.695 INFO:teuthology.orchestra.run.trial069.stderr:18 Feb 00:29:58 ntpd[4908]: can't open /var/log/ntpstats/rawstats.20260218: Permission denied 2026-02-18T00:29:58.695 INFO:teuthology.orchestra.run.trial069.stderr:18 Feb 00:29:58 ntpd[4908]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-18T00:29:58.695 INFO:teuthology.orchestra.run.trial069.stderr:18 Feb 00:29:58 ntpd[4908]: can't open /var/log/ntpstats/peerstats.20260218: Permission denied 2026-02-18T00:29:58.703 INFO:teuthology.orchestra.run.trial069.stderr:18 Feb 00:29:58 ntpd[4908]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-18T00:29:58.703 INFO:teuthology.orchestra.run.trial069.stderr:18 Feb 00:29:58 ntpd[4908]: can't open /var/log/ntpstats/rawstats.20260218: Permission denied 2026-02-18T00:29:58.703 INFO:teuthology.orchestra.run.trial069.stderr:18 Feb 00:29:58 ntpd[4908]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-18T00:29:58.703 INFO:teuthology.orchestra.run.trial069.stderr:18 Feb 00:29:58 ntpd[4908]: can't open /var/log/ntpstats/peerstats.20260218: Permission denied 2026-02-18T00:29:58.711 INFO:teuthology.orchestra.run.trial069.stderr:18 Feb 00:29:58 ntpd[4908]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-18T00:29:58.711 INFO:teuthology.orchestra.run.trial069.stderr:18 Feb 00:29:58 ntpd[4908]: can't open /var/log/ntpstats/rawstats.20260218: Permission denied 2026-02-18T00:29:58.711 INFO:teuthology.orchestra.run.trial069.stderr:18 Feb 00:29:58 ntpd[4908]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-18T00:29:58.711 INFO:teuthology.orchestra.run.trial069.stderr:18 Feb 00:29:58 ntpd[4908]: can't open /var/log/ntpstats/peerstats.20260218: Permission denied 2026-02-18T00:30:00.673 INFO:teuthology.orchestra.run.trial069.stderr:18 Feb 00:30:00 ntpd[4908]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-18T00:30:00.673 INFO:teuthology.orchestra.run.trial069.stderr:18 Feb 00:30:00 ntpd[4908]: can't open /var/log/ntpstats/rawstats.20260218: Permission denied 2026-02-18T00:30:00.673 INFO:teuthology.orchestra.run.trial069.stderr:18 Feb 00:30:00 ntpd[4908]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-18T00:30:00.673 INFO:teuthology.orchestra.run.trial069.stderr:18 Feb 00:30:00 ntpd[4908]: can't open /var/log/ntpstats/rawstats.20260218: Permission denied 2026-02-18T00:30:00.673 INFO:teuthology.orchestra.run.trial069.stderr:18 Feb 00:30:00 ntpd[4908]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-18T00:30:00.673 INFO:teuthology.orchestra.run.trial069.stderr:18 Feb 00:30:00 ntpd[4908]: can't open /var/log/ntpstats/rawstats.20260218: Permission denied 2026-02-18T00:30:00.673 INFO:teuthology.orchestra.run.trial069.stderr:18 Feb 00:30:00 ntpd[4908]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-18T00:30:00.673 INFO:teuthology.orchestra.run.trial069.stderr:18 Feb 00:30:00 ntpd[4908]: can't open /var/log/ntpstats/rawstats.20260218: Permission denied 2026-02-18T00:30:00.691 INFO:teuthology.orchestra.run.trial069.stderr:18 Feb 00:30:00 ntpd[4908]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-18T00:30:00.692 INFO:teuthology.orchestra.run.trial069.stderr:18 Feb 00:30:00 ntpd[4908]: can't open /var/log/ntpstats/rawstats.20260218: Permission denied 2026-02-18T00:30:00.692 INFO:teuthology.orchestra.run.trial069.stderr:18 Feb 00:30:00 ntpd[4908]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-18T00:30:00.692 INFO:teuthology.orchestra.run.trial069.stderr:18 Feb 00:30:00 ntpd[4908]: can't open /var/log/ntpstats/peerstats.20260218: Permission denied 2026-02-18T00:30:00.694 INFO:teuthology.orchestra.run.trial069.stderr:18 Feb 00:30:00 ntpd[4908]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-18T00:30:00.694 INFO:teuthology.orchestra.run.trial069.stderr:18 Feb 00:30:00 ntpd[4908]: can't open /var/log/ntpstats/rawstats.20260218: Permission denied 2026-02-18T00:30:00.694 INFO:teuthology.orchestra.run.trial069.stderr:18 Feb 00:30:00 ntpd[4908]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-18T00:30:00.694 INFO:teuthology.orchestra.run.trial069.stderr:18 Feb 00:30:00 ntpd[4908]: can't open /var/log/ntpstats/peerstats.20260218: Permission denied 2026-02-18T00:30:00.702 INFO:teuthology.orchestra.run.trial069.stderr:18 Feb 00:30:00 ntpd[4908]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-18T00:30:00.702 INFO:teuthology.orchestra.run.trial069.stderr:18 Feb 00:30:00 ntpd[4908]: can't open /var/log/ntpstats/rawstats.20260218: Permission denied 2026-02-18T00:30:00.703 INFO:teuthology.orchestra.run.trial069.stderr:18 Feb 00:30:00 ntpd[4908]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-18T00:30:00.703 INFO:teuthology.orchestra.run.trial069.stderr:18 Feb 00:30:00 ntpd[4908]: can't open /var/log/ntpstats/peerstats.20260218: Permission denied 2026-02-18T00:30:00.703 INFO:teuthology.orchestra.run.trial069.stdout:18 Feb 00:30:00 ntpd[4908]: ntpd: time set +0.556823 s 2026-02-18T00:30:00.703 INFO:teuthology.orchestra.run.trial069.stdout:ntpd: time set +0.556823s 2026-02-18T00:30:00.703 INFO:teuthology.orchestra.run.trial069.stderr:18 Feb 00:30:00 ntpd[4908]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2026-02-18T00:30:00.703 INFO:teuthology.orchestra.run.trial069.stderr:18 Feb 00:30:00 ntpd[4908]: can't open /var/log/ntpstats/loopstats.20260218: Permission denied 2026-02-18T00:30:00.763 INFO:teuthology.orchestra.run.trial069.stdout: remote refid st t when poll reach delay offset jitter 2026-02-18T00:30:00.763 INFO:teuthology.orchestra.run.trial069.stdout:============================================================================== 2026-02-18T00:30:00.763 INFO:teuthology.orchestra.run.trial069.stdout: 66.42.71.197 (6 .INIT. 16 u - 64 0 0.000 +0.000 0.000 2026-02-18T00:30:00.763 INFO:teuthology.orchestra.run.trial069.stdout: 69.164.213.136 .INIT. 16 u - 64 0 0.000 +0.000 0.000 2026-02-18T00:30:00.763 INFO:teuthology.orchestra.run.trial069.stdout: 38.45.64.130 .INIT. 16 u - 64 0 0.000 +0.000 0.000 2026-02-18T00:30:00.763 INFO:teuthology.orchestra.run.trial069.stdout: ntp0.alb1.inoc. .INIT. 16 u - 64 0 0.000 +0.000 0.000 2026-02-18T00:30:00.764 INFO:teuthology.run_tasks:Running task install... 2026-02-18T00:30:00.777 DEBUG:teuthology.task.install:project ceph 2026-02-18T00:30:00.777 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'adc1923395f2bcd6ae89b5d331d278364d1848ed'}} 2026-02-18T00:30:00.777 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': 'adc1923395f2bcd6ae89b5d331d278364d1848ed'} 2026-02-18T00:30:00.777 INFO:teuthology.task.install:Using flavor: default 2026-02-18T00:30:00.780 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2026-02-18T00:30:00.780 INFO:teuthology.task.install:extra packages: [] 2026-02-18T00:30:00.780 DEBUG:teuthology.orchestra.run.trial069:> sudo apt-key list | grep Ceph 2026-02-18T00:30:00.856 INFO:teuthology.orchestra.run.trial069.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2026-02-18T00:30:00.885 INFO:teuthology.orchestra.run.trial069.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2026-02-18T00:30:00.885 INFO:teuthology.orchestra.run.trial069.stdout:uid [ unknown] Ceph.com (release key) 2026-02-18T00:30:00.886 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2026-02-18T00:30:00.886 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=adc1923395f2bcd6ae89b5d331d278364d1848ed 2026-02-18T00:30:01.014 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/20.2.1_2.17.26-baseline_2/adc1923395f2bcd6ae89b5d331d278364d1848ed/ubuntu/jammy/flavors/default/ 2026-02-18T00:30:01.014 INFO:teuthology.task.install.deb:Package version is 20.2.0-670-gadc19233-1jammy 2026-02-18T00:30:01.126 DEBUG:teuthology.orchestra.run.trial069:> set -ex 2026-02-18T00:30:01.126 DEBUG:teuthology.orchestra.run.trial069:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2026-02-18T00:30:01.136 DEBUG:teuthology.orchestra.run.trial069:> sudo apt-get update 2026-02-18T00:30:01.296 INFO:teuthology.orchestra.run.trial069.stdout:Ign:1 https://2.chacra.ceph.com/r/ceph/20.2.1_2.17.26-baseline_2/adc1923395f2bcd6ae89b5d331d278364d1848ed/ubuntu/jammy/flavors/default jammy InRelease 2026-02-18T00:30:01.307 INFO:teuthology.orchestra.run.trial069.stdout:Get:2 https://2.chacra.ceph.com/r/ceph/20.2.1_2.17.26-baseline_2/adc1923395f2bcd6ae89b5d331d278364d1848ed/ubuntu/jammy/flavors/default jammy Release [7680 B] 2026-02-18T00:30:01.319 INFO:teuthology.orchestra.run.trial069.stdout:Ign:3 https://2.chacra.ceph.com/r/ceph/20.2.1_2.17.26-baseline_2/adc1923395f2bcd6ae89b5d331d278364d1848ed/ubuntu/jammy/flavors/default jammy Release.gpg 2026-02-18T00:30:01.330 INFO:teuthology.orchestra.run.trial069.stdout:Get:4 https://2.chacra.ceph.com/r/ceph/20.2.1_2.17.26-baseline_2/adc1923395f2bcd6ae89b5d331d278364d1848ed/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.8 kB] 2026-02-18T00:30:01.644 INFO:teuthology.orchestra.run.trial069.stdout:Hit:5 https://archive.ubuntu.com/ubuntu jammy InRelease 2026-02-18T00:30:01.726 INFO:teuthology.orchestra.run.trial069.stdout:Hit:6 https://archive.ubuntu.com/ubuntu jammy-updates InRelease 2026-02-18T00:30:01.815 INFO:teuthology.orchestra.run.trial069.stdout:Hit:7 https://archive.ubuntu.com/ubuntu jammy-security InRelease 2026-02-18T00:30:01.903 INFO:teuthology.orchestra.run.trial069.stdout:Hit:8 https://archive.ubuntu.com/ubuntu jammy-backports InRelease 2026-02-18T00:30:02.039 INFO:teuthology.orchestra.run.trial069.stdout:Fetched 26.5 kB in 1s (35.5 kB/s) 2026-02-18T00:30:02.548 INFO:teuthology.orchestra.run.trial069.stdout:Reading package lists... 2026-02-18T00:30:02.561 DEBUG:teuthology.orchestra.run.trial069:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=20.2.0-670-gadc19233-1jammy cephadm=20.2.0-670-gadc19233-1jammy ceph-mds=20.2.0-670-gadc19233-1jammy ceph-mgr=20.2.0-670-gadc19233-1jammy ceph-common=20.2.0-670-gadc19233-1jammy ceph-fuse=20.2.0-670-gadc19233-1jammy ceph-test=20.2.0-670-gadc19233-1jammy ceph-volume=20.2.0-670-gadc19233-1jammy radosgw=20.2.0-670-gadc19233-1jammy python3-rados=20.2.0-670-gadc19233-1jammy python3-rgw=20.2.0-670-gadc19233-1jammy python3-cephfs=20.2.0-670-gadc19233-1jammy python3-rbd=20.2.0-670-gadc19233-1jammy libcephfs2=20.2.0-670-gadc19233-1jammy libcephfs-dev=20.2.0-670-gadc19233-1jammy librados2=20.2.0-670-gadc19233-1jammy librbd1=20.2.0-670-gadc19233-1jammy rbd-fuse=20.2.0-670-gadc19233-1jammy 2026-02-18T00:30:02.592 INFO:teuthology.orchestra.run.trial069.stdout:Reading package lists... 2026-02-18T00:30:02.699 INFO:teuthology.orchestra.run.trial069.stdout:Building dependency tree... 2026-02-18T00:30:02.699 INFO:teuthology.orchestra.run.trial069.stdout:Reading state information... 2026-02-18T00:30:02.784 INFO:teuthology.orchestra.run.trial069.stdout:The following packages were automatically installed and are no longer required: 2026-02-18T00:30:02.784 INFO:teuthology.orchestra.run.trial069.stdout: kpartx libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 2026-02-18T00:30:02.784 INFO:teuthology.orchestra.run.trial069.stdout: libgfxdr0 libglusterfs0 libiscsi7 libpmemobj1 libsgutils2-2 sg3-utils 2026-02-18T00:30:02.784 INFO:teuthology.orchestra.run.trial069.stdout: sg3-utils-udev 2026-02-18T00:30:02.784 INFO:teuthology.orchestra.run.trial069.stdout:Use 'sudo apt autoremove' to remove them. 2026-02-18T00:30:02.785 INFO:teuthology.orchestra.run.trial069.stdout:The following additional packages will be installed: 2026-02-18T00:30:02.785 INFO:teuthology.orchestra.run.trial069.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2026-02-18T00:30:02.785 INFO:teuthology.orchestra.run.trial069.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2026-02-18T00:30:02.785 INFO:teuthology.orchestra.run.trial069.stdout: libcephfs-daemon libcephfs-proxy2 libdouble-conversion3 libfuse2 libjq1 2026-02-18T00:30:02.785 INFO:teuthology.orchestra.run.trial069.stdout: liblttng-ust1 libnbd0 liboath0 libonig5 libpcre2-16-0 libqt5core5a 2026-02-18T00:30:02.785 INFO:teuthology.orchestra.run.trial069.stdout: libqt5dbus5 libqt5network5 libradosstriper1 librdkafka1 librgw2 2026-02-18T00:30:02.785 INFO:teuthology.orchestra.run.trial069.stdout: libsqlite3-mod-ceph libthrift-0.16.0 nvme-cli python-asyncssh-doc 2026-02-18T00:30:02.785 INFO:teuthology.orchestra.run.trial069.stdout: python3-asyncssh python3-cachetools python3-ceph-argparse 2026-02-18T00:30:02.785 INFO:teuthology.orchestra.run.trial069.stdout: python3-ceph-common python3-cheroot python3-cherrypy3 python3-google-auth 2026-02-18T00:30:02.785 INFO:teuthology.orchestra.run.trial069.stdout: python3-iniconfig python3-jaraco.classes python3-jaraco.collections 2026-02-18T00:30:02.785 INFO:teuthology.orchestra.run.trial069.stdout: python3-jaraco.functools python3-jaraco.text python3-joblib 2026-02-18T00:30:02.785 INFO:teuthology.orchestra.run.trial069.stdout: python3-kubernetes python3-natsort python3-pluggy python3-portend 2026-02-18T00:30:02.785 INFO:teuthology.orchestra.run.trial069.stdout: python3-prettytable python3-psutil python3-py python3-pygments 2026-02-18T00:30:02.785 INFO:teuthology.orchestra.run.trial069.stdout: python3-pytest python3-repoze.lru python3-requests-oauthlib python3-routes 2026-02-18T00:30:02.785 INFO:teuthology.orchestra.run.trial069.stdout: python3-rsa python3-simplejson python3-sklearn python3-sklearn-lib 2026-02-18T00:30:02.785 INFO:teuthology.orchestra.run.trial069.stdout: python3-tempora python3-threadpoolctl python3-toml python3-wcwidth 2026-02-18T00:30:02.785 INFO:teuthology.orchestra.run.trial069.stdout: python3-webob python3-websocket python3-zc.lockfile qttranslations5-l10n 2026-02-18T00:30:02.785 INFO:teuthology.orchestra.run.trial069.stdout: socat xmlstarlet 2026-02-18T00:30:02.785 INFO:teuthology.orchestra.run.trial069.stdout:Suggested packages: 2026-02-18T00:30:02.785 INFO:teuthology.orchestra.run.trial069.stdout: python3-influxdb liblua5.3-dev luarocks python-natsort-doc python-psutil-doc 2026-02-18T00:30:02.785 INFO:teuthology.orchestra.run.trial069.stdout: subversion python-pygments-doc ttf-bitstream-vera python3-paste python3-dap 2026-02-18T00:30:02.785 INFO:teuthology.orchestra.run.trial069.stdout: python-sklearn-doc ipython3 python-webob-doc 2026-02-18T00:30:02.785 INFO:teuthology.orchestra.run.trial069.stdout:Recommended packages: 2026-02-18T00:30:02.785 INFO:teuthology.orchestra.run.trial069.stdout: btrfs-tools 2026-02-18T00:30:02.819 INFO:teuthology.orchestra.run.trial069.stdout:The following NEW packages will be installed: 2026-02-18T00:30:02.819 INFO:teuthology.orchestra.run.trial069.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2026-02-18T00:30:02.819 INFO:teuthology.orchestra.run.trial069.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2026-02-18T00:30:02.819 INFO:teuthology.orchestra.run.trial069.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2026-02-18T00:30:02.819 INFO:teuthology.orchestra.run.trial069.stdout: libcephfs-daemon libcephfs-dev libcephfs-proxy2 libcephfs2 2026-02-18T00:30:02.819 INFO:teuthology.orchestra.run.trial069.stdout: libdouble-conversion3 libfuse2 libjq1 liblttng-ust1 libnbd0 liboath0 2026-02-18T00:30:02.819 INFO:teuthology.orchestra.run.trial069.stdout: libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2026-02-18T00:30:02.819 INFO:teuthology.orchestra.run.trial069.stdout: libradosstriper1 librbd1 librdkafka1 librgw2 libsqlite3-mod-ceph 2026-02-18T00:30:02.819 INFO:teuthology.orchestra.run.trial069.stdout: libthrift-0.16.0 nvme-cli python-asyncssh-doc python3-asyncssh 2026-02-18T00:30:02.819 INFO:teuthology.orchestra.run.trial069.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2026-02-18T00:30:02.819 INFO:teuthology.orchestra.run.trial069.stdout: python3-cheroot python3-cherrypy3 python3-google-auth python3-iniconfig 2026-02-18T00:30:02.819 INFO:teuthology.orchestra.run.trial069.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2026-02-18T00:30:02.819 INFO:teuthology.orchestra.run.trial069.stdout: python3-jaraco.text python3-joblib python3-kubernetes python3-natsort 2026-02-18T00:30:02.819 INFO:teuthology.orchestra.run.trial069.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2026-02-18T00:30:02.819 INFO:teuthology.orchestra.run.trial069.stdout: python3-pygments python3-pytest python3-rados python3-rbd python3-repoze.lru 2026-02-18T00:30:02.819 INFO:teuthology.orchestra.run.trial069.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2026-02-18T00:30:02.819 INFO:teuthology.orchestra.run.trial069.stdout: python3-simplejson python3-sklearn python3-sklearn-lib python3-tempora 2026-02-18T00:30:02.819 INFO:teuthology.orchestra.run.trial069.stdout: python3-threadpoolctl python3-toml python3-wcwidth python3-webob 2026-02-18T00:30:02.819 INFO:teuthology.orchestra.run.trial069.stdout: python3-websocket python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2026-02-18T00:30:02.819 INFO:teuthology.orchestra.run.trial069.stdout: socat xmlstarlet 2026-02-18T00:30:02.898 INFO:teuthology.orchestra.run.trial069.stdout:0 upgraded, 86 newly installed, 0 to remove and 53 not upgraded. 2026-02-18T00:30:02.898 INFO:teuthology.orchestra.run.trial069.stdout:Need to get 280 MB of archives. 2026-02-18T00:30:02.898 INFO:teuthology.orchestra.run.trial069.stdout:After this operation, 1119 MB of additional disk space will be used. 2026-02-18T00:30:02.898 INFO:teuthology.orchestra.run.trial069.stdout:Get:1 https://2.chacra.ceph.com/r/ceph/20.2.1_2.17.26-baseline_2/adc1923395f2bcd6ae89b5d331d278364d1848ed/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 20.2.0-670-gadc19233-1jammy [3561 kB] 2026-02-18T00:30:02.942 INFO:teuthology.orchestra.run.trial069.stdout:Get:2 https://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2026-02-18T00:30:02.987 INFO:teuthology.orchestra.run.trial069.stdout:Get:3 https://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2026-02-18T00:30:02.988 INFO:teuthology.orchestra.run.trial069.stdout:Get:4 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2026-02-18T00:30:02.998 INFO:teuthology.orchestra.run.trial069.stdout:Get:5 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2006 kB] 2026-02-18T00:30:03.000 INFO:teuthology.orchestra.run.trial069.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/20.2.1_2.17.26-baseline_2/adc1923395f2bcd6ae89b5d331d278364d1848ed/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 20.2.0-670-gadc19233-1jammy [2867 kB] 2026-02-18T00:30:03.026 INFO:teuthology.orchestra.run.trial069.stdout:Get:7 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2026-02-18T00:30:03.028 INFO:teuthology.orchestra.run.trial069.stdout:Get:8 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2026-02-18T00:30:03.033 INFO:teuthology.orchestra.run.trial069.stdout:Get:9 https://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2026-02-18T00:30:03.035 INFO:teuthology.orchestra.run.trial069.stdout:Get:10 https://archive.ubuntu.com/ubuntu jammy/universe amd64 libnbd0 amd64 1.10.5-1 [71.3 kB] 2026-02-18T00:30:03.036 INFO:teuthology.orchestra.run.trial069.stdout:Get:11 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2026-02-18T00:30:03.036 INFO:teuthology.orchestra.run.trial069.stdout:Get:12 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2026-02-18T00:30:03.036 INFO:teuthology.orchestra.run.trial069.stdout:Get:13 https://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2026-02-18T00:30:03.039 INFO:teuthology.orchestra.run.trial069.stdout:Get:14 https://2.chacra.ceph.com/r/ceph/20.2.1_2.17.26-baseline_2/adc1923395f2bcd6ae89b5d331d278364d1848ed/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 20.2.0-670-gadc19233-1jammy [833 kB] 2026-02-18T00:30:03.041 INFO:teuthology.orchestra.run.trial069.stdout:Get:15 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 liboath0 amd64 2.6.7-3ubuntu0.1 [41.3 kB] 2026-02-18T00:30:03.041 INFO:teuthology.orchestra.run.trial069.stdout:Get:16 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9030 B] 2026-02-18T00:30:03.042 INFO:teuthology.orchestra.run.trial069.stdout:Get:17 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2026-02-18T00:30:03.047 INFO:teuthology.orchestra.run.trial069.stdout:Get:18 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6452 B] 2026-02-18T00:30:03.047 INFO:teuthology.orchestra.run.trial069.stdout:Get:19 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8716 B] 2026-02-18T00:30:03.047 INFO:teuthology.orchestra.run.trial069.stdout:Get:20 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2026-02-18T00:30:03.048 INFO:teuthology.orchestra.run.trial069.stdout:Get:21 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2026-02-18T00:30:03.052 INFO:teuthology.orchestra.run.trial069.stdout:Get:22 https://2.chacra.ceph.com/r/ceph/20.2.1_2.17.26-baseline_2/adc1923395f2bcd6ae89b5d331d278364d1848ed/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 20.2.0-670-gadc19233-1jammy [364 kB] 2026-02-18T00:30:03.056 INFO:teuthology.orchestra.run.trial069.stdout:Get:23 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7240 B] 2026-02-18T00:30:03.057 INFO:teuthology.orchestra.run.trial069.stdout:Get:24 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8980 B] 2026-02-18T00:30:03.057 INFO:teuthology.orchestra.run.trial069.stdout:Get:25 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2026-02-18T00:30:03.058 INFO:teuthology.orchestra.run.trial069.stdout:Get:26 https://2.chacra.ceph.com/r/ceph/20.2.1_2.17.26-baseline_2/adc1923395f2bcd6ae89b5d331d278364d1848ed/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 20.2.0-670-gadc19233-1jammy [32.8 kB] 2026-02-18T00:30:03.059 INFO:teuthology.orchestra.run.trial069.stdout:Get:27 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2026-02-18T00:30:03.059 INFO:teuthology.orchestra.run.trial069.stdout:Get:28 https://archive.ubuntu.com/ubuntu jammy/universe amd64 libfuse2 amd64 2.9.9-5ubuntu3 [90.3 kB] 2026-02-18T00:30:03.059 INFO:teuthology.orchestra.run.trial069.stdout:Get:29 https://2.chacra.ceph.com/r/ceph/20.2.1_2.17.26-baseline_2/adc1923395f2bcd6ae89b5d331d278364d1848ed/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 20.2.0-670-gadc19233-1jammy [184 kB] 2026-02-18T00:30:03.060 INFO:teuthology.orchestra.run.trial069.stdout:Get:30 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 python3-asyncssh all 2.5.0-1ubuntu0.1 [189 kB] 2026-02-18T00:30:03.061 INFO:teuthology.orchestra.run.trial069.stdout:Get:31 https://2.chacra.ceph.com/r/ceph/20.2.1_2.17.26-baseline_2/adc1923395f2bcd6ae89b5d331d278364d1848ed/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 20.2.0-670-gadc19233-1jammy [83.9 kB] 2026-02-18T00:30:03.063 INFO:teuthology.orchestra.run.trial069.stdout:Get:32 https://2.chacra.ceph.com/r/ceph/20.2.1_2.17.26-baseline_2/adc1923395f2bcd6ae89b5d331d278364d1848ed/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 20.2.0-670-gadc19233-1jammy [341 kB] 2026-02-18T00:30:03.066 INFO:teuthology.orchestra.run.trial069.stdout:Get:33 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2026-02-18T00:30:03.066 INFO:teuthology.orchestra.run.trial069.stdout:Get:34 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2026-02-18T00:30:03.067 INFO:teuthology.orchestra.run.trial069.stdout:Get:35 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2058 kB] 2026-02-18T00:30:03.068 INFO:teuthology.orchestra.run.trial069.stdout:Get:36 https://2.chacra.ceph.com/r/ceph/20.2.1_2.17.26-baseline_2/adc1923395f2bcd6ae89b5d331d278364d1848ed/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 20.2.0-670-gadc19233-1jammy [8687 kB] 2026-02-18T00:30:03.081 INFO:teuthology.orchestra.run.trial069.stdout:Get:37 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2026-02-18T00:30:03.082 INFO:teuthology.orchestra.run.trial069.stdout:Get:38 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2026-02-18T00:30:03.083 INFO:teuthology.orchestra.run.trial069.stdout:Get:39 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1829 kB] 2026-02-18T00:30:03.092 INFO:teuthology.orchestra.run.trial069.stdout:Get:40 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9722 B] 2026-02-18T00:30:03.093 INFO:teuthology.orchestra.run.trial069.stdout:Get:41 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2026-02-18T00:30:03.093 INFO:teuthology.orchestra.run.trial069.stdout:Get:42 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2026-02-18T00:30:03.093 INFO:teuthology.orchestra.run.trial069.stdout:Get:43 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2026-02-18T00:30:03.093 INFO:teuthology.orchestra.run.trial069.stdout:Get:44 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2026-02-18T00:30:03.094 INFO:teuthology.orchestra.run.trial069.stdout:Get:45 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2026-02-18T00:30:03.095 INFO:teuthology.orchestra.run.trial069.stdout:Get:46 https://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2026-02-18T00:30:03.096 INFO:teuthology.orchestra.run.trial069.stdout:Get:47 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libjq1 amd64 1.6-2.1ubuntu3.1 [133 kB] 2026-02-18T00:30:03.096 INFO:teuthology.orchestra.run.trial069.stdout:Get:48 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 jq amd64 1.6-2.1ubuntu3.1 [52.5 kB] 2026-02-18T00:30:03.103 INFO:teuthology.orchestra.run.trial069.stdout:Get:49 https://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2026-02-18T00:30:03.105 INFO:teuthology.orchestra.run.trial069.stdout:Get:50 https://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2026-02-18T00:30:03.106 INFO:teuthology.orchestra.run.trial069.stdout:Get:51 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.3 [474 kB] 2026-02-18T00:30:03.108 INFO:teuthology.orchestra.run.trial069.stdout:Get:52 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 python-asyncssh-doc all 2.5.0-1ubuntu0.1 [309 kB] 2026-02-18T00:30:03.112 INFO:teuthology.orchestra.run.trial069.stdout:Get:53 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6024 B] 2026-02-18T00:30:03.113 INFO:teuthology.orchestra.run.trial069.stdout:Get:54 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2026-02-18T00:30:03.113 INFO:teuthology.orchestra.run.trial069.stdout:Get:55 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2026-02-18T00:30:03.113 INFO:teuthology.orchestra.run.trial069.stdout:Get:56 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2026-02-18T00:30:03.114 INFO:teuthology.orchestra.run.trial069.stdout:Get:57 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-pygments all 2.11.2+dfsg-2ubuntu0.1 [750 kB] 2026-02-18T00:30:03.117 INFO:teuthology.orchestra.run.trial069.stdout:Get:58 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2026-02-18T00:30:03.122 INFO:teuthology.orchestra.run.trial069.stdout:Get:59 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2026-02-18T00:30:03.123 INFO:teuthology.orchestra.run.trial069.stdout:Get:60 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2026-02-18T00:30:03.123 INFO:teuthology.orchestra.run.trial069.stdout:Get:61 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2026-02-18T00:30:03.124 INFO:teuthology.orchestra.run.trial069.stdout:Get:62 https://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1983 kB] 2026-02-18T00:30:03.212 INFO:teuthology.orchestra.run.trial069.stdout:Get:63 https://2.chacra.ceph.com/r/ceph/20.2.1_2.17.26-baseline_2/adc1923395f2bcd6ae89b5d331d278364d1848ed/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 20.2.0-670-gadc19233-1jammy [112 kB] 2026-02-18T00:30:03.212 INFO:teuthology.orchestra.run.trial069.stdout:Get:64 https://2.chacra.ceph.com/r/ceph/20.2.1_2.17.26-baseline_2/adc1923395f2bcd6ae89b5d331d278364d1848ed/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 20.2.0-670-gadc19233-1jammy [261 kB] 2026-02-18T00:30:03.216 INFO:teuthology.orchestra.run.trial069.stdout:Get:65 https://2.chacra.ceph.com/r/ceph/20.2.1_2.17.26-baseline_2/adc1923395f2bcd6ae89b5d331d278364d1848ed/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 20.2.0-670-gadc19233-1jammy [29.3 MB] 2026-02-18T00:30:03.701 INFO:teuthology.orchestra.run.trial069.stdout:Get:66 https://2.chacra.ceph.com/r/ceph/20.2.1_2.17.26-baseline_2/adc1923395f2bcd6ae89b5d331d278364d1848ed/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 20.2.0-670-gadc19233-1jammy [5416 kB] 2026-02-18T00:30:03.787 INFO:teuthology.orchestra.run.trial069.stdout:Get:67 https://2.chacra.ceph.com/r/ceph/20.2.1_2.17.26-baseline_2/adc1923395f2bcd6ae89b5d331d278364d1848ed/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 20.2.0-670-gadc19233-1jammy [246 kB] 2026-02-18T00:30:03.790 INFO:teuthology.orchestra.run.trial069.stdout:Get:68 https://2.chacra.ceph.com/r/ceph/20.2.1_2.17.26-baseline_2/adc1923395f2bcd6ae89b5d331d278364d1848ed/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 20.2.0-670-gadc19233-1jammy [124 kB] 2026-02-18T00:30:03.792 INFO:teuthology.orchestra.run.trial069.stdout:Get:69 https://2.chacra.ceph.com/r/ceph/20.2.1_2.17.26-baseline_2/adc1923395f2bcd6ae89b5d331d278364d1848ed/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 20.2.0-670-gadc19233-1jammy [907 kB] 2026-02-18T00:30:03.807 INFO:teuthology.orchestra.run.trial069.stdout:Get:70 https://2.chacra.ceph.com/r/ceph/20.2.1_2.17.26-baseline_2/adc1923395f2bcd6ae89b5d331d278364d1848ed/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 20.2.0-670-gadc19233-1jammy [6397 kB] 2026-02-18T00:30:03.913 INFO:teuthology.orchestra.run.trial069.stdout:Get:71 https://2.chacra.ceph.com/r/ceph/20.2.1_2.17.26-baseline_2/adc1923395f2bcd6ae89b5d331d278364d1848ed/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 20.2.0-670-gadc19233-1jammy [21.7 MB] 2026-02-18T00:30:04.270 INFO:teuthology.orchestra.run.trial069.stdout:Get:72 https://2.chacra.ceph.com/r/ceph/20.2.1_2.17.26-baseline_2/adc1923395f2bcd6ae89b5d331d278364d1848ed/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 20.2.0-670-gadc19233-1jammy [14.1 kB] 2026-02-18T00:30:04.270 INFO:teuthology.orchestra.run.trial069.stdout:Get:73 https://2.chacra.ceph.com/r/ceph/20.2.1_2.17.26-baseline_2/adc1923395f2bcd6ae89b5d331d278364d1848ed/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 20.2.0-670-gadc19233-1jammy [957 kB] 2026-02-18T00:30:04.283 INFO:teuthology.orchestra.run.trial069.stdout:Get:74 https://2.chacra.ceph.com/r/ceph/20.2.1_2.17.26-baseline_2/adc1923395f2bcd6ae89b5d331d278364d1848ed/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 20.2.0-670-gadc19233-1jammy [2345 kB] 2026-02-18T00:30:04.321 INFO:teuthology.orchestra.run.trial069.stdout:Get:75 https://2.chacra.ceph.com/r/ceph/20.2.1_2.17.26-baseline_2/adc1923395f2bcd6ae89b5d331d278364d1848ed/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 20.2.0-670-gadc19233-1jammy [1049 kB] 2026-02-18T00:30:04.338 INFO:teuthology.orchestra.run.trial069.stdout:Get:76 https://2.chacra.ceph.com/r/ceph/20.2.1_2.17.26-baseline_2/adc1923395f2bcd6ae89b5d331d278364d1848ed/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 20.2.0-670-gadc19233-1jammy [179 kB] 2026-02-18T00:30:04.341 INFO:teuthology.orchestra.run.trial069.stdout:Get:77 https://2.chacra.ceph.com/r/ceph/20.2.1_2.17.26-baseline_2/adc1923395f2bcd6ae89b5d331d278364d1848ed/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 20.2.0-670-gadc19233-1jammy [45.5 MB] 2026-02-18T00:30:05.093 INFO:teuthology.orchestra.run.trial069.stdout:Get:78 https://2.chacra.ceph.com/r/ceph/20.2.1_2.17.26-baseline_2/adc1923395f2bcd6ae89b5d331d278364d1848ed/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 20.2.0-670-gadc19233-1jammy [8625 kB] 2026-02-18T00:30:05.229 INFO:teuthology.orchestra.run.trial069.stdout:Get:79 https://2.chacra.ceph.com/r/ceph/20.2.1_2.17.26-baseline_2/adc1923395f2bcd6ae89b5d331d278364d1848ed/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 20.2.0-670-gadc19233-1jammy [14.2 kB] 2026-02-18T00:30:05.229 INFO:teuthology.orchestra.run.trial069.stdout:Get:80 https://2.chacra.ceph.com/r/ceph/20.2.1_2.17.26-baseline_2/adc1923395f2bcd6ae89b5d331d278364d1848ed/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 20.2.0-670-gadc19233-1jammy [99.5 MB] 2026-02-18T00:30:06.874 INFO:teuthology.orchestra.run.trial069.stdout:Get:81 https://2.chacra.ceph.com/r/ceph/20.2.1_2.17.26-baseline_2/adc1923395f2bcd6ae89b5d331d278364d1848ed/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 20.2.0-670-gadc19233-1jammy [135 kB] 2026-02-18T00:30:06.875 INFO:teuthology.orchestra.run.trial069.stdout:Get:82 https://2.chacra.ceph.com/r/ceph/20.2.1_2.17.26-baseline_2/adc1923395f2bcd6ae89b5d331d278364d1848ed/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-daemon amd64 20.2.0-670-gadc19233-1jammy [43.3 kB] 2026-02-18T00:30:06.875 INFO:teuthology.orchestra.run.trial069.stdout:Get:83 https://2.chacra.ceph.com/r/ceph/20.2.1_2.17.26-baseline_2/adc1923395f2bcd6ae89b5d331d278364d1848ed/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-proxy2 amd64 20.2.0-670-gadc19233-1jammy [30.7 kB] 2026-02-18T00:30:06.876 INFO:teuthology.orchestra.run.trial069.stdout:Get:84 https://2.chacra.ceph.com/r/ceph/20.2.1_2.17.26-baseline_2/adc1923395f2bcd6ae89b5d331d278364d1848ed/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 20.2.0-670-gadc19233-1jammy [41.5 kB] 2026-02-18T00:30:06.876 INFO:teuthology.orchestra.run.trial069.stdout:Get:85 https://2.chacra.ceph.com/r/ceph/20.2.1_2.17.26-baseline_2/adc1923395f2bcd6ae89b5d331d278364d1848ed/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 20.2.0-670-gadc19233-1jammy [25.1 MB] 2026-02-18T00:30:07.311 INFO:teuthology.orchestra.run.trial069.stdout:Get:86 https://2.chacra.ceph.com/r/ceph/20.2.1_2.17.26-baseline_2/adc1923395f2bcd6ae89b5d331d278364d1848ed/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 20.2.0-670-gadc19233-1jammy [97.5 kB] 2026-02-18T00:30:07.590 INFO:teuthology.orchestra.run.trial069.stdout:Fetched 280 MB in 4s (62.4 MB/s) 2026-02-18T00:30:07.607 INFO:teuthology.orchestra.run.trial069.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2026-02-18T00:30:07.762 INFO:teuthology.orchestra.run.trial069.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 167438 files and directories currently installed.) 2026-02-18T00:30:07.764 INFO:teuthology.orchestra.run.trial069.stdout:Preparing to unpack .../00-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2026-02-18T00:30:07.765 INFO:teuthology.orchestra.run.trial069.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2026-02-18T00:30:07.783 INFO:teuthology.orchestra.run.trial069.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2026-02-18T00:30:07.795 INFO:teuthology.orchestra.run.trial069.stdout:Preparing to unpack .../01-libdouble-conversion3_3.1.7-4_amd64.deb ... 2026-02-18T00:30:07.796 INFO:teuthology.orchestra.run.trial069.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2026-02-18T00:30:07.813 INFO:teuthology.orchestra.run.trial069.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2026-02-18T00:30:07.821 INFO:teuthology.orchestra.run.trial069.stdout:Preparing to unpack .../02-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2026-02-18T00:30:07.821 INFO:teuthology.orchestra.run.trial069.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2026-02-18T00:30:07.839 INFO:teuthology.orchestra.run.trial069.stdout:Selecting previously unselected package libqt5core5a:amd64. 2026-02-18T00:30:07.847 INFO:teuthology.orchestra.run.trial069.stdout:Preparing to unpack .../03-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2026-02-18T00:30:07.852 INFO:teuthology.orchestra.run.trial069.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-18T00:30:07.883 INFO:teuthology.orchestra.run.trial069.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2026-02-18T00:30:07.891 INFO:teuthology.orchestra.run.trial069.stdout:Preparing to unpack .../04-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2026-02-18T00:30:07.891 INFO:teuthology.orchestra.run.trial069.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-18T00:30:07.907 INFO:teuthology.orchestra.run.trial069.stdout:Selecting previously unselected package libqt5network5:amd64. 2026-02-18T00:30:07.915 INFO:teuthology.orchestra.run.trial069.stdout:Preparing to unpack .../05-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2026-02-18T00:30:07.916 INFO:teuthology.orchestra.run.trial069.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-18T00:30:07.934 INFO:teuthology.orchestra.run.trial069.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2026-02-18T00:30:07.942 INFO:teuthology.orchestra.run.trial069.stdout:Preparing to unpack .../06-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2026-02-18T00:30:07.943 INFO:teuthology.orchestra.run.trial069.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2026-02-18T00:30:07.958 INFO:teuthology.orchestra.run.trial069.stdout:Selecting previously unselected package librados2. 2026-02-18T00:30:07.967 INFO:teuthology.orchestra.run.trial069.stdout:Preparing to unpack .../07-librados2_20.2.0-670-gadc19233-1jammy_amd64.deb ... 2026-02-18T00:30:07.967 INFO:teuthology.orchestra.run.trial069.stdout:Unpacking librados2 (20.2.0-670-gadc19233-1jammy) ... 2026-02-18T00:30:08.006 INFO:teuthology.orchestra.run.trial069.stdout:Selecting previously unselected package libnbd0. 2026-02-18T00:30:08.015 INFO:teuthology.orchestra.run.trial069.stdout:Preparing to unpack .../08-libnbd0_1.10.5-1_amd64.deb ... 2026-02-18T00:30:08.015 INFO:teuthology.orchestra.run.trial069.stdout:Unpacking libnbd0 (1.10.5-1) ... 2026-02-18T00:30:08.028 INFO:teuthology.orchestra.run.trial069.stdout:Selecting previously unselected package librbd1. 2026-02-18T00:30:08.036 INFO:teuthology.orchestra.run.trial069.stdout:Preparing to unpack .../09-librbd1_20.2.0-670-gadc19233-1jammy_amd64.deb ... 2026-02-18T00:30:08.036 INFO:teuthology.orchestra.run.trial069.stdout:Unpacking librbd1 (20.2.0-670-gadc19233-1jammy) ... 2026-02-18T00:30:08.073 INFO:teuthology.orchestra.run.trial069.stdout:Selecting previously unselected package libcephfs2. 2026-02-18T00:30:08.081 INFO:teuthology.orchestra.run.trial069.stdout:Preparing to unpack .../10-libcephfs2_20.2.0-670-gadc19233-1jammy_amd64.deb ... 2026-02-18T00:30:08.081 INFO:teuthology.orchestra.run.trial069.stdout:Unpacking libcephfs2 (20.2.0-670-gadc19233-1jammy) ... 2026-02-18T00:30:08.101 INFO:teuthology.orchestra.run.trial069.stdout:Selecting previously unselected package python3-rados. 2026-02-18T00:30:08.109 INFO:teuthology.orchestra.run.trial069.stdout:Preparing to unpack .../11-python3-rados_20.2.0-670-gadc19233-1jammy_amd64.deb ... 2026-02-18T00:30:08.110 INFO:teuthology.orchestra.run.trial069.stdout:Unpacking python3-rados (20.2.0-670-gadc19233-1jammy) ... 2026-02-18T00:30:08.126 INFO:teuthology.orchestra.run.trial069.stdout:Selecting previously unselected package python3-ceph-argparse. 2026-02-18T00:30:08.134 INFO:teuthology.orchestra.run.trial069.stdout:Preparing to unpack .../12-python3-ceph-argparse_20.2.0-670-gadc19233-1jammy_all.deb ... 2026-02-18T00:30:08.135 INFO:teuthology.orchestra.run.trial069.stdout:Unpacking python3-ceph-argparse (20.2.0-670-gadc19233-1jammy) ... 2026-02-18T00:30:08.148 INFO:teuthology.orchestra.run.trial069.stdout:Selecting previously unselected package python3-cephfs. 2026-02-18T00:30:08.156 INFO:teuthology.orchestra.run.trial069.stdout:Preparing to unpack .../13-python3-cephfs_20.2.0-670-gadc19233-1jammy_amd64.deb ... 2026-02-18T00:30:08.157 INFO:teuthology.orchestra.run.trial069.stdout:Unpacking python3-cephfs (20.2.0-670-gadc19233-1jammy) ... 2026-02-18T00:30:08.172 INFO:teuthology.orchestra.run.trial069.stdout:Selecting previously unselected package python3-ceph-common. 2026-02-18T00:30:08.180 INFO:teuthology.orchestra.run.trial069.stdout:Preparing to unpack .../14-python3-ceph-common_20.2.0-670-gadc19233-1jammy_all.deb ... 2026-02-18T00:30:08.180 INFO:teuthology.orchestra.run.trial069.stdout:Unpacking python3-ceph-common (20.2.0-670-gadc19233-1jammy) ... 2026-02-18T00:30:08.198 INFO:teuthology.orchestra.run.trial069.stdout:Selecting previously unselected package python3-wcwidth. 2026-02-18T00:30:08.206 INFO:teuthology.orchestra.run.trial069.stdout:Preparing to unpack .../15-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2026-02-18T00:30:08.207 INFO:teuthology.orchestra.run.trial069.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2026-02-18T00:30:08.222 INFO:teuthology.orchestra.run.trial069.stdout:Selecting previously unselected package python3-prettytable. 2026-02-18T00:30:08.230 INFO:teuthology.orchestra.run.trial069.stdout:Preparing to unpack .../16-python3-prettytable_2.5.0-2_all.deb ... 2026-02-18T00:30:08.230 INFO:teuthology.orchestra.run.trial069.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2026-02-18T00:30:08.245 INFO:teuthology.orchestra.run.trial069.stdout:Selecting previously unselected package python3-rbd. 2026-02-18T00:30:08.253 INFO:teuthology.orchestra.run.trial069.stdout:Preparing to unpack .../17-python3-rbd_20.2.0-670-gadc19233-1jammy_amd64.deb ... 2026-02-18T00:30:08.253 INFO:teuthology.orchestra.run.trial069.stdout:Unpacking python3-rbd (20.2.0-670-gadc19233-1jammy) ... 2026-02-18T00:30:08.270 INFO:teuthology.orchestra.run.trial069.stdout:Selecting previously unselected package librdkafka1:amd64. 2026-02-18T00:30:08.278 INFO:teuthology.orchestra.run.trial069.stdout:Preparing to unpack .../18-librdkafka1_1.8.0-1build1_amd64.deb ... 2026-02-18T00:30:08.278 INFO:teuthology.orchestra.run.trial069.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2026-02-18T00:30:08.297 INFO:teuthology.orchestra.run.trial069.stdout:Selecting previously unselected package librgw2. 2026-02-18T00:30:08.305 INFO:teuthology.orchestra.run.trial069.stdout:Preparing to unpack .../19-librgw2_20.2.0-670-gadc19233-1jammy_amd64.deb ... 2026-02-18T00:30:08.305 INFO:teuthology.orchestra.run.trial069.stdout:Unpacking librgw2 (20.2.0-670-gadc19233-1jammy) ... 2026-02-18T00:30:08.401 INFO:teuthology.orchestra.run.trial069.stdout:Selecting previously unselected package python3-rgw. 2026-02-18T00:30:08.410 INFO:teuthology.orchestra.run.trial069.stdout:Preparing to unpack .../20-python3-rgw_20.2.0-670-gadc19233-1jammy_amd64.deb ... 2026-02-18T00:30:08.410 INFO:teuthology.orchestra.run.trial069.stdout:Unpacking python3-rgw (20.2.0-670-gadc19233-1jammy) ... 2026-02-18T00:30:08.425 INFO:teuthology.orchestra.run.trial069.stdout:Selecting previously unselected package liboath0:amd64. 2026-02-18T00:30:08.433 INFO:teuthology.orchestra.run.trial069.stdout:Preparing to unpack .../21-liboath0_2.6.7-3ubuntu0.1_amd64.deb ... 2026-02-18T00:30:08.434 INFO:teuthology.orchestra.run.trial069.stdout:Unpacking liboath0:amd64 (2.6.7-3ubuntu0.1) ... 2026-02-18T00:30:08.449 INFO:teuthology.orchestra.run.trial069.stdout:Selecting previously unselected package libradosstriper1. 2026-02-18T00:30:08.457 INFO:teuthology.orchestra.run.trial069.stdout:Preparing to unpack .../22-libradosstriper1_20.2.0-670-gadc19233-1jammy_amd64.deb ... 2026-02-18T00:30:08.457 INFO:teuthology.orchestra.run.trial069.stdout:Unpacking libradosstriper1 (20.2.0-670-gadc19233-1jammy) ... 2026-02-18T00:30:08.474 INFO:teuthology.orchestra.run.trial069.stdout:Selecting previously unselected package ceph-common. 2026-02-18T00:30:08.482 INFO:teuthology.orchestra.run.trial069.stdout:Preparing to unpack .../23-ceph-common_20.2.0-670-gadc19233-1jammy_amd64.deb ... 2026-02-18T00:30:08.483 INFO:teuthology.orchestra.run.trial069.stdout:Unpacking ceph-common (20.2.0-670-gadc19233-1jammy) ... 2026-02-18T00:30:08.764 INFO:teuthology.orchestra.run.trial069.stdout:Selecting previously unselected package ceph-base. 2026-02-18T00:30:08.772 INFO:teuthology.orchestra.run.trial069.stdout:Preparing to unpack .../24-ceph-base_20.2.0-670-gadc19233-1jammy_amd64.deb ... 2026-02-18T00:30:08.777 INFO:teuthology.orchestra.run.trial069.stdout:Unpacking ceph-base (20.2.0-670-gadc19233-1jammy) ... 2026-02-18T00:30:08.840 INFO:teuthology.orchestra.run.trial069.stdout:Selecting previously unselected package python3-jaraco.functools. 2026-02-18T00:30:08.849 INFO:teuthology.orchestra.run.trial069.stdout:Preparing to unpack .../25-python3-jaraco.functools_3.4.0-2_all.deb ... 2026-02-18T00:30:08.849 INFO:teuthology.orchestra.run.trial069.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2026-02-18T00:30:08.863 INFO:teuthology.orchestra.run.trial069.stdout:Selecting previously unselected package python3-cheroot. 2026-02-18T00:30:08.871 INFO:teuthology.orchestra.run.trial069.stdout:Preparing to unpack .../26-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2026-02-18T00:30:08.871 INFO:teuthology.orchestra.run.trial069.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2026-02-18T00:30:08.888 INFO:teuthology.orchestra.run.trial069.stdout:Selecting previously unselected package python3-jaraco.classes. 2026-02-18T00:30:08.896 INFO:teuthology.orchestra.run.trial069.stdout:Preparing to unpack .../27-python3-jaraco.classes_3.2.1-3_all.deb ... 2026-02-18T00:30:08.896 INFO:teuthology.orchestra.run.trial069.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2026-02-18T00:30:08.911 INFO:teuthology.orchestra.run.trial069.stdout:Selecting previously unselected package python3-jaraco.text. 2026-02-18T00:30:08.919 INFO:teuthology.orchestra.run.trial069.stdout:Preparing to unpack .../28-python3-jaraco.text_3.6.0-2_all.deb ... 2026-02-18T00:30:08.919 INFO:teuthology.orchestra.run.trial069.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2026-02-18T00:30:08.934 INFO:teuthology.orchestra.run.trial069.stdout:Selecting previously unselected package python3-jaraco.collections. 2026-02-18T00:30:08.942 INFO:teuthology.orchestra.run.trial069.stdout:Preparing to unpack .../29-python3-jaraco.collections_3.4.0-2_all.deb ... 2026-02-18T00:30:08.942 INFO:teuthology.orchestra.run.trial069.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2026-02-18T00:30:08.956 INFO:teuthology.orchestra.run.trial069.stdout:Selecting previously unselected package python3-tempora. 2026-02-18T00:30:08.964 INFO:teuthology.orchestra.run.trial069.stdout:Preparing to unpack .../30-python3-tempora_4.1.2-1_all.deb ... 2026-02-18T00:30:08.964 INFO:teuthology.orchestra.run.trial069.stdout:Unpacking python3-tempora (4.1.2-1) ... 2026-02-18T00:30:08.979 INFO:teuthology.orchestra.run.trial069.stdout:Selecting previously unselected package python3-portend. 2026-02-18T00:30:08.987 INFO:teuthology.orchestra.run.trial069.stdout:Preparing to unpack .../31-python3-portend_3.0.0-1_all.deb ... 2026-02-18T00:30:08.987 INFO:teuthology.orchestra.run.trial069.stdout:Unpacking python3-portend (3.0.0-1) ... 2026-02-18T00:30:09.001 INFO:teuthology.orchestra.run.trial069.stdout:Selecting previously unselected package python3-zc.lockfile. 2026-02-18T00:30:09.009 INFO:teuthology.orchestra.run.trial069.stdout:Preparing to unpack .../32-python3-zc.lockfile_2.0-1_all.deb ... 2026-02-18T00:30:09.009 INFO:teuthology.orchestra.run.trial069.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2026-02-18T00:30:09.023 INFO:teuthology.orchestra.run.trial069.stdout:Selecting previously unselected package python3-cherrypy3. 2026-02-18T00:30:09.031 INFO:teuthology.orchestra.run.trial069.stdout:Preparing to unpack .../33-python3-cherrypy3_18.6.1-4_all.deb ... 2026-02-18T00:30:09.031 INFO:teuthology.orchestra.run.trial069.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2026-02-18T00:30:09.054 INFO:teuthology.orchestra.run.trial069.stdout:Selecting previously unselected package python3-natsort. 2026-02-18T00:30:09.062 INFO:teuthology.orchestra.run.trial069.stdout:Preparing to unpack .../34-python3-natsort_8.0.2-1_all.deb ... 2026-02-18T00:30:09.063 INFO:teuthology.orchestra.run.trial069.stdout:Unpacking python3-natsort (8.0.2-1) ... 2026-02-18T00:30:09.080 INFO:teuthology.orchestra.run.trial069.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2026-02-18T00:30:09.088 INFO:teuthology.orchestra.run.trial069.stdout:Preparing to unpack .../35-ceph-mgr-modules-core_20.2.0-670-gadc19233-1jammy_all.deb ... 2026-02-18T00:30:09.088 INFO:teuthology.orchestra.run.trial069.stdout:Unpacking ceph-mgr-modules-core (20.2.0-670-gadc19233-1jammy) ... 2026-02-18T00:30:09.115 INFO:teuthology.orchestra.run.trial069.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2026-02-18T00:30:09.124 INFO:teuthology.orchestra.run.trial069.stdout:Preparing to unpack .../36-libsqlite3-mod-ceph_20.2.0-670-gadc19233-1jammy_amd64.deb ... 2026-02-18T00:30:09.124 INFO:teuthology.orchestra.run.trial069.stdout:Unpacking libsqlite3-mod-ceph (20.2.0-670-gadc19233-1jammy) ... 2026-02-18T00:30:09.139 INFO:teuthology.orchestra.run.trial069.stdout:Selecting previously unselected package ceph-mgr. 2026-02-18T00:30:09.147 INFO:teuthology.orchestra.run.trial069.stdout:Preparing to unpack .../37-ceph-mgr_20.2.0-670-gadc19233-1jammy_amd64.deb ... 2026-02-18T00:30:09.147 INFO:teuthology.orchestra.run.trial069.stdout:Unpacking ceph-mgr (20.2.0-670-gadc19233-1jammy) ... 2026-02-18T00:30:09.167 INFO:teuthology.orchestra.run.trial069.stdout:Selecting previously unselected package ceph-mon. 2026-02-18T00:30:09.175 INFO:teuthology.orchestra.run.trial069.stdout:Preparing to unpack .../38-ceph-mon_20.2.0-670-gadc19233-1jammy_amd64.deb ... 2026-02-18T00:30:09.175 INFO:teuthology.orchestra.run.trial069.stdout:Unpacking ceph-mon (20.2.0-670-gadc19233-1jammy) ... 2026-02-18T00:30:09.234 INFO:teuthology.orchestra.run.trial069.stdout:Selecting previously unselected package libfuse2:amd64. 2026-02-18T00:30:09.242 INFO:teuthology.orchestra.run.trial069.stdout:Preparing to unpack .../39-libfuse2_2.9.9-5ubuntu3_amd64.deb ... 2026-02-18T00:30:09.243 INFO:teuthology.orchestra.run.trial069.stdout:Unpacking libfuse2:amd64 (2.9.9-5ubuntu3) ... 2026-02-18T00:30:09.258 INFO:teuthology.orchestra.run.trial069.stdout:Selecting previously unselected package ceph-osd. 2026-02-18T00:30:09.266 INFO:teuthology.orchestra.run.trial069.stdout:Preparing to unpack .../40-ceph-osd_20.2.0-670-gadc19233-1jammy_amd64.deb ... 2026-02-18T00:30:09.266 INFO:teuthology.orchestra.run.trial069.stdout:Unpacking ceph-osd (20.2.0-670-gadc19233-1jammy) ... 2026-02-18T00:30:09.410 INFO:teuthology.orchestra.run.trial069.stdout:Selecting previously unselected package ceph. 2026-02-18T00:30:09.419 INFO:teuthology.orchestra.run.trial069.stdout:Preparing to unpack .../41-ceph_20.2.0-670-gadc19233-1jammy_amd64.deb ... 2026-02-18T00:30:09.419 INFO:teuthology.orchestra.run.trial069.stdout:Unpacking ceph (20.2.0-670-gadc19233-1jammy) ... 2026-02-18T00:30:09.434 INFO:teuthology.orchestra.run.trial069.stdout:Selecting previously unselected package ceph-fuse. 2026-02-18T00:30:09.442 INFO:teuthology.orchestra.run.trial069.stdout:Preparing to unpack .../42-ceph-fuse_20.2.0-670-gadc19233-1jammy_amd64.deb ... 2026-02-18T00:30:09.442 INFO:teuthology.orchestra.run.trial069.stdout:Unpacking ceph-fuse (20.2.0-670-gadc19233-1jammy) ... 2026-02-18T00:30:09.462 INFO:teuthology.orchestra.run.trial069.stdout:Selecting previously unselected package ceph-mds. 2026-02-18T00:30:09.471 INFO:teuthology.orchestra.run.trial069.stdout:Preparing to unpack .../43-ceph-mds_20.2.0-670-gadc19233-1jammy_amd64.deb ... 2026-02-18T00:30:09.471 INFO:teuthology.orchestra.run.trial069.stdout:Unpacking ceph-mds (20.2.0-670-gadc19233-1jammy) ... 2026-02-18T00:30:09.503 INFO:teuthology.orchestra.run.trial069.stdout:Selecting previously unselected package cephadm. 2026-02-18T00:30:09.510 INFO:teuthology.orchestra.run.trial069.stdout:Preparing to unpack .../44-cephadm_20.2.0-670-gadc19233-1jammy_amd64.deb ... 2026-02-18T00:30:09.511 INFO:teuthology.orchestra.run.trial069.stdout:Unpacking cephadm (20.2.0-670-gadc19233-1jammy) ... 2026-02-18T00:30:09.526 INFO:teuthology.orchestra.run.trial069.stdout:Selecting previously unselected package python3-asyncssh. 2026-02-18T00:30:09.534 INFO:teuthology.orchestra.run.trial069.stdout:Preparing to unpack .../45-python3-asyncssh_2.5.0-1ubuntu0.1_all.deb ... 2026-02-18T00:30:09.535 INFO:teuthology.orchestra.run.trial069.stdout:Unpacking python3-asyncssh (2.5.0-1ubuntu0.1) ... 2026-02-18T00:30:09.555 INFO:teuthology.orchestra.run.trial069.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2026-02-18T00:30:09.563 INFO:teuthology.orchestra.run.trial069.stdout:Preparing to unpack .../46-ceph-mgr-cephadm_20.2.0-670-gadc19233-1jammy_all.deb ... 2026-02-18T00:30:09.563 INFO:teuthology.orchestra.run.trial069.stdout:Unpacking ceph-mgr-cephadm (20.2.0-670-gadc19233-1jammy) ... 2026-02-18T00:30:09.583 INFO:teuthology.orchestra.run.trial069.stdout:Selecting previously unselected package python3-repoze.lru. 2026-02-18T00:30:09.591 INFO:teuthology.orchestra.run.trial069.stdout:Preparing to unpack .../47-python3-repoze.lru_0.7-2_all.deb ... 2026-02-18T00:30:09.592 INFO:teuthology.orchestra.run.trial069.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2026-02-18T00:30:09.606 INFO:teuthology.orchestra.run.trial069.stdout:Selecting previously unselected package python3-routes. 2026-02-18T00:30:09.614 INFO:teuthology.orchestra.run.trial069.stdout:Preparing to unpack .../48-python3-routes_2.5.1-1ubuntu1_all.deb ... 2026-02-18T00:30:09.614 INFO:teuthology.orchestra.run.trial069.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2026-02-18T00:30:09.633 INFO:teuthology.orchestra.run.trial069.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2026-02-18T00:30:09.641 INFO:teuthology.orchestra.run.trial069.stdout:Preparing to unpack .../49-ceph-mgr-dashboard_20.2.0-670-gadc19233-1jammy_all.deb ... 2026-02-18T00:30:09.642 INFO:teuthology.orchestra.run.trial069.stdout:Unpacking ceph-mgr-dashboard (20.2.0-670-gadc19233-1jammy) ... 2026-02-18T00:30:10.073 INFO:teuthology.orchestra.run.trial069.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2026-02-18T00:30:10.082 INFO:teuthology.orchestra.run.trial069.stdout:Preparing to unpack .../50-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2026-02-18T00:30:10.083 INFO:teuthology.orchestra.run.trial069.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2026-02-18T00:30:10.121 INFO:teuthology.orchestra.run.trial069.stdout:Selecting previously unselected package python3-joblib. 2026-02-18T00:30:10.130 INFO:teuthology.orchestra.run.trial069.stdout:Preparing to unpack .../51-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2026-02-18T00:30:10.131 INFO:teuthology.orchestra.run.trial069.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2026-02-18T00:30:10.157 INFO:teuthology.orchestra.run.trial069.stdout:Selecting previously unselected package python3-threadpoolctl. 2026-02-18T00:30:10.165 INFO:teuthology.orchestra.run.trial069.stdout:Preparing to unpack .../52-python3-threadpoolctl_3.1.0-1_all.deb ... 2026-02-18T00:30:10.165 INFO:teuthology.orchestra.run.trial069.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2026-02-18T00:30:10.180 INFO:teuthology.orchestra.run.trial069.stdout:Selecting previously unselected package python3-sklearn. 2026-02-18T00:30:10.189 INFO:teuthology.orchestra.run.trial069.stdout:Preparing to unpack .../53-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2026-02-18T00:30:10.189 INFO:teuthology.orchestra.run.trial069.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2026-02-18T00:30:10.267 INFO:teuthology.orchestra.run.trial069.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2026-02-18T00:30:10.276 INFO:teuthology.orchestra.run.trial069.stdout:Preparing to unpack .../54-ceph-mgr-diskprediction-local_20.2.0-670-gadc19233-1jammy_all.deb ... 2026-02-18T00:30:10.276 INFO:teuthology.orchestra.run.trial069.stdout:Unpacking ceph-mgr-diskprediction-local (20.2.0-670-gadc19233-1jammy) ... 2026-02-18T00:30:10.442 INFO:teuthology.orchestra.run.trial069.stdout:Selecting previously unselected package python3-cachetools. 2026-02-18T00:30:10.451 INFO:teuthology.orchestra.run.trial069.stdout:Preparing to unpack .../55-python3-cachetools_5.0.0-1_all.deb ... 2026-02-18T00:30:10.452 INFO:teuthology.orchestra.run.trial069.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2026-02-18T00:30:10.466 INFO:teuthology.orchestra.run.trial069.stdout:Selecting previously unselected package python3-rsa. 2026-02-18T00:30:10.475 INFO:teuthology.orchestra.run.trial069.stdout:Preparing to unpack .../56-python3-rsa_4.8-1_all.deb ... 2026-02-18T00:30:10.475 INFO:teuthology.orchestra.run.trial069.stdout:Unpacking python3-rsa (4.8-1) ... 2026-02-18T00:30:10.492 INFO:teuthology.orchestra.run.trial069.stdout:Selecting previously unselected package python3-google-auth. 2026-02-18T00:30:10.500 INFO:teuthology.orchestra.run.trial069.stdout:Preparing to unpack .../57-python3-google-auth_1.5.1-3_all.deb ... 2026-02-18T00:30:10.501 INFO:teuthology.orchestra.run.trial069.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2026-02-18T00:30:10.518 INFO:teuthology.orchestra.run.trial069.stdout:Selecting previously unselected package python3-requests-oauthlib. 2026-02-18T00:30:10.526 INFO:teuthology.orchestra.run.trial069.stdout:Preparing to unpack .../58-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2026-02-18T00:30:10.526 INFO:teuthology.orchestra.run.trial069.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2026-02-18T00:30:10.542 INFO:teuthology.orchestra.run.trial069.stdout:Selecting previously unselected package python3-websocket. 2026-02-18T00:30:10.551 INFO:teuthology.orchestra.run.trial069.stdout:Preparing to unpack .../59-python3-websocket_1.2.3-1_all.deb ... 2026-02-18T00:30:10.551 INFO:teuthology.orchestra.run.trial069.stdout:Unpacking python3-websocket (1.2.3-1) ... 2026-02-18T00:30:10.568 INFO:teuthology.orchestra.run.trial069.stdout:Selecting previously unselected package python3-kubernetes. 2026-02-18T00:30:10.577 INFO:teuthology.orchestra.run.trial069.stdout:Preparing to unpack .../60-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2026-02-18T00:30:10.577 INFO:teuthology.orchestra.run.trial069.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2026-02-18T00:30:10.672 INFO:teuthology.orchestra.run.trial069.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2026-02-18T00:30:10.681 INFO:teuthology.orchestra.run.trial069.stdout:Preparing to unpack .../61-ceph-mgr-k8sevents_20.2.0-670-gadc19233-1jammy_all.deb ... 2026-02-18T00:30:10.682 INFO:teuthology.orchestra.run.trial069.stdout:Unpacking ceph-mgr-k8sevents (20.2.0-670-gadc19233-1jammy) ... 2026-02-18T00:30:10.696 INFO:teuthology.orchestra.run.trial069.stdout:Selecting previously unselected package libonig5:amd64. 2026-02-18T00:30:10.704 INFO:teuthology.orchestra.run.trial069.stdout:Preparing to unpack .../62-libonig5_6.9.7.1-2build1_amd64.deb ... 2026-02-18T00:30:10.705 INFO:teuthology.orchestra.run.trial069.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2026-02-18T00:30:10.721 INFO:teuthology.orchestra.run.trial069.stdout:Selecting previously unselected package libjq1:amd64. 2026-02-18T00:30:10.730 INFO:teuthology.orchestra.run.trial069.stdout:Preparing to unpack .../63-libjq1_1.6-2.1ubuntu3.1_amd64.deb ... 2026-02-18T00:30:10.731 INFO:teuthology.orchestra.run.trial069.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3.1) ... 2026-02-18T00:30:10.745 INFO:teuthology.orchestra.run.trial069.stdout:Selecting previously unselected package jq. 2026-02-18T00:30:10.753 INFO:teuthology.orchestra.run.trial069.stdout:Preparing to unpack .../64-jq_1.6-2.1ubuntu3.1_amd64.deb ... 2026-02-18T00:30:10.754 INFO:teuthology.orchestra.run.trial069.stdout:Unpacking jq (1.6-2.1ubuntu3.1) ... 2026-02-18T00:30:10.768 INFO:teuthology.orchestra.run.trial069.stdout:Selecting previously unselected package socat. 2026-02-18T00:30:10.776 INFO:teuthology.orchestra.run.trial069.stdout:Preparing to unpack .../65-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2026-02-18T00:30:10.777 INFO:teuthology.orchestra.run.trial069.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2026-02-18T00:30:10.797 INFO:teuthology.orchestra.run.trial069.stdout:Selecting previously unselected package xmlstarlet. 2026-02-18T00:30:10.805 INFO:teuthology.orchestra.run.trial069.stdout:Preparing to unpack .../66-xmlstarlet_1.6.1-2.1_amd64.deb ... 2026-02-18T00:30:10.805 INFO:teuthology.orchestra.run.trial069.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2026-02-18T00:30:10.841 INFO:teuthology.orchestra.run.trial069.stdout:Selecting previously unselected package ceph-test. 2026-02-18T00:30:10.850 INFO:teuthology.orchestra.run.trial069.stdout:Preparing to unpack .../67-ceph-test_20.2.0-670-gadc19233-1jammy_amd64.deb ... 2026-02-18T00:30:10.850 INFO:teuthology.orchestra.run.trial069.stdout:Unpacking ceph-test (20.2.0-670-gadc19233-1jammy) ... 2026-02-18T00:30:11.738 INFO:teuthology.orchestra.run.trial069.stdout:Selecting previously unselected package ceph-volume. 2026-02-18T00:30:11.747 INFO:teuthology.orchestra.run.trial069.stdout:Preparing to unpack .../68-ceph-volume_20.2.0-670-gadc19233-1jammy_all.deb ... 2026-02-18T00:30:11.747 INFO:teuthology.orchestra.run.trial069.stdout:Unpacking ceph-volume (20.2.0-670-gadc19233-1jammy) ... 2026-02-18T00:30:11.770 INFO:teuthology.orchestra.run.trial069.stdout:Selecting previously unselected package libcephfs-daemon. 2026-02-18T00:30:11.778 INFO:teuthology.orchestra.run.trial069.stdout:Preparing to unpack .../69-libcephfs-daemon_20.2.0-670-gadc19233-1jammy_amd64.deb ... 2026-02-18T00:30:11.779 INFO:teuthology.orchestra.run.trial069.stdout:Unpacking libcephfs-daemon (20.2.0-670-gadc19233-1jammy) ... 2026-02-18T00:30:11.793 INFO:teuthology.orchestra.run.trial069.stdout:Selecting previously unselected package libcephfs-proxy2. 2026-02-18T00:30:11.802 INFO:teuthology.orchestra.run.trial069.stdout:Preparing to unpack .../70-libcephfs-proxy2_20.2.0-670-gadc19233-1jammy_amd64.deb ... 2026-02-18T00:30:11.802 INFO:teuthology.orchestra.run.trial069.stdout:Unpacking libcephfs-proxy2 (20.2.0-670-gadc19233-1jammy) ... 2026-02-18T00:30:11.816 INFO:teuthology.orchestra.run.trial069.stdout:Selecting previously unselected package libcephfs-dev. 2026-02-18T00:30:11.824 INFO:teuthology.orchestra.run.trial069.stdout:Preparing to unpack .../71-libcephfs-dev_20.2.0-670-gadc19233-1jammy_amd64.deb ... 2026-02-18T00:30:11.825 INFO:teuthology.orchestra.run.trial069.stdout:Unpacking libcephfs-dev (20.2.0-670-gadc19233-1jammy) ... 2026-02-18T00:30:11.841 INFO:teuthology.orchestra.run.trial069.stdout:Selecting previously unselected package nvme-cli. 2026-02-18T00:30:11.849 INFO:teuthology.orchestra.run.trial069.stdout:Preparing to unpack .../72-nvme-cli_1.16-3ubuntu0.3_amd64.deb ... 2026-02-18T00:30:11.849 INFO:teuthology.orchestra.run.trial069.stdout:Unpacking nvme-cli (1.16-3ubuntu0.3) ... 2026-02-18T00:30:11.880 INFO:teuthology.orchestra.run.trial069.stdout:Selecting previously unselected package python-asyncssh-doc. 2026-02-18T00:30:11.888 INFO:teuthology.orchestra.run.trial069.stdout:Preparing to unpack .../73-python-asyncssh-doc_2.5.0-1ubuntu0.1_all.deb ... 2026-02-18T00:30:11.889 INFO:teuthology.orchestra.run.trial069.stdout:Unpacking python-asyncssh-doc (2.5.0-1ubuntu0.1) ... 2026-02-18T00:30:11.919 INFO:teuthology.orchestra.run.trial069.stdout:Selecting previously unselected package python3-iniconfig. 2026-02-18T00:30:11.927 INFO:teuthology.orchestra.run.trial069.stdout:Preparing to unpack .../74-python3-iniconfig_1.1.1-2_all.deb ... 2026-02-18T00:30:11.927 INFO:teuthology.orchestra.run.trial069.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2026-02-18T00:30:11.942 INFO:teuthology.orchestra.run.trial069.stdout:Selecting previously unselected package python3-pluggy. 2026-02-18T00:30:11.950 INFO:teuthology.orchestra.run.trial069.stdout:Preparing to unpack .../75-python3-pluggy_0.13.0-7.1_all.deb ... 2026-02-18T00:30:11.951 INFO:teuthology.orchestra.run.trial069.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2026-02-18T00:30:11.966 INFO:teuthology.orchestra.run.trial069.stdout:Selecting previously unselected package python3-psutil. 2026-02-18T00:30:11.974 INFO:teuthology.orchestra.run.trial069.stdout:Preparing to unpack .../76-python3-psutil_5.9.0-1build1_amd64.deb ... 2026-02-18T00:30:11.975 INFO:teuthology.orchestra.run.trial069.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2026-02-18T00:30:11.992 INFO:teuthology.orchestra.run.trial069.stdout:Selecting previously unselected package python3-py. 2026-02-18T00:30:12.000 INFO:teuthology.orchestra.run.trial069.stdout:Preparing to unpack .../77-python3-py_1.10.0-1_all.deb ... 2026-02-18T00:30:12.001 INFO:teuthology.orchestra.run.trial069.stdout:Unpacking python3-py (1.10.0-1) ... 2026-02-18T00:30:12.020 INFO:teuthology.orchestra.run.trial069.stdout:Selecting previously unselected package python3-pygments. 2026-02-18T00:30:12.029 INFO:teuthology.orchestra.run.trial069.stdout:Preparing to unpack .../78-python3-pygments_2.11.2+dfsg-2ubuntu0.1_all.deb ... 2026-02-18T00:30:12.029 INFO:teuthology.orchestra.run.trial069.stdout:Unpacking python3-pygments (2.11.2+dfsg-2ubuntu0.1) ... 2026-02-18T00:30:12.071 INFO:teuthology.orchestra.run.trial069.stdout:Selecting previously unselected package python3-toml. 2026-02-18T00:30:12.079 INFO:teuthology.orchestra.run.trial069.stdout:Preparing to unpack .../79-python3-toml_0.10.2-1_all.deb ... 2026-02-18T00:30:12.079 INFO:teuthology.orchestra.run.trial069.stdout:Unpacking python3-toml (0.10.2-1) ... 2026-02-18T00:30:12.095 INFO:teuthology.orchestra.run.trial069.stdout:Selecting previously unselected package python3-pytest. 2026-02-18T00:30:12.103 INFO:teuthology.orchestra.run.trial069.stdout:Preparing to unpack .../80-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2026-02-18T00:30:12.103 INFO:teuthology.orchestra.run.trial069.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2026-02-18T00:30:12.125 INFO:teuthology.orchestra.run.trial069.stdout:Selecting previously unselected package python3-simplejson. 2026-02-18T00:30:12.133 INFO:teuthology.orchestra.run.trial069.stdout:Preparing to unpack .../81-python3-simplejson_3.17.6-1build1_amd64.deb ... 2026-02-18T00:30:12.134 INFO:teuthology.orchestra.run.trial069.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2026-02-18T00:30:12.151 INFO:teuthology.orchestra.run.trial069.stdout:Selecting previously unselected package python3-webob. 2026-02-18T00:30:12.159 INFO:teuthology.orchestra.run.trial069.stdout:Preparing to unpack .../82-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2026-02-18T00:30:12.160 INFO:teuthology.orchestra.run.trial069.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2026-02-18T00:30:12.183 INFO:teuthology.orchestra.run.trial069.stdout:Selecting previously unselected package qttranslations5-l10n. 2026-02-18T00:30:12.191 INFO:teuthology.orchestra.run.trial069.stdout:Preparing to unpack .../83-qttranslations5-l10n_5.15.3-1_all.deb ... 2026-02-18T00:30:12.192 INFO:teuthology.orchestra.run.trial069.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2026-02-18T00:30:12.259 INFO:teuthology.orchestra.run.trial069.stdout:Selecting previously unselected package radosgw. 2026-02-18T00:30:12.268 INFO:teuthology.orchestra.run.trial069.stdout:Preparing to unpack .../84-radosgw_20.2.0-670-gadc19233-1jammy_amd64.deb ... 2026-02-18T00:30:12.268 INFO:teuthology.orchestra.run.trial069.stdout:Unpacking radosgw (20.2.0-670-gadc19233-1jammy) ... 2026-02-18T00:30:12.485 INFO:teuthology.orchestra.run.trial069.stdout:Selecting previously unselected package rbd-fuse. 2026-02-18T00:30:12.494 INFO:teuthology.orchestra.run.trial069.stdout:Preparing to unpack .../85-rbd-fuse_20.2.0-670-gadc19233-1jammy_amd64.deb ... 2026-02-18T00:30:12.495 INFO:teuthology.orchestra.run.trial069.stdout:Unpacking rbd-fuse (20.2.0-670-gadc19233-1jammy) ... 2026-02-18T00:30:12.522 INFO:teuthology.orchestra.run.trial069.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2026-02-18T00:30:12.587 INFO:teuthology.orchestra.run.trial069.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2026-02-18T00:30:12.588 INFO:teuthology.orchestra.run.trial069.stdout:Setting up nvme-cli (1.16-3ubuntu0.3) ... 2026-02-18T00:30:12.659 INFO:teuthology.orchestra.run.trial069.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /lib/systemd/system/nvmefc-boot-connections.service. 2026-02-18T00:30:12.954 INFO:teuthology.orchestra.run.trial069.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service → /lib/systemd/system/nvmf-autoconnect.service. 2026-02-18T00:30:13.324 INFO:teuthology.orchestra.run.trial069.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2026-02-18T00:30:13.336 INFO:teuthology.orchestra.run.trial069.stdout:Setting up cephadm (20.2.0-670-gadc19233-1jammy) ... 2026-02-18T00:30:13.379 INFO:teuthology.orchestra.run.trial069.stdout:Adding system user cephadm....done 2026-02-18T00:30:13.388 INFO:teuthology.orchestra.run.trial069.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2026-02-18T00:30:13.461 INFO:teuthology.orchestra.run.trial069.stdout:Setting up python-asyncssh-doc (2.5.0-1ubuntu0.1) ... 2026-02-18T00:30:13.462 INFO:teuthology.orchestra.run.trial069.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2026-02-18T00:30:13.533 INFO:teuthology.orchestra.run.trial069.stdout:Setting up python3-repoze.lru (0.7-2) ... 2026-02-18T00:30:13.607 INFO:teuthology.orchestra.run.trial069.stdout:Setting up liboath0:amd64 (2.6.7-3ubuntu0.1) ... 2026-02-18T00:30:13.608 INFO:teuthology.orchestra.run.trial069.stdout:Setting up python3-py (1.10.0-1) ... 2026-02-18T00:30:13.703 INFO:teuthology.orchestra.run.trial069.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2026-02-18T00:30:13.824 INFO:teuthology.orchestra.run.trial069.stdout:Setting up python3-cachetools (5.0.0-1) ... 2026-02-18T00:30:13.898 INFO:teuthology.orchestra.run.trial069.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2026-02-18T00:30:13.971 INFO:teuthology.orchestra.run.trial069.stdout:Setting up python3-ceph-argparse (20.2.0-670-gadc19233-1jammy) ... 2026-02-18T00:30:14.039 INFO:teuthology.orchestra.run.trial069.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2026-02-18T00:30:14.040 INFO:teuthology.orchestra.run.trial069.stdout:Setting up libnbd0 (1.10.5-1) ... 2026-02-18T00:30:14.041 INFO:teuthology.orchestra.run.trial069.stdout:Setting up libfuse2:amd64 (2.9.9-5ubuntu3) ... 2026-02-18T00:30:14.042 INFO:teuthology.orchestra.run.trial069.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2026-02-18T00:30:14.043 INFO:teuthology.orchestra.run.trial069.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2026-02-18T00:30:14.161 INFO:teuthology.orchestra.run.trial069.stdout:Setting up python3-natsort (8.0.2-1) ... 2026-02-18T00:30:14.238 INFO:teuthology.orchestra.run.trial069.stdout:Setting up libcephfs-proxy2 (20.2.0-670-gadc19233-1jammy) ... 2026-02-18T00:30:14.239 INFO:teuthology.orchestra.run.trial069.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2026-02-18T00:30:14.318 INFO:teuthology.orchestra.run.trial069.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2026-02-18T00:30:14.409 INFO:teuthology.orchestra.run.trial069.stdout:Setting up python3-pygments (2.11.2+dfsg-2ubuntu0.1) ... 2026-02-18T00:30:14.654 INFO:teuthology.orchestra.run.trial069.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2026-02-18T00:30:14.655 INFO:teuthology.orchestra.run.trial069.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2026-02-18T00:30:14.747 INFO:teuthology.orchestra.run.trial069.stdout:Setting up python3-asyncssh (2.5.0-1ubuntu0.1) ... 2026-02-18T00:30:14.869 INFO:teuthology.orchestra.run.trial069.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2026-02-18T00:30:14.950 INFO:teuthology.orchestra.run.trial069.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2026-02-18T00:30:15.022 INFO:teuthology.orchestra.run.trial069.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2026-02-18T00:30:15.022 INFO:teuthology.orchestra.run.trial069.stdout:Setting up python3-ceph-common (20.2.0-670-gadc19233-1jammy) ... 2026-02-18T00:30:15.111 INFO:teuthology.orchestra.run.trial069.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2026-02-18T00:30:15.604 INFO:teuthology.orchestra.run.trial069.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-18T00:30:15.608 INFO:teuthology.orchestra.run.trial069.stdout:Setting up python3-toml (0.10.2-1) ... 2026-02-18T00:30:15.683 INFO:teuthology.orchestra.run.trial069.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2026-02-18T00:30:15.684 INFO:teuthology.orchestra.run.trial069.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2026-02-18T00:30:15.685 INFO:teuthology.orchestra.run.trial069.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2026-02-18T00:30:15.760 INFO:teuthology.orchestra.run.trial069.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2026-02-18T00:30:15.833 INFO:teuthology.orchestra.run.trial069.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-18T00:30:15.834 INFO:teuthology.orchestra.run.trial069.stdout:Setting up python3-rsa (4.8-1) ... 2026-02-18T00:30:15.911 INFO:teuthology.orchestra.run.trial069.stdout:Setting up python3-tempora (4.1.2-1) ... 2026-02-18T00:30:15.983 INFO:teuthology.orchestra.run.trial069.stdout:Setting up python3-prettytable (2.5.0-2) ... 2026-02-18T00:30:16.060 INFO:teuthology.orchestra.run.trial069.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2026-02-18T00:30:16.061 INFO:teuthology.orchestra.run.trial069.stdout:Setting up python3-websocket (1.2.3-1) ... 2026-02-18T00:30:16.144 INFO:teuthology.orchestra.run.trial069.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2026-02-18T00:30:16.145 INFO:teuthology.orchestra.run.trial069.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2026-02-18T00:30:16.221 INFO:teuthology.orchestra.run.trial069.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2026-02-18T00:30:16.304 INFO:teuthology.orchestra.run.trial069.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2026-02-18T00:30:16.378 INFO:teuthology.orchestra.run.trial069.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3.1) ... 2026-02-18T00:30:16.379 INFO:teuthology.orchestra.run.trial069.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2026-02-18T00:30:16.512 INFO:teuthology.orchestra.run.trial069.stdout:Setting up python3-portend (3.0.0-1) ... 2026-02-18T00:30:16.585 INFO:teuthology.orchestra.run.trial069.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-18T00:30:16.586 INFO:teuthology.orchestra.run.trial069.stdout:Setting up python3-google-auth (1.5.1-3) ... 2026-02-18T00:30:16.670 INFO:teuthology.orchestra.run.trial069.stdout:Setting up jq (1.6-2.1ubuntu3.1) ... 2026-02-18T00:30:16.671 INFO:teuthology.orchestra.run.trial069.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2026-02-18T00:30:16.799 INFO:teuthology.orchestra.run.trial069.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2026-02-18T00:30:16.800 INFO:teuthology.orchestra.run.trial069.stdout:Setting up librados2 (20.2.0-670-gadc19233-1jammy) ... 2026-02-18T00:30:16.801 INFO:teuthology.orchestra.run.trial069.stdout:Setting up librgw2 (20.2.0-670-gadc19233-1jammy) ... 2026-02-18T00:30:16.802 INFO:teuthology.orchestra.run.trial069.stdout:Setting up libsqlite3-mod-ceph (20.2.0-670-gadc19233-1jammy) ... 2026-02-18T00:30:16.803 INFO:teuthology.orchestra.run.trial069.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2026-02-18T00:30:17.320 INFO:teuthology.orchestra.run.trial069.stdout:Setting up libcephfs2 (20.2.0-670-gadc19233-1jammy) ... 2026-02-18T00:30:17.321 INFO:teuthology.orchestra.run.trial069.stdout:Setting up libradosstriper1 (20.2.0-670-gadc19233-1jammy) ... 2026-02-18T00:30:17.322 INFO:teuthology.orchestra.run.trial069.stdout:Setting up librbd1 (20.2.0-670-gadc19233-1jammy) ... 2026-02-18T00:30:17.323 INFO:teuthology.orchestra.run.trial069.stdout:Setting up ceph-mgr-modules-core (20.2.0-670-gadc19233-1jammy) ... 2026-02-18T00:30:17.324 INFO:teuthology.orchestra.run.trial069.stdout:Setting up ceph-fuse (20.2.0-670-gadc19233-1jammy) ... 2026-02-18T00:30:17.394 INFO:teuthology.orchestra.run.trial069.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target → /lib/systemd/system/ceph-fuse.target. 2026-02-18T00:30:17.395 INFO:teuthology.orchestra.run.trial069.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target → /lib/systemd/system/ceph-fuse.target. 2026-02-18T00:30:17.767 INFO:teuthology.orchestra.run.trial069.stdout:Setting up libcephfs-dev (20.2.0-670-gadc19233-1jammy) ... 2026-02-18T00:30:17.768 INFO:teuthology.orchestra.run.trial069.stdout:Setting up python3-rados (20.2.0-670-gadc19233-1jammy) ... 2026-02-18T00:30:17.769 INFO:teuthology.orchestra.run.trial069.stdout:Setting up libcephfs-daemon (20.2.0-670-gadc19233-1jammy) ... 2026-02-18T00:30:17.770 INFO:teuthology.orchestra.run.trial069.stdout:Setting up python3-rbd (20.2.0-670-gadc19233-1jammy) ... 2026-02-18T00:30:17.771 INFO:teuthology.orchestra.run.trial069.stdout:Setting up rbd-fuse (20.2.0-670-gadc19233-1jammy) ... 2026-02-18T00:30:17.772 INFO:teuthology.orchestra.run.trial069.stdout:Setting up python3-rgw (20.2.0-670-gadc19233-1jammy) ... 2026-02-18T00:30:17.773 INFO:teuthology.orchestra.run.trial069.stdout:Setting up python3-cephfs (20.2.0-670-gadc19233-1jammy) ... 2026-02-18T00:30:17.774 INFO:teuthology.orchestra.run.trial069.stdout:Setting up ceph-common (20.2.0-670-gadc19233-1jammy) ... 2026-02-18T00:30:17.802 INFO:teuthology.orchestra.run.trial069.stdout:Adding group ceph....done 2026-02-18T00:30:17.837 INFO:teuthology.orchestra.run.trial069.stdout:Adding system user ceph....done 2026-02-18T00:30:17.847 INFO:teuthology.orchestra.run.trial069.stdout:Setting system user ceph properties....done 2026-02-18T00:30:17.854 INFO:teuthology.orchestra.run.trial069.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2026-02-18T00:30:17.926 INFO:teuthology.orchestra.run.trial069.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /lib/systemd/system/ceph.target. 2026-02-18T00:30:18.193 INFO:teuthology.orchestra.run.trial069.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service → /lib/systemd/system/rbdmap.service. 2026-02-18T00:30:18.560 INFO:teuthology.orchestra.run.trial069.stdout:Setting up ceph-test (20.2.0-670-gadc19233-1jammy) ... 2026-02-18T00:30:18.561 INFO:teuthology.orchestra.run.trial069.stdout:Setting up radosgw (20.2.0-670-gadc19233-1jammy) ... 2026-02-18T00:30:18.808 INFO:teuthology.orchestra.run.trial069.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /lib/systemd/system/ceph-radosgw.target. 2026-02-18T00:30:18.809 INFO:teuthology.orchestra.run.trial069.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /lib/systemd/system/ceph-radosgw.target. 2026-02-18T00:30:19.150 INFO:teuthology.orchestra.run.trial069.stdout:Setting up ceph-base (20.2.0-670-gadc19233-1jammy) ... 2026-02-18T00:30:19.265 INFO:teuthology.orchestra.run.trial069.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /lib/systemd/system/ceph-crash.service. 2026-02-18T00:30:19.629 INFO:teuthology.orchestra.run.trial069.stdout:Setting up ceph-mds (20.2.0-670-gadc19233-1jammy) ... 2026-02-18T00:30:19.688 INFO:teuthology.orchestra.run.trial069.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /lib/systemd/system/ceph-mds.target. 2026-02-18T00:30:19.688 INFO:teuthology.orchestra.run.trial069.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /lib/systemd/system/ceph-mds.target. 2026-02-18T00:30:20.022 INFO:teuthology.orchestra.run.trial069.stdout:Setting up ceph-mgr (20.2.0-670-gadc19233-1jammy) ... 2026-02-18T00:30:20.099 INFO:teuthology.orchestra.run.trial069.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /lib/systemd/system/ceph-mgr.target. 2026-02-18T00:30:20.099 INFO:teuthology.orchestra.run.trial069.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /lib/systemd/system/ceph-mgr.target. 2026-02-18T00:30:20.446 INFO:teuthology.orchestra.run.trial069.stdout:Setting up ceph-osd (20.2.0-670-gadc19233-1jammy) ... 2026-02-18T00:30:20.529 INFO:teuthology.orchestra.run.trial069.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /lib/systemd/system/ceph-osd.target. 2026-02-18T00:30:20.529 INFO:teuthology.orchestra.run.trial069.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /lib/systemd/system/ceph-osd.target. 2026-02-18T00:30:20.890 INFO:teuthology.orchestra.run.trial069.stdout:Setting up ceph-mgr-k8sevents (20.2.0-670-gadc19233-1jammy) ... 2026-02-18T00:30:20.900 INFO:teuthology.orchestra.run.trial069.stdout:Setting up ceph-mgr-diskprediction-local (20.2.0-670-gadc19233-1jammy) ... 2026-02-18T00:30:20.910 INFO:teuthology.orchestra.run.trial069.stdout:Setting up ceph-mon (20.2.0-670-gadc19233-1jammy) ... 2026-02-18T00:30:20.978 INFO:teuthology.orchestra.run.trial069.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /lib/systemd/system/ceph-mon.target. 2026-02-18T00:30:20.978 INFO:teuthology.orchestra.run.trial069.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /lib/systemd/system/ceph-mon.target. 2026-02-18T00:30:21.326 INFO:teuthology.orchestra.run.trial069.stdout:Setting up ceph-mgr-cephadm (20.2.0-670-gadc19233-1jammy) ... 2026-02-18T00:30:21.339 INFO:teuthology.orchestra.run.trial069.stdout:Setting up ceph (20.2.0-670-gadc19233-1jammy) ... 2026-02-18T00:30:21.340 INFO:teuthology.orchestra.run.trial069.stdout:Setting up ceph-mgr-dashboard (20.2.0-670-gadc19233-1jammy) ... 2026-02-18T00:30:21.351 INFO:teuthology.orchestra.run.trial069.stdout:Setting up ceph-volume (20.2.0-670-gadc19233-1jammy) ... 2026-02-18T00:30:21.460 INFO:teuthology.orchestra.run.trial069.stdout:Processing triggers for man-db (2.10.2-1) ... 2026-02-18T00:30:21.542 INFO:teuthology.orchestra.run.trial069.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.11) ... 2026-02-18T00:30:21.976 INFO:teuthology.orchestra.run.trial069.stdout: 2026-02-18T00:30:21.976 INFO:teuthology.orchestra.run.trial069.stdout:Running kernel seems to be up-to-date. 2026-02-18T00:30:21.977 INFO:teuthology.orchestra.run.trial069.stdout: 2026-02-18T00:30:21.977 INFO:teuthology.orchestra.run.trial069.stdout:The processor microcode seems to be up-to-date. 2026-02-18T00:30:21.977 INFO:teuthology.orchestra.run.trial069.stdout: 2026-02-18T00:30:21.977 INFO:teuthology.orchestra.run.trial069.stdout:No services need to be restarted. 2026-02-18T00:30:21.977 INFO:teuthology.orchestra.run.trial069.stdout: 2026-02-18T00:30:21.977 INFO:teuthology.orchestra.run.trial069.stdout:No containers need to be restarted. 2026-02-18T00:30:21.977 INFO:teuthology.orchestra.run.trial069.stdout: 2026-02-18T00:30:21.977 INFO:teuthology.orchestra.run.trial069.stdout:No user sessions are running outdated binaries. 2026-02-18T00:30:21.977 INFO:teuthology.orchestra.run.trial069.stdout: 2026-02-18T00:30:21.977 INFO:teuthology.orchestra.run.trial069.stdout:No VM guests are running outdated hypervisor (qemu) binaries on this host. 2026-02-18T00:30:22.637 INFO:teuthology.orchestra.run.trial069.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2026-02-18T00:30:22.643 DEBUG:teuthology.parallel:result is None 2026-02-18T00:30:22.644 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=adc1923395f2bcd6ae89b5d331d278364d1848ed 2026-02-18T00:30:22.814 DEBUG:teuthology.orchestra.run.trial069:> dpkg-query -W -f '${Version}' ceph 2026-02-18T00:30:22.824 INFO:teuthology.orchestra.run.trial069.stdout:20.2.0-670-gadc19233-1jammy 2026-02-18T00:30:22.825 INFO:teuthology.packaging:The installed version of ceph is 20.2.0-670-gadc19233-1jammy 2026-02-18T00:30:22.825 INFO:teuthology.task.install:The correct ceph version 20.2.0-670-gadc19233-1jammy is installed. 2026-02-18T00:30:22.826 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2026-02-18T00:30:22.827 DEBUG:teuthology.orchestra.run.trial069:> set -ex 2026-02-18T00:30:22.827 DEBUG:teuthology.orchestra.run.trial069:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-18T00:30:22.877 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2026-02-18T00:30:22.877 DEBUG:teuthology.orchestra.run.trial069:> set -ex 2026-02-18T00:30:22.877 DEBUG:teuthology.orchestra.run.trial069:> sudo dd of=/usr/bin/daemon-helper 2026-02-18T00:30:22.929 DEBUG:teuthology.orchestra.run.trial069:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-18T00:30:22.979 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2026-02-18T00:30:22.980 DEBUG:teuthology.orchestra.run.trial069:> set -ex 2026-02-18T00:30:22.981 DEBUG:teuthology.orchestra.run.trial069:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-18T00:30:23.034 DEBUG:teuthology.orchestra.run.trial069:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-18T00:30:23.084 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2026-02-18T00:30:23.085 DEBUG:teuthology.orchestra.run.trial069:> set -ex 2026-02-18T00:30:23.085 DEBUG:teuthology.orchestra.run.trial069:> sudo dd of=/usr/bin/stdin-killer 2026-02-18T00:30:23.136 DEBUG:teuthology.orchestra.run.trial069:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-18T00:30:23.188 INFO:teuthology.run_tasks:Running task workunit... 2026-02-18T00:30:23.200 INFO:tasks.workunit:Pulling workunits from ref adc1923395f2bcd6ae89b5d331d278364d1848ed 2026-02-18T00:30:23.200 INFO:tasks.workunit:Making a separate scratch dir for every client... 2026-02-18T00:30:23.200 INFO:tasks.workunit:timeout=3h 2026-02-18T00:30:23.200 INFO:tasks.workunit:cleanup=True 2026-02-18T00:30:23.200 DEBUG:teuthology.orchestra.run.trial069:> stat -- /home/ubuntu/cephtest/mnt.0 2026-02-18T00:30:23.232 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-18T00:30:23.232 INFO:teuthology.orchestra.run.trial069.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2026-02-18T00:30:23.233 DEBUG:teuthology.orchestra.run.trial069:> mkdir -- /home/ubuntu/cephtest/mnt.0 2026-02-18T00:30:23.280 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2026-02-18T00:30:23.281 DEBUG:teuthology.orchestra.run.trial069:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2026-02-18T00:30:23.324 DEBUG:teuthology.orchestra.run.trial069:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout adc1923395f2bcd6ae89b5d331d278364d1848ed 2026-02-18T00:30:23.375 INFO:tasks.workunit.client.0.trial069.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2026-02-18T00:30:44.829 INFO:tasks.workunit.client.0.trial069.stderr:Note: switching to 'adc1923395f2bcd6ae89b5d331d278364d1848ed'. 2026-02-18T00:30:44.829 INFO:tasks.workunit.client.0.trial069.stderr: 2026-02-18T00:30:44.829 INFO:tasks.workunit.client.0.trial069.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2026-02-18T00:30:44.829 INFO:tasks.workunit.client.0.trial069.stderr:changes and commit them, and you can discard any commits you make in this 2026-02-18T00:30:44.829 INFO:tasks.workunit.client.0.trial069.stderr:state without impacting any branches by switching back to a branch. 2026-02-18T00:30:44.829 INFO:tasks.workunit.client.0.trial069.stderr: 2026-02-18T00:30:44.830 INFO:tasks.workunit.client.0.trial069.stderr:If you want to create a new branch to retain commits you create, you may 2026-02-18T00:30:44.830 INFO:tasks.workunit.client.0.trial069.stderr:do so (now or later) by using -c with the switch command. Example: 2026-02-18T00:30:44.830 INFO:tasks.workunit.client.0.trial069.stderr: 2026-02-18T00:30:44.830 INFO:tasks.workunit.client.0.trial069.stderr: git switch -c 2026-02-18T00:30:44.830 INFO:tasks.workunit.client.0.trial069.stderr: 2026-02-18T00:30:44.830 INFO:tasks.workunit.client.0.trial069.stderr:Or undo this operation with: 2026-02-18T00:30:44.830 INFO:tasks.workunit.client.0.trial069.stderr: 2026-02-18T00:30:44.830 INFO:tasks.workunit.client.0.trial069.stderr: git switch - 2026-02-18T00:30:44.830 INFO:tasks.workunit.client.0.trial069.stderr: 2026-02-18T00:30:44.830 INFO:tasks.workunit.client.0.trial069.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2026-02-18T00:30:44.830 INFO:tasks.workunit.client.0.trial069.stderr: 2026-02-18T00:30:44.831 INFO:tasks.workunit.client.0.trial069.stderr:HEAD is now at adc1923395f Merge PR #67279 into tentacle 2026-02-18T00:30:44.839 DEBUG:teuthology.orchestra.run.trial069:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/standalone && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2026-02-18T00:30:44.890 DEBUG:teuthology.orchestra.run.trial069:> set -ex 2026-02-18T00:30:44.890 DEBUG:teuthology.orchestra.run.trial069:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2026-02-18T00:30:44.936 INFO:tasks.workunit:Running workunits matching misc on client.0... 2026-02-18T00:30:44.936 INFO:tasks.workunit:Running workunit misc/mclock-config.sh... 2026-02-18T00:30:44.937 DEBUG:teuthology.orchestra.run.trial069:workunit test misc/mclock-config.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=adc1923395f2bcd6ae89b5d331d278364d1848ed TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh 2026-02-18T00:30:44.986 INFO:tasks.workunit.client.0.trial069.stderr:stty: 'standard input': Inappropriate ioctl for device 2026-02-18T00:30:44.993 INFO:tasks.workunit.client.0.trial069.stderr:+ PS4='${BASH_SOURCE[0]}:$LINENO: ${FUNCNAME[0]}: ' 2026-02-18T00:30:44.993 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2394: main: export PATH=.:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2026-02-18T00:30:44.993 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2394: main: PATH=.:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2026-02-18T00:30:44.993 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2395: main: export PYTHONWARNINGS=ignore 2026-02-18T00:30:44.993 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2395: main: PYTHONWARNINGS=ignore 2026-02-18T00:30:44.994 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2396: main: export CEPH_CONF=/dev/null 2026-02-18T00:30:44.994 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2396: main: CEPH_CONF=/dev/null 2026-02-18T00:30:44.994 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2397: main: unset CEPH_ARGS 2026-02-18T00:30:44.994 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2399: main: local code 2026-02-18T00:30:44.994 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2400: main: run td/mclock-config 2026-02-18T00:30:44.994 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:21: run: local dir=td/mclock-config 2026-02-18T00:30:44.994 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:22: run: shift 2026-02-18T00:30:44.994 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:24: run: export CEPH_MON=127.0.0.1:7124 2026-02-18T00:30:44.994 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:24: run: CEPH_MON=127.0.0.1:7124 2026-02-18T00:30:44.994 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:25: run: export CEPH_ARGS 2026-02-18T00:30:44.995 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:26: run: uuidgen 2026-02-18T00:30:44.995 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:26: run: CEPH_ARGS+='--fsid=96923420-254b-4639-a0f2-a5afc59a1de0 --auth-supported=none ' 2026-02-18T00:30:44.995 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:27: run: CEPH_ARGS+='--mon-host=127.0.0.1:7124 ' 2026-02-18T00:30:44.995 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:28: run: CEPH_ARGS+='--debug-mclock 20 ' 2026-02-18T00:30:44.997 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:30: run: set 2026-02-18T00:30:44.997 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:30: run: sed -n -e 's/^\(TEST_[0-9a-z_]*\) .*/\1/p' 2026-02-18T00:30:44.997 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:30: run: local 'funcs=TEST_backfill_limit_adjustment_mclock 2026-02-18T00:30:44.997 INFO:tasks.workunit.client.0.trial069.stderr:TEST_profile_builtin_to_custom 2026-02-18T00:30:44.997 INFO:tasks.workunit.client.0.trial069.stderr:TEST_profile_custom_to_builtin 2026-02-18T00:30:44.997 INFO:tasks.workunit.client.0.trial069.stderr:TEST_profile_disallow_builtin_params_modify 2026-02-18T00:30:44.998 INFO:tasks.workunit.client.0.trial069.stderr:TEST_profile_disallow_builtin_params_override 2026-02-18T00:30:44.998 INFO:tasks.workunit.client.0.trial069.stderr:TEST_recovery_limit_adjustment_mclock' 2026-02-18T00:30:44.998 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:31: run: for func in $funcs 2026-02-18T00:30:44.998 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:32: run: setup td/mclock-config 2026-02-18T00:30:44.998 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/mclock-config 2026-02-18T00:30:44.998 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/mclock-config 2026-02-18T00:30:44.998 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/mclock-config 2026-02-18T00:30:44.998 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T00:30:44.998 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/mclock-config KILL 2026-02-18T00:30:44.998 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:30:44.998 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:30:44.999 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:30:44.999 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:30:44.999 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:30:44.999 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:30:45.000 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T00:30:45.000 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T00:30:45.000 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T00:30:45.001 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T00:30:45.001 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T00:30:45.001 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T00:30:45.002 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:30:45.002 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T00:30:45.003 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T00:30:45.003 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:30:45.004 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T00:30:45.005 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T00:30:45.005 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/mclock-config 2026-02-18T00:30:45.007 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T00:30:45.007 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:30:45.007 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.7504 2026-02-18T00:30:45.007 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.7504 2026-02-18T00:30:45.008 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T00:30:45.008 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T00:30:45.008 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/mclock-config 2026-02-18T00:30:45.009 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-18T00:30:45.009 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:30:45.009 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.7504 2026-02-18T00:30:45.009 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.7504 2026-02-18T00:30:45.011 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-18T00:30:45.012 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 1024 -le 1024 ']' 2026-02-18T00:30:45.012 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:127: setup: ulimit -n 4096 2026-02-18T00:30:45.013 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-18T00:30:45.013 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/mclock-config 1' TERM HUP INT 2026-02-18T00:30:45.013 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:33: run: TEST_backfill_limit_adjustment_mclock td/mclock-config 2026-02-18T00:30:45.013 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:236: TEST_backfill_limit_adjustment_mclock: local dir=td/mclock-config 2026-02-18T00:30:45.013 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:238: TEST_backfill_limit_adjustment_mclock: setup td/mclock-config 2026-02-18T00:30:45.013 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/mclock-config 2026-02-18T00:30:45.013 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/mclock-config 2026-02-18T00:30:45.013 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/mclock-config 2026-02-18T00:30:45.013 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T00:30:45.013 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/mclock-config KILL 2026-02-18T00:30:45.013 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:30:45.013 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:30:45.014 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:30:45.014 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:30:45.014 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:30:45.014 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:30:45.014 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T00:30:45.015 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T00:30:45.016 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T00:30:45.017 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T00:30:45.017 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T00:30:45.018 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T00:30:45.018 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:30:45.018 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T00:30:45.019 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T00:30:45.019 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:30:45.019 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T00:30:45.020 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T00:30:45.020 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/mclock-config 2026-02-18T00:30:45.022 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T00:30:45.022 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:30:45.022 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.7504 2026-02-18T00:30:45.022 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.7504 2026-02-18T00:30:45.023 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T00:30:45.023 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T00:30:45.024 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/mclock-config 2026-02-18T00:30:45.025 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-18T00:30:45.025 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:30:45.025 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.7504 2026-02-18T00:30:45.026 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.7504 2026-02-18T00:30:45.027 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-18T00:30:45.028 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-18T00:30:45.028 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-18T00:30:45.028 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/mclock-config 1' TERM HUP INT 2026-02-18T00:30:45.029 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:239: TEST_backfill_limit_adjustment_mclock: run_mon td/mclock-config a 2026-02-18T00:30:45.029 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/mclock-config 2026-02-18T00:30:45.029 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-18T00:30:45.029 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-18T00:30:45.029 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-18T00:30:45.029 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/mclock-config/a 2026-02-18T00:30:45.029 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/mclock-config/a --run-dir=td/mclock-config 2026-02-18T00:30:45.065 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-18T00:30:45.065 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:30:45.065 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:30:45.065 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:30:45.065 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:30:45.066 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.7504 2026-02-18T00:30:45.066 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.7504/$cluster-$name.asok' 2026-02-18T00:30:45.066 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/mclock-config/a '--log-file=td/mclock-config/$name.log' '--admin-socket=/tmp/ceph-asok.7504/$cluster-$name.asok' --mon-cluster-log-file=td/mclock-config/log --run-dir=td/mclock-config '--pid-file=td/mclock-config/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-18T00:30:45.097 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-18T00:30:45.098 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-18T00:30:45.098 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T00:30:45.098 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-18T00:30:45.098 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-18T00:30:45.099 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-18T00:30:45.099 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-18T00:30:45.099 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:30:45.099 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:30:45.099 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:30:45.099 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:30:45.099 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.7504 2026-02-18T00:30:45.099 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.7504/ceph-mon.a.asok 2026-02-18T00:30:45.100 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T00:30:45.100 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.7504/ceph-mon.a.asok config get fsid 2026-02-18T00:30:45.155 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-18T00:30:45.155 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T00:30:45.155 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-18T00:30:45.156 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-18T00:30:45.156 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-18T00:30:45.156 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-18T00:30:45.156 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:30:45.156 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:30:45.156 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:30:45.156 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:30:45.156 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.7504 2026-02-18T00:30:45.156 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.7504/ceph-mon.a.asok 2026-02-18T00:30:45.157 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T00:30:45.157 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.7504/ceph-mon.a.asok config get mon_host 2026-02-18T00:30:45.208 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:240: TEST_backfill_limit_adjustment_mclock: run_mgr td/mclock-config x 2026-02-18T00:30:45.209 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/mclock-config 2026-02-18T00:30:45.209 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-18T00:30:45.209 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-18T00:30:45.209 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-18T00:30:45.209 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/mclock-config/x 2026-02-18T00:30:45.209 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-18T00:30:45.317 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-18T00:30:45.317 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:30:45.317 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:30:45.318 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:30:45.318 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:30:45.318 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.7504 2026-02-18T00:30:45.318 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.7504/$cluster-$name.asok' 2026-02-18T00:30:45.318 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-18T00:30:45.319 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/mclock-config/x '--log-file=td/mclock-config/$name.log' '--admin-socket=/tmp/ceph-asok.7504/$cluster-$name.asok' --run-dir=td/mclock-config '--pid-file=td/mclock-config/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-18T00:30:45.342 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:242: TEST_backfill_limit_adjustment_mclock: run_osd td/mclock-config 0 --osd_op_queue=mclock_scheduler 2026-02-18T00:30:45.342 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/mclock-config 2026-02-18T00:30:45.342 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T00:30:45.342 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-18T00:30:45.343 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T00:30:45.343 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/mclock-config/0 2026-02-18T00:30:45.343 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=96923420-254b-4639-a0f2-a5afc59a1de0 --auth-supported=none --mon-host=127.0.0.1:7124 --debug-mclock 20 ' 2026-02-18T00:30:45.343 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T00:30:45.343 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T00:30:45.343 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T00:30:45.343 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/mclock-config/0' 2026-02-18T00:30:45.343 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/mclock-config/0/journal' 2026-02-18T00:30:45.343 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T00:30:45.343 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-18T00:30:45.344 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/mclock-config' 2026-02-18T00:30:45.344 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T00:30:45.344 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:30:45.344 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:30:45.344 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:30:45.344 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:30:45.344 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.7504 2026-02-18T00:30:45.344 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.7504/$cluster-$name.asok' 2026-02-18T00:30:45.344 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.7504/$cluster-$name.asok' 2026-02-18T00:30:45.344 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T00:30:45.344 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T00:30:45.345 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T00:30:45.345 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/mclock-config/$name.log' 2026-02-18T00:30:45.345 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/mclock-config/$name.pid' 2026-02-18T00:30:45.345 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T00:30:45.345 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T00:30:45.345 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T00:30:45.345 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T00:30:45.345 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T00:30:45.345 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=--osd_op_queue=mclock_scheduler 2026-02-18T00:30:45.345 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/mclock-config/0 2026-02-18T00:30:45.345 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T00:30:45.346 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=508ca2e1-c17b-464c-9d96-e01828d313e9 2026-02-18T00:30:45.346 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 508ca2e1-c17b-464c-9d96-e01828d313e9' 2026-02-18T00:30:45.347 INFO:tasks.workunit.client.0.trial069.stdout:add osd0 508ca2e1-c17b-464c-9d96-e01828d313e9 2026-02-18T00:30:45.347 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T00:30:45.354 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQA1CJVpP773FBAAYr5EJGsdqO/g4iBdXuLziw== 2026-02-18T00:30:45.354 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQA1CJVpP773FBAAYr5EJGsdqO/g4iBdXuLziw=="}' 2026-02-18T00:30:45.354 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 508ca2e1-c17b-464c-9d96-e01828d313e9 -i td/mclock-config/0/new.json 2026-02-18T00:30:45.466 INFO:tasks.workunit.client.0.trial069.stdout:0 2026-02-18T00:30:45.473 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/mclock-config/0/new.json 2026-02-18T00:30:45.474 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=96923420-254b-4639-a0f2-a5afc59a1de0 --auth-supported=none --mon-host=127.0.0.1:7124 --debug-mclock 20 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/mclock-config/0 --osd-journal=td/mclock-config/0/journal --chdir= --run-dir=td/mclock-config '--admin-socket=/tmp/ceph-asok.7504/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/mclock-config/$name.log' '--pid-file=td/mclock-config/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_op_queue=mclock_scheduler --mkfs --key AQA1CJVpP773FBAAYr5EJGsdqO/g4iBdXuLziw== --osd-uuid 508ca2e1-c17b-464c-9d96-e01828d313e9 2026-02-18T00:30:45.490 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:30:45.485+0000 7fed1b6d6a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:30:45.492 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:30:45.485+0000 7fed1b6d6a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:30:45.493 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:30:45.489+0000 7fed1b6d6a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:30:45.494 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:30:45.489+0000 7fed1b6d6a40 -1 bdev(0x562a7b11ec00 td/mclock-config/0/block) open stat got: (1) Operation not permitted 2026-02-18T00:30:45.494 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:30:45.489+0000 7fed1b6d6a40 -1 bluestore(td/mclock-config/0) _read_fsid unparsable uuid 2026-02-18T00:30:46.341 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/mclock-config/0/keyring 2026-02-18T00:30:46.342 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T00:30:46.343 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-18T00:30:46.343 INFO:tasks.workunit.client.0.trial069.stdout:adding osd0 key to auth repository 2026-02-18T00:30:46.343 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/mclock-config/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T00:30:46.459 INFO:tasks.workunit.client.0.trial069.stdout:start osd.0 2026-02-18T00:30:46.460 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-18T00:30:46.460 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=96923420-254b-4639-a0f2-a5afc59a1de0 --auth-supported=none --mon-host=127.0.0.1:7124 --debug-mclock 20 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/mclock-config/0 --osd-journal=td/mclock-config/0/journal --chdir= --run-dir=td/mclock-config '--admin-socket=/tmp/ceph-asok.7504/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/mclock-config/$name.log' '--pid-file=td/mclock-config/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_op_queue=mclock_scheduler 2026-02-18T00:30:46.460 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T00:30:46.460 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T00:30:46.460 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T00:30:46.474 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:30:46.469+0000 7fbbaa1bea40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:30:46.475 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:30:46.469+0000 7fbbaa1bea40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:30:46.476 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:30:46.469+0000 7fbbaa1bea40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:30:46.565 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-18T00:30:46.565 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:30:46.566 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-18T00:30:46.566 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:30:46.566 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:30:46.566 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:30:46.566 INFO:tasks.workunit.client.0.trial069.stdout:0 2026-02-18T00:30:46.567 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:30:46.567 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:30:46.567 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T00:30:46.673 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:30:46.874 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:30:46.869+0000 7fbbaa1bea40 -1 Falling back to public interface 2026-02-18T00:30:47.496 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:30:47.489+0000 7fbbaa1bea40 -1 osd.0 0 log_to_monitors true 2026-02-18T00:30:47.675 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:30:47.675 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:30:47.676 INFO:tasks.workunit.client.0.trial069.stdout:1 2026-02-18T00:30:47.676 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T00:30:47.677 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:30:47.677 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T00:30:47.817 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:30:48.822 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:30:48.823 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:30:48.823 INFO:tasks.workunit.client.0.trial069.stdout:2 2026-02-18T00:30:48.824 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-18T00:30:48.824 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:30:48.824 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T00:30:49.024 INFO:tasks.workunit.client.0.trial069.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/2579666287,v1:127.0.0.1:6801/2579666287] [v2:127.0.0.1:6802/2579666287,v1:127.0.0.1:6803/2579666287] exists,up 508ca2e1-c17b-464c-9d96-e01828d313e9 2026-02-18T00:30:49.025 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:30:49.025 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:30:49.025 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:30:49.025 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:244: TEST_backfill_limit_adjustment_mclock: jq .osd_max_backfills 2026-02-18T00:30:49.025 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:244: TEST_backfill_limit_adjustment_mclock: bc 2026-02-18T00:30:49.026 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:244: TEST_backfill_limit_adjustment_mclock: get_asok_path osd.0 2026-02-18T00:30:49.026 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-18T00:30:49.026 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-18T00:30:49.027 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:30:49.027 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:30:49.027 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.7504 2026-02-18T00:30:49.027 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.7504/ceph-osd.0.asok 2026-02-18T00:30:49.027 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:244: TEST_backfill_limit_adjustment_mclock: CEPH_ARGS= 2026-02-18T00:30:49.027 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:244: TEST_backfill_limit_adjustment_mclock: ceph --format=json daemon /tmp/ceph-asok.7504/ceph-osd.0.asok config get osd_max_backfills 2026-02-18T00:30:49.086 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:244: TEST_backfill_limit_adjustment_mclock: local backfills=1 2026-02-18T00:30:49.086 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:246: TEST_backfill_limit_adjustment_mclock: echo 'osd_max_backfills: 1' 2026-02-18T00:30:49.087 INFO:tasks.workunit.client.0.trial069.stdout:osd_max_backfills: 1 2026-02-18T00:30:49.087 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:251: TEST_backfill_limit_adjustment_mclock: ceph config set osd.0 osd_max_backfills 20 2026-02-18T00:30:49.295 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:252: TEST_backfill_limit_adjustment_mclock: sleep 2 2026-02-18T00:30:51.297 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:254: TEST_backfill_limit_adjustment_mclock: jq .osd_max_backfills 2026-02-18T00:30:51.298 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:254: TEST_backfill_limit_adjustment_mclock: bc 2026-02-18T00:30:51.299 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:254: TEST_backfill_limit_adjustment_mclock: get_asok_path osd.0 2026-02-18T00:30:51.299 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-18T00:30:51.299 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-18T00:30:51.299 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:30:51.299 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:30:51.300 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.7504 2026-02-18T00:30:51.300 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.7504/ceph-osd.0.asok 2026-02-18T00:30:51.300 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:254: TEST_backfill_limit_adjustment_mclock: CEPH_ARGS= 2026-02-18T00:30:51.300 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:254: TEST_backfill_limit_adjustment_mclock: ceph --format=json daemon /tmp/ceph-asok.7504/ceph-osd.0.asok config get osd_max_backfills 2026-02-18T00:30:51.360 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:254: TEST_backfill_limit_adjustment_mclock: local max_backfills=1 2026-02-18T00:30:51.361 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:255: TEST_backfill_limit_adjustment_mclock: test 1 = 1 2026-02-18T00:30:51.362 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:259: TEST_backfill_limit_adjustment_mclock: jq .local_reservations.max_allowed 2026-02-18T00:30:51.362 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:259: TEST_backfill_limit_adjustment_mclock: bc 2026-02-18T00:30:51.363 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:259: TEST_backfill_limit_adjustment_mclock: get_asok_path osd.0 2026-02-18T00:30:51.363 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-18T00:30:51.363 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-18T00:30:51.363 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:30:51.363 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:30:51.363 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.7504 2026-02-18T00:30:51.363 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.7504/ceph-osd.0.asok 2026-02-18T00:30:51.363 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:259: TEST_backfill_limit_adjustment_mclock: CEPH_ARGS= 2026-02-18T00:30:51.363 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:259: TEST_backfill_limit_adjustment_mclock: ceph --format=json daemon /tmp/ceph-asok.7504/ceph-osd.0.asok dump_recovery_reservations 2026-02-18T00:30:51.421 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:259: TEST_backfill_limit_adjustment_mclock: max_backfills=1 2026-02-18T00:30:51.421 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:260: TEST_backfill_limit_adjustment_mclock: test 1 = 1 2026-02-18T00:30:51.422 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:262: TEST_backfill_limit_adjustment_mclock: jq .remote_reservations.max_allowed 2026-02-18T00:30:51.423 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:262: TEST_backfill_limit_adjustment_mclock: bc 2026-02-18T00:30:51.423 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:262: TEST_backfill_limit_adjustment_mclock: get_asok_path osd.0 2026-02-18T00:30:51.423 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-18T00:30:51.423 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-18T00:30:51.424 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:30:51.424 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:30:51.424 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.7504 2026-02-18T00:30:51.424 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.7504/ceph-osd.0.asok 2026-02-18T00:30:51.425 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:262: TEST_backfill_limit_adjustment_mclock: CEPH_ARGS= 2026-02-18T00:30:51.425 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:262: TEST_backfill_limit_adjustment_mclock: ceph --format=json daemon /tmp/ceph-asok.7504/ceph-osd.0.asok dump_recovery_reservations 2026-02-18T00:30:51.482 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:262: TEST_backfill_limit_adjustment_mclock: max_backfills=1 2026-02-18T00:30:51.483 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:263: TEST_backfill_limit_adjustment_mclock: test 1 = 1 2026-02-18T00:30:51.483 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:267: TEST_backfill_limit_adjustment_mclock: ceph config set osd.0 osd_mclock_override_recovery_settings true 2026-02-18T00:30:51.694 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:268: TEST_backfill_limit_adjustment_mclock: ceph config set osd.0 osd_max_backfills 20 2026-02-18T00:30:51.916 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:269: TEST_backfill_limit_adjustment_mclock: sleep 2 2026-02-18T00:30:53.918 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:271: TEST_backfill_limit_adjustment_mclock: jq .osd_max_backfills 2026-02-18T00:30:53.919 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:271: TEST_backfill_limit_adjustment_mclock: bc 2026-02-18T00:30:53.920 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:271: TEST_backfill_limit_adjustment_mclock: get_asok_path osd.0 2026-02-18T00:30:53.920 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-18T00:30:53.920 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-18T00:30:53.920 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:30:53.921 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:30:53.921 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.7504 2026-02-18T00:30:53.921 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.7504/ceph-osd.0.asok 2026-02-18T00:30:53.921 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:271: TEST_backfill_limit_adjustment_mclock: CEPH_ARGS= 2026-02-18T00:30:53.921 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:271: TEST_backfill_limit_adjustment_mclock: ceph --format=json daemon /tmp/ceph-asok.7504/ceph-osd.0.asok config get osd_max_backfills 2026-02-18T00:30:53.984 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:271: TEST_backfill_limit_adjustment_mclock: max_backfills=20 2026-02-18T00:30:53.984 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:272: TEST_backfill_limit_adjustment_mclock: test 20 = 20 2026-02-18T00:30:53.985 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:276: TEST_backfill_limit_adjustment_mclock: jq .local_reservations.max_allowed 2026-02-18T00:30:53.985 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:276: TEST_backfill_limit_adjustment_mclock: bc 2026-02-18T00:30:53.986 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:276: TEST_backfill_limit_adjustment_mclock: get_asok_path osd.0 2026-02-18T00:30:53.986 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-18T00:30:53.986 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-18T00:30:53.986 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:30:53.986 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:30:53.986 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.7504 2026-02-18T00:30:53.986 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.7504/ceph-osd.0.asok 2026-02-18T00:30:53.988 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:276: TEST_backfill_limit_adjustment_mclock: CEPH_ARGS= 2026-02-18T00:30:53.988 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:276: TEST_backfill_limit_adjustment_mclock: ceph --format=json daemon /tmp/ceph-asok.7504/ceph-osd.0.asok dump_recovery_reservations 2026-02-18T00:30:54.047 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:276: TEST_backfill_limit_adjustment_mclock: max_backfills=20 2026-02-18T00:30:54.048 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:277: TEST_backfill_limit_adjustment_mclock: test 20 = 20 2026-02-18T00:30:54.048 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:279: TEST_backfill_limit_adjustment_mclock: jq .remote_reservations.max_allowed 2026-02-18T00:30:54.048 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:279: TEST_backfill_limit_adjustment_mclock: bc 2026-02-18T00:30:54.048 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:279: TEST_backfill_limit_adjustment_mclock: get_asok_path osd.0 2026-02-18T00:30:54.048 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-18T00:30:54.048 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-18T00:30:54.048 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:30:54.049 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:30:54.049 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.7504 2026-02-18T00:30:54.049 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.7504/ceph-osd.0.asok 2026-02-18T00:30:54.049 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:279: TEST_backfill_limit_adjustment_mclock: CEPH_ARGS= 2026-02-18T00:30:54.049 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:279: TEST_backfill_limit_adjustment_mclock: ceph --format=json daemon /tmp/ceph-asok.7504/ceph-osd.0.asok dump_recovery_reservations 2026-02-18T00:30:54.108 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:279: TEST_backfill_limit_adjustment_mclock: max_backfills=20 2026-02-18T00:30:54.108 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:280: TEST_backfill_limit_adjustment_mclock: test 20 = 20 2026-02-18T00:30:54.108 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:284: TEST_backfill_limit_adjustment_mclock: kill_daemons td/mclock-config TERM osd 2026-02-18T00:30:54.108 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:30:54.108 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:30:54.108 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:30:54.109 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:30:54.109 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:30:54.415 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:30:54.416 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:285: TEST_backfill_limit_adjustment_mclock: ceph osd down 0 2026-02-18T00:30:54.620 INFO:tasks.workunit.client.0.trial069.stderr:osd.0 is already down. 2026-02-18T00:30:54.629 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:286: TEST_backfill_limit_adjustment_mclock: wait_for_osd down 0 2026-02-18T00:30:54.630 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=down 2026-02-18T00:30:54.630 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-18T00:30:54.630 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:30:54.630 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:30:54.630 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:30:54.630 INFO:tasks.workunit.client.0.trial069.stdout:0 2026-02-18T00:30:54.631 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:30:54.631 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:30:54.631 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 down' 2026-02-18T00:30:54.857 INFO:tasks.workunit.client.0.trial069.stdout:osd.0 down in weight 1 up_from 5 up_thru 0 down_at 6 last_clean_interval [0,0) [v2:127.0.0.1:6800/2579666287,v1:127.0.0.1:6801/2579666287] [v2:127.0.0.1:6802/2579666287,v1:127.0.0.1:6803/2579666287] exists 508ca2e1-c17b-464c-9d96-e01828d313e9 2026-02-18T00:30:54.858 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:30:54.858 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:30:54.858 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:30:54.858 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:287: TEST_backfill_limit_adjustment_mclock: activate_osd td/mclock-config 0 --osd-op-queue=mclock_scheduler 2026-02-18T00:30:54.858 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/mclock-config 2026-02-18T00:30:54.858 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-18T00:30:54.858 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-18T00:30:54.858 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-18T00:30:54.858 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/mclock-config/0 2026-02-18T00:30:54.858 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=96923420-254b-4639-a0f2-a5afc59a1de0 --auth-supported=none --mon-host=127.0.0.1:7124 --debug-mclock 20 ' 2026-02-18T00:30:54.858 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T00:30:54.858 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T00:30:54.858 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T00:30:54.858 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/mclock-config/0' 2026-02-18T00:30:54.858 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/mclock-config/0/journal' 2026-02-18T00:30:54.858 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-18T00:30:54.858 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-18T00:30:54.858 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/mclock-config' 2026-02-18T00:30:54.859 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-18T00:30:54.859 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:30:54.859 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:30:54.859 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:30:54.859 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:30:54.859 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.7504 2026-02-18T00:30:54.859 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.7504/$cluster-$name.asok' 2026-02-18T00:30:54.860 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.7504/$cluster-$name.asok' 2026-02-18T00:30:54.860 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-18T00:30:54.860 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/mclock-config/$name.log' 2026-02-18T00:30:54.860 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/mclock-config/$name.pid' 2026-02-18T00:30:54.860 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T00:30:54.860 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T00:30:54.860 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T00:30:54.860 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T00:30:54.860 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-18T00:30:54.860 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+=--osd-op-queue=mclock_scheduler 2026-02-18T00:30:54.860 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/mclock-config/0 2026-02-18T00:30:54.861 INFO:tasks.workunit.client.0.trial069.stdout:start osd.0 2026-02-18T00:30:54.861 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-18T00:30:54.861 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=96923420-254b-4639-a0f2-a5afc59a1de0 --auth-supported=none --mon-host=127.0.0.1:7124 --debug-mclock 20 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/mclock-config/0 --osd-journal=td/mclock-config/0/journal --chdir= --run-dir=td/mclock-config '--admin-socket=/tmp/ceph-asok.7504/$cluster-$name.asok' --debug-osd=20 '--log-file=td/mclock-config/$name.log' '--pid-file=td/mclock-config/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd-op-queue=mclock_scheduler 2026-02-18T00:30:54.862 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/mclock-config/0/whoami 2026-02-18T00:30:54.863 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-18T00:30:54.863 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-18T00:30:54.863 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-18T00:30:54.863 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-18T00:30:54.880 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:30:54.873+0000 7f4f7f800a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:30:54.882 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:30:54.877+0000 7f4f7f800a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:30:54.883 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:30:54.877+0000 7f4f7f800a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:30:55.075 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-18T00:30:55.076 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:30:55.076 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-18T00:30:55.076 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:30:55.076 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:30:55.076 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:30:55.076 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:30:55.076 INFO:tasks.workunit.client.0.trial069.stdout:0 2026-02-18T00:30:55.076 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:30:55.076 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T00:30:55.286 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:30:55.299 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:30:55.293+0000 7f4f7f800a40 -1 Falling back to public interface 2026-02-18T00:30:55.920 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:30:55.913+0000 7f4f7f800a40 -1 osd.0 6 log_to_monitors true 2026-02-18T00:30:56.287 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:30:56.288 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:30:56.288 INFO:tasks.workunit.client.0.trial069.stdout:1 2026-02-18T00:30:56.289 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T00:30:56.289 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:30:56.289 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T00:30:56.491 INFO:tasks.workunit.client.0.trial069.stdout:osd.0 up in weight 1 up_from 9 up_thru 0 down_at 6 last_clean_interval [5,6) [v2:127.0.0.1:6800/2587292023,v1:127.0.0.1:6801/2587292023] [v2:127.0.0.1:6802/2587292023,v1:127.0.0.1:6803/2587292023] exists,up 508ca2e1-c17b-464c-9d96-e01828d313e9 2026-02-18T00:30:56.493 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:30:56.493 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:30:56.493 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:30:56.493 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:290: TEST_backfill_limit_adjustment_mclock: jq .osd_max_backfills 2026-02-18T00:30:56.493 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:290: TEST_backfill_limit_adjustment_mclock: bc 2026-02-18T00:30:56.493 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:290: TEST_backfill_limit_adjustment_mclock: get_asok_path osd.0 2026-02-18T00:30:56.493 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-18T00:30:56.493 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-18T00:30:56.493 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:30:56.493 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:30:56.493 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.7504 2026-02-18T00:30:56.493 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.7504/ceph-osd.0.asok 2026-02-18T00:30:56.493 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:290: TEST_backfill_limit_adjustment_mclock: CEPH_ARGS= 2026-02-18T00:30:56.493 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:290: TEST_backfill_limit_adjustment_mclock: ceph --format=json daemon /tmp/ceph-asok.7504/ceph-osd.0.asok config get osd_max_backfills 2026-02-18T00:30:56.550 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:290: TEST_backfill_limit_adjustment_mclock: max_backfills=20 2026-02-18T00:30:56.551 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:291: TEST_backfill_limit_adjustment_mclock: test 20 = 20 2026-02-18T00:30:56.551 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:295: TEST_backfill_limit_adjustment_mclock: jq .local_reservations.max_allowed 2026-02-18T00:30:56.551 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:295: TEST_backfill_limit_adjustment_mclock: bc 2026-02-18T00:30:56.552 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:295: TEST_backfill_limit_adjustment_mclock: get_asok_path osd.0 2026-02-18T00:30:56.552 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-18T00:30:56.552 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-18T00:30:56.552 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:30:56.552 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:30:56.552 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.7504 2026-02-18T00:30:56.552 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.7504/ceph-osd.0.asok 2026-02-18T00:30:56.553 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:295: TEST_backfill_limit_adjustment_mclock: CEPH_ARGS= 2026-02-18T00:30:56.553 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:295: TEST_backfill_limit_adjustment_mclock: ceph --format=json daemon /tmp/ceph-asok.7504/ceph-osd.0.asok dump_recovery_reservations 2026-02-18T00:30:56.610 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:295: TEST_backfill_limit_adjustment_mclock: max_backfills=20 2026-02-18T00:30:56.610 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:296: TEST_backfill_limit_adjustment_mclock: test 20 = 20 2026-02-18T00:30:56.610 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:298: TEST_backfill_limit_adjustment_mclock: jq .remote_reservations.max_allowed 2026-02-18T00:30:56.610 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:298: TEST_backfill_limit_adjustment_mclock: bc 2026-02-18T00:30:56.610 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:298: TEST_backfill_limit_adjustment_mclock: get_asok_path osd.0 2026-02-18T00:30:56.611 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-18T00:30:56.611 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-18T00:30:56.611 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:30:56.611 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:30:56.611 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.7504 2026-02-18T00:30:56.611 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.7504/ceph-osd.0.asok 2026-02-18T00:30:56.612 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:298: TEST_backfill_limit_adjustment_mclock: CEPH_ARGS= 2026-02-18T00:30:56.612 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:298: TEST_backfill_limit_adjustment_mclock: ceph --format=json daemon /tmp/ceph-asok.7504/ceph-osd.0.asok dump_recovery_reservations 2026-02-18T00:30:56.668 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:298: TEST_backfill_limit_adjustment_mclock: max_backfills=20 2026-02-18T00:30:56.668 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:299: TEST_backfill_limit_adjustment_mclock: test 20 = 20 2026-02-18T00:30:56.668 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:301: TEST_backfill_limit_adjustment_mclock: teardown td/mclock-config 2026-02-18T00:30:56.668 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/mclock-config 2026-02-18T00:30:56.668 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T00:30:56.669 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/mclock-config KILL 2026-02-18T00:30:56.669 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:30:56.669 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:30:56.669 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:30:56.669 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:30:56.669 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:30:56.776 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:30:56.777 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T00:30:56.778 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T00:30:56.778 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T00:30:56.780 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T00:30:56.780 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T00:30:56.781 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T00:30:56.781 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:30:56.782 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T00:30:56.782 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T00:30:56.782 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:30:56.783 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T00:30:56.784 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T00:30:56.784 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/mclock-config 2026-02-18T00:30:56.789 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T00:30:56.789 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:30:56.789 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.7504 2026-02-18T00:30:56.789 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.7504 2026-02-18T00:30:56.789 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T00:30:56.789 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T00:30:56.789 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:34: run: teardown td/mclock-config 2026-02-18T00:30:56.789 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/mclock-config 2026-02-18T00:30:56.789 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T00:30:56.789 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/mclock-config KILL 2026-02-18T00:30:56.790 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:30:56.790 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:30:56.790 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:30:56.790 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:30:56.790 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:30:56.792 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:30:56.793 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T00:30:56.793 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T00:30:56.794 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T00:30:56.796 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T00:30:56.796 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T00:30:56.796 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T00:30:56.797 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:30:56.797 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T00:30:56.798 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T00:30:56.798 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:30:56.799 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T00:30:56.800 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T00:30:56.800 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/mclock-config 2026-02-18T00:30:56.801 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T00:30:56.802 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:30:56.802 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.7504 2026-02-18T00:30:56.802 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.7504 2026-02-18T00:30:56.805 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T00:30:56.805 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T00:30:56.805 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:31: run: for func in $funcs 2026-02-18T00:30:56.805 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:32: run: setup td/mclock-config 2026-02-18T00:30:56.805 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/mclock-config 2026-02-18T00:30:56.805 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/mclock-config 2026-02-18T00:30:56.805 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/mclock-config 2026-02-18T00:30:56.805 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T00:30:56.806 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/mclock-config KILL 2026-02-18T00:30:56.806 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:30:56.806 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:30:56.806 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:30:56.806 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:30:56.806 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:30:56.807 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:30:56.807 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T00:30:56.807 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T00:30:56.807 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T00:30:56.808 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T00:30:56.808 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T00:30:56.809 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T00:30:56.809 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:30:56.809 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T00:30:56.810 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T00:30:56.810 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:30:56.811 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T00:30:56.812 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T00:30:56.812 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/mclock-config 2026-02-18T00:30:56.813 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T00:30:56.813 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:30:56.813 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.7504 2026-02-18T00:30:56.813 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.7504 2026-02-18T00:30:56.814 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T00:30:56.814 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T00:30:56.814 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/mclock-config 2026-02-18T00:30:56.816 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-18T00:30:56.816 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:30:56.816 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.7504 2026-02-18T00:30:56.816 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.7504 2026-02-18T00:30:56.819 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-18T00:30:56.819 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-18T00:30:56.819 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-18T00:30:56.819 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/mclock-config 1' TERM HUP INT 2026-02-18T00:30:56.819 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:33: run: TEST_profile_builtin_to_custom td/mclock-config 2026-02-18T00:30:56.819 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:39: TEST_profile_builtin_to_custom: local dir=td/mclock-config 2026-02-18T00:30:56.819 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:41: TEST_profile_builtin_to_custom: run_mon td/mclock-config a 2026-02-18T00:30:56.819 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/mclock-config 2026-02-18T00:30:56.819 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-18T00:30:56.819 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-18T00:30:56.820 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-18T00:30:56.820 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/mclock-config/a 2026-02-18T00:30:56.820 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/mclock-config/a --run-dir=td/mclock-config 2026-02-18T00:30:56.840 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-18T00:30:56.840 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:30:56.840 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:30:56.840 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:30:56.841 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:30:56.841 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.7504 2026-02-18T00:30:56.841 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.7504/$cluster-$name.asok' 2026-02-18T00:30:56.841 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/mclock-config/a '--log-file=td/mclock-config/$name.log' '--admin-socket=/tmp/ceph-asok.7504/$cluster-$name.asok' --mon-cluster-log-file=td/mclock-config/log --run-dir=td/mclock-config '--pid-file=td/mclock-config/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-18T00:30:56.868 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-18T00:30:56.871 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-18T00:30:56.871 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T00:30:56.872 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-18T00:30:56.872 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-18T00:30:56.872 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-18T00:30:56.872 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-18T00:30:56.872 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:30:56.872 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:30:56.872 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:30:56.873 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:30:56.873 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.7504 2026-02-18T00:30:56.873 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.7504/ceph-mon.a.asok 2026-02-18T00:30:56.873 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T00:30:56.873 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.7504/ceph-mon.a.asok config get fsid 2026-02-18T00:30:56.926 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-18T00:30:56.926 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T00:30:56.926 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-18T00:30:56.926 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-18T00:30:56.926 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-18T00:30:56.926 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-18T00:30:56.926 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:30:56.926 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:30:56.927 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:30:56.928 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:30:56.928 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.7504 2026-02-18T00:30:56.928 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.7504/ceph-mon.a.asok 2026-02-18T00:30:56.928 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T00:30:56.928 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.7504/ceph-mon.a.asok config get mon_host 2026-02-18T00:30:56.980 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:42: TEST_profile_builtin_to_custom: run_mgr td/mclock-config x 2026-02-18T00:30:56.980 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/mclock-config 2026-02-18T00:30:56.981 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-18T00:30:56.981 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-18T00:30:56.981 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-18T00:30:56.981 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/mclock-config/x 2026-02-18T00:30:56.981 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-18T00:30:57.095 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-18T00:30:57.095 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:30:57.095 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:30:57.095 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:30:57.095 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:30:57.095 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.7504 2026-02-18T00:30:57.095 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.7504/$cluster-$name.asok' 2026-02-18T00:30:57.096 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-18T00:30:57.096 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/mclock-config/x '--log-file=td/mclock-config/$name.log' '--admin-socket=/tmp/ceph-asok.7504/$cluster-$name.asok' --run-dir=td/mclock-config '--pid-file=td/mclock-config/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-18T00:30:57.116 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:43: TEST_profile_builtin_to_custom: run_osd td/mclock-config 0 --osd_op_queue=mclock_scheduler 2026-02-18T00:30:57.116 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/mclock-config 2026-02-18T00:30:57.116 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T00:30:57.117 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-18T00:30:57.117 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T00:30:57.117 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/mclock-config/0 2026-02-18T00:30:57.117 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=96923420-254b-4639-a0f2-a5afc59a1de0 --auth-supported=none --mon-host=127.0.0.1:7124 --debug-mclock 20 ' 2026-02-18T00:30:57.117 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T00:30:57.117 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T00:30:57.117 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T00:30:57.117 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/mclock-config/0' 2026-02-18T00:30:57.118 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/mclock-config/0/journal' 2026-02-18T00:30:57.118 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T00:30:57.118 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-18T00:30:57.118 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/mclock-config' 2026-02-18T00:30:57.118 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T00:30:57.118 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:30:57.118 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:30:57.118 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:30:57.118 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:30:57.118 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.7504 2026-02-18T00:30:57.118 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.7504/$cluster-$name.asok' 2026-02-18T00:30:57.119 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.7504/$cluster-$name.asok' 2026-02-18T00:30:57.119 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T00:30:57.119 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T00:30:57.119 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T00:30:57.119 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/mclock-config/$name.log' 2026-02-18T00:30:57.119 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/mclock-config/$name.pid' 2026-02-18T00:30:57.119 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T00:30:57.119 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T00:30:57.119 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T00:30:57.119 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T00:30:57.119 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T00:30:57.119 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=--osd_op_queue=mclock_scheduler 2026-02-18T00:30:57.120 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/mclock-config/0 2026-02-18T00:30:57.120 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T00:30:57.120 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=3a1af7ec-2ae3-4c78-853c-5e06bb682c44 2026-02-18T00:30:57.120 INFO:tasks.workunit.client.0.trial069.stdout:add osd0 3a1af7ec-2ae3-4c78-853c-5e06bb682c44 2026-02-18T00:30:57.121 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 3a1af7ec-2ae3-4c78-853c-5e06bb682c44' 2026-02-18T00:30:57.121 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T00:30:57.127 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQBBCJVprudtBxAAW1rnf2huvKFPaJFqgt6Lrg== 2026-02-18T00:30:57.127 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQBBCJVprudtBxAAW1rnf2huvKFPaJFqgt6Lrg=="}' 2026-02-18T00:30:57.127 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 3a1af7ec-2ae3-4c78-853c-5e06bb682c44 -i td/mclock-config/0/new.json 2026-02-18T00:30:57.240 INFO:tasks.workunit.client.0.trial069.stdout:0 2026-02-18T00:30:57.248 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/mclock-config/0/new.json 2026-02-18T00:30:57.249 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=96923420-254b-4639-a0f2-a5afc59a1de0 --auth-supported=none --mon-host=127.0.0.1:7124 --debug-mclock 20 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/mclock-config/0 --osd-journal=td/mclock-config/0/journal --chdir= --run-dir=td/mclock-config '--admin-socket=/tmp/ceph-asok.7504/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/mclock-config/$name.log' '--pid-file=td/mclock-config/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_op_queue=mclock_scheduler --mkfs --key AQBBCJVprudtBxAAW1rnf2huvKFPaJFqgt6Lrg== --osd-uuid 3a1af7ec-2ae3-4c78-853c-5e06bb682c44 2026-02-18T00:30:57.266 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:30:57.261+0000 7f3135b82a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:30:57.268 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:30:57.261+0000 7f3135b82a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:30:57.269 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:30:57.261+0000 7f3135b82a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:30:57.269 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:30:57.261+0000 7f3135b82a40 -1 bdev(0x55d6d40cec00 td/mclock-config/0/block) open stat got: (1) Operation not permitted 2026-02-18T00:30:57.270 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:30:57.261+0000 7f3135b82a40 -1 bluestore(td/mclock-config/0) _read_fsid unparsable uuid 2026-02-18T00:30:58.041 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/mclock-config/0/keyring 2026-02-18T00:30:58.041 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T00:30:58.042 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-18T00:30:58.043 INFO:tasks.workunit.client.0.trial069.stdout:adding osd0 key to auth repository 2026-02-18T00:30:58.043 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/mclock-config/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T00:30:58.161 INFO:tasks.workunit.client.0.trial069.stdout:start osd.0 2026-02-18T00:30:58.163 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-18T00:30:58.163 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=96923420-254b-4639-a0f2-a5afc59a1de0 --auth-supported=none --mon-host=127.0.0.1:7124 --debug-mclock 20 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/mclock-config/0 --osd-journal=td/mclock-config/0/journal --chdir= --run-dir=td/mclock-config '--admin-socket=/tmp/ceph-asok.7504/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/mclock-config/$name.log' '--pid-file=td/mclock-config/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_op_queue=mclock_scheduler 2026-02-18T00:30:58.163 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T00:30:58.163 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T00:30:58.163 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T00:30:58.186 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:30:58.181+0000 7f54e32c1a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:30:58.189 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:30:58.181+0000 7f54e32c1a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:30:58.190 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:30:58.185+0000 7f54e32c1a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:30:58.269 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-18T00:30:58.269 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:30:58.269 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-18T00:30:58.269 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:30:58.270 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:30:58.270 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:30:58.270 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:30:58.270 INFO:tasks.workunit.client.0.trial069.stdout:0 2026-02-18T00:30:58.271 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:30:58.271 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T00:30:58.372 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:30:58.575 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:30:58.569+0000 7f54e32c1a40 -1 Falling back to public interface 2026-02-18T00:30:59.373 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:30:59.373 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:30:59.374 INFO:tasks.workunit.client.0.trial069.stdout:1 2026-02-18T00:30:59.374 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T00:30:59.374 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:30:59.374 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T00:30:59.482 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:30:59.575 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:30:59.569+0000 7f54e32c1a40 -1 osd.0 0 log_to_monitors true 2026-02-18T00:31:00.484 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:31:00.484 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:31:00.485 INFO:tasks.workunit.client.0.trial069.stdout:2 2026-02-18T00:31:00.485 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-18T00:31:00.485 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:31:00.485 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T00:31:00.695 INFO:tasks.workunit.client.0.trial069.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/3197312015,v1:127.0.0.1:6801/3197312015] [v2:127.0.0.1:6802/3197312015,v1:127.0.0.1:6803/3197312015] exists,up 3a1af7ec-2ae3-4c78-853c-5e06bb682c44 2026-02-18T00:31:00.696 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:31:00.696 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:31:00.696 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:31:00.696 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:46: TEST_profile_builtin_to_custom: ceph config get osd.0 osd_mclock_profile 2026-02-18T00:31:00.901 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:46: TEST_profile_builtin_to_custom: local mclock_profile=balanced 2026-02-18T00:31:00.901 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:47: TEST_profile_builtin_to_custom: test balanced = balanced 2026-02-18T00:31:00.902 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:52: TEST_profile_builtin_to_custom: jq .osd_mclock_profile 2026-02-18T00:31:00.902 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:52: TEST_profile_builtin_to_custom: get_asok_path osd.0 2026-02-18T00:31:00.902 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-18T00:31:00.902 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-18T00:31:00.903 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:31:00.904 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:31:00.904 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.7504 2026-02-18T00:31:00.904 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.7504/ceph-osd.0.asok 2026-02-18T00:31:00.904 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:52: TEST_profile_builtin_to_custom: CEPH_ARGS= 2026-02-18T00:31:00.904 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:52: TEST_profile_builtin_to_custom: ceph --format=json daemon /tmp/ceph-asok.7504/ceph-osd.0.asok config get osd_mclock_profile 2026-02-18T00:31:00.962 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:52: TEST_profile_builtin_to_custom: mclock_profile='"high_recovery_ops"' 2026-02-18T00:31:00.962 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:53: TEST_profile_builtin_to_custom: eval echo '"high_recovery_ops"' 2026-02-18T00:31:00.962 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:53: TEST_profile_builtin_to_custom: echo high_recovery_ops 2026-02-18T00:31:00.962 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:53: TEST_profile_builtin_to_custom: mclock_profile=high_recovery_ops 2026-02-18T00:31:00.962 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:54: TEST_profile_builtin_to_custom: test high_recovery_ops = high_recovery_ops 2026-02-18T00:31:00.962 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:57: TEST_profile_builtin_to_custom: ceph tell osd.0 config set osd_mclock_profile custom 2026-02-18T00:31:01.030 INFO:tasks.workunit.client.0.trial069.stdout:{ 2026-02-18T00:31:01.030 INFO:tasks.workunit.client.0.trial069.stdout: "success": "" 2026-02-18T00:31:01.030 INFO:tasks.workunit.client.0.trial069.stdout:} 2026-02-18T00:31:01.037 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:61: TEST_profile_builtin_to_custom: jq .osd_mclock_profile 2026-02-18T00:31:01.038 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:61: TEST_profile_builtin_to_custom: get_asok_path osd.0 2026-02-18T00:31:01.039 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-18T00:31:01.039 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-18T00:31:01.039 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:31:01.039 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:31:01.039 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.7504 2026-02-18T00:31:01.039 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.7504/ceph-osd.0.asok 2026-02-18T00:31:01.039 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:61: TEST_profile_builtin_to_custom: CEPH_ARGS= 2026-02-18T00:31:01.040 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:61: TEST_profile_builtin_to_custom: ceph --format=json daemon /tmp/ceph-asok.7504/ceph-osd.0.asok config get osd_mclock_profile 2026-02-18T00:31:01.100 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:61: TEST_profile_builtin_to_custom: mclock_profile='"custom"' 2026-02-18T00:31:01.101 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:62: TEST_profile_builtin_to_custom: eval echo '"custom"' 2026-02-18T00:31:01.101 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:62: TEST_profile_builtin_to_custom: echo custom 2026-02-18T00:31:01.101 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:62: TEST_profile_builtin_to_custom: mclock_profile=custom 2026-02-18T00:31:01.101 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:63: TEST_profile_builtin_to_custom: test custom = custom 2026-02-18T00:31:01.102 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:68: TEST_profile_builtin_to_custom: jq .osd_mclock_scheduler_client_res 2026-02-18T00:31:01.102 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:68: TEST_profile_builtin_to_custom: bc 2026-02-18T00:31:01.102 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:68: TEST_profile_builtin_to_custom: get_asok_path osd.0 2026-02-18T00:31:01.102 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-18T00:31:01.102 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-18T00:31:01.103 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:31:01.103 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:31:01.103 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.7504 2026-02-18T00:31:01.103 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.7504/ceph-osd.0.asok 2026-02-18T00:31:01.104 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:68: TEST_profile_builtin_to_custom: CEPH_ARGS= 2026-02-18T00:31:01.104 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:68: TEST_profile_builtin_to_custom: ceph --format=json daemon /tmp/ceph-asok.7504/ceph-osd.0.asok config get osd_mclock_scheduler_client_res 2026-02-18T00:31:01.162 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:68: TEST_profile_builtin_to_custom: local client_res=0.300000 2026-02-18T00:31:01.163 INFO:tasks.workunit.client.0.trial069.stdout:client_res = 0.300000 2026-02-18T00:31:01.163 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:69: TEST_profile_builtin_to_custom: echo 'client_res = 0.300000' 2026-02-18T00:31:01.163 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:70: TEST_profile_builtin_to_custom: echo '0.300000 + 0.1' 2026-02-18T00:31:01.163 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:70: TEST_profile_builtin_to_custom: bc -l 2026-02-18T00:31:01.164 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:70: TEST_profile_builtin_to_custom: local client_res_new=.400000 2026-02-18T00:31:01.164 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:71: TEST_profile_builtin_to_custom: echo 'client_res_new = .400000' 2026-02-18T00:31:01.165 INFO:tasks.workunit.client.0.trial069.stdout:client_res_new = .400000 2026-02-18T00:31:01.165 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:72: TEST_profile_builtin_to_custom: ceph config set osd.0 osd_mclock_scheduler_client_res .400000 2026-02-18T00:31:01.390 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:77: TEST_profile_builtin_to_custom: ceph config get osd.0 osd_mclock_scheduler_client_res 2026-02-18T00:31:01.601 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:77: TEST_profile_builtin_to_custom: local res=0.400000 2026-02-18T00:31:01.602 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:78: TEST_profile_builtin_to_custom: echo '0.400000 != .400000' 2026-02-18T00:31:01.602 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:78: TEST_profile_builtin_to_custom: bc -l 2026-02-18T00:31:01.603 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:78: TEST_profile_builtin_to_custom: (( 0 )) 2026-02-18T00:31:01.604 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:84: TEST_profile_builtin_to_custom: jq .osd_mclock_scheduler_client_res 2026-02-18T00:31:01.604 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:84: TEST_profile_builtin_to_custom: bc 2026-02-18T00:31:01.604 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:84: TEST_profile_builtin_to_custom: get_asok_path osd.0 2026-02-18T00:31:01.604 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-18T00:31:01.604 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-18T00:31:01.605 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:31:01.605 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:31:01.605 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.7504 2026-02-18T00:31:01.605 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.7504/ceph-osd.0.asok 2026-02-18T00:31:01.605 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:84: TEST_profile_builtin_to_custom: CEPH_ARGS= 2026-02-18T00:31:01.605 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:84: TEST_profile_builtin_to_custom: ceph --format=json daemon /tmp/ceph-asok.7504/ceph-osd.0.asok config get osd_mclock_scheduler_client_res 2026-02-18T00:31:01.664 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:84: TEST_profile_builtin_to_custom: res=0.400000 2026-02-18T00:31:01.665 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:85: TEST_profile_builtin_to_custom: echo '0.400000 != .400000' 2026-02-18T00:31:01.665 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:85: TEST_profile_builtin_to_custom: bc -l 2026-02-18T00:31:01.667 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:85: TEST_profile_builtin_to_custom: (( 0 )) 2026-02-18T00:31:01.667 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:89: TEST_profile_builtin_to_custom: teardown td/mclock-config 2026-02-18T00:31:01.667 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/mclock-config 2026-02-18T00:31:01.667 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T00:31:01.667 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/mclock-config KILL 2026-02-18T00:31:01.667 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:31:01.667 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:31:01.668 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:31:01.668 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:31:01.668 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:31:01.775 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:31:01.775 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T00:31:01.776 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T00:31:01.776 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T00:31:01.778 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T00:31:01.778 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T00:31:01.778 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T00:31:01.779 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:31:01.779 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T00:31:01.780 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T00:31:01.780 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:31:01.781 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T00:31:01.782 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T00:31:01.782 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/mclock-config 2026-02-18T00:31:01.787 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T00:31:01.787 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:31:01.787 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.7504 2026-02-18T00:31:01.787 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.7504 2026-02-18T00:31:01.788 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T00:31:01.788 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T00:31:01.788 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:34: run: teardown td/mclock-config 2026-02-18T00:31:01.788 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/mclock-config 2026-02-18T00:31:01.788 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T00:31:01.788 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/mclock-config KILL 2026-02-18T00:31:01.789 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:31:01.789 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:31:01.789 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:31:01.789 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:31:01.789 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:31:01.791 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:31:01.792 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T00:31:01.793 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T00:31:01.793 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T00:31:01.794 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T00:31:01.794 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T00:31:01.794 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T00:31:01.795 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:31:01.795 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T00:31:01.796 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T00:31:01.796 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:31:01.797 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T00:31:01.798 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T00:31:01.798 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/mclock-config 2026-02-18T00:31:01.799 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T00:31:01.800 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:31:01.800 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.7504 2026-02-18T00:31:01.800 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.7504 2026-02-18T00:31:01.801 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T00:31:01.801 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T00:31:01.801 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:31: run: for func in $funcs 2026-02-18T00:31:01.801 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:32: run: setup td/mclock-config 2026-02-18T00:31:01.801 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/mclock-config 2026-02-18T00:31:01.801 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/mclock-config 2026-02-18T00:31:01.801 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/mclock-config 2026-02-18T00:31:01.801 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T00:31:01.801 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/mclock-config KILL 2026-02-18T00:31:01.801 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:31:01.801 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:31:01.802 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:31:01.802 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:31:01.802 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:31:01.804 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:31:01.805 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T00:31:01.806 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T00:31:01.806 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T00:31:01.807 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T00:31:01.807 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T00:31:01.807 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T00:31:01.808 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:31:01.808 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T00:31:01.809 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T00:31:01.809 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:31:01.810 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T00:31:01.811 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T00:31:01.811 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/mclock-config 2026-02-18T00:31:01.812 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T00:31:01.812 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:31:01.812 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.7504 2026-02-18T00:31:01.812 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.7504 2026-02-18T00:31:01.813 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T00:31:01.813 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T00:31:01.813 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/mclock-config 2026-02-18T00:31:01.814 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-18T00:31:01.814 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:31:01.814 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.7504 2026-02-18T00:31:01.814 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.7504 2026-02-18T00:31:01.816 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-18T00:31:01.817 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-18T00:31:01.817 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-18T00:31:01.817 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/mclock-config 1' TERM HUP INT 2026-02-18T00:31:01.817 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:33: run: TEST_profile_custom_to_builtin td/mclock-config 2026-02-18T00:31:01.817 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:93: TEST_profile_custom_to_builtin: local dir=td/mclock-config 2026-02-18T00:31:01.817 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:95: TEST_profile_custom_to_builtin: setup td/mclock-config 2026-02-18T00:31:01.817 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/mclock-config 2026-02-18T00:31:01.817 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/mclock-config 2026-02-18T00:31:01.817 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/mclock-config 2026-02-18T00:31:01.817 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T00:31:01.817 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/mclock-config KILL 2026-02-18T00:31:01.817 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:31:01.817 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:31:01.818 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:31:01.818 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:31:01.818 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:31:01.820 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:31:01.820 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T00:31:01.821 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T00:31:01.821 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T00:31:01.823 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T00:31:01.823 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T00:31:01.823 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T00:31:01.824 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:31:01.824 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T00:31:01.824 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T00:31:01.824 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:31:01.825 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T00:31:01.826 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T00:31:01.826 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/mclock-config 2026-02-18T00:31:01.827 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T00:31:01.827 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:31:01.827 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.7504 2026-02-18T00:31:01.828 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.7504 2026-02-18T00:31:01.829 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T00:31:01.829 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T00:31:01.829 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/mclock-config 2026-02-18T00:31:01.830 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-18T00:31:01.830 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:31:01.830 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.7504 2026-02-18T00:31:01.830 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.7504 2026-02-18T00:31:01.832 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-18T00:31:01.833 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-18T00:31:01.833 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-18T00:31:01.833 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/mclock-config 1' TERM HUP INT 2026-02-18T00:31:01.833 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:96: TEST_profile_custom_to_builtin: run_mon td/mclock-config a 2026-02-18T00:31:01.833 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/mclock-config 2026-02-18T00:31:01.833 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-18T00:31:01.833 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-18T00:31:01.833 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-18T00:31:01.833 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/mclock-config/a 2026-02-18T00:31:01.833 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/mclock-config/a --run-dir=td/mclock-config 2026-02-18T00:31:01.854 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-18T00:31:01.854 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:31:01.854 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:31:01.854 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:31:01.854 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:31:01.854 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.7504 2026-02-18T00:31:01.854 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.7504/$cluster-$name.asok' 2026-02-18T00:31:01.855 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/mclock-config/a '--log-file=td/mclock-config/$name.log' '--admin-socket=/tmp/ceph-asok.7504/$cluster-$name.asok' --mon-cluster-log-file=td/mclock-config/log --run-dir=td/mclock-config '--pid-file=td/mclock-config/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-18T00:31:01.884 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-18T00:31:01.886 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-18T00:31:01.886 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T00:31:01.886 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-18T00:31:01.886 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-18T00:31:01.886 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-18T00:31:01.886 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-18T00:31:01.886 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:31:01.886 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:31:01.887 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:31:01.887 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:31:01.887 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.7504 2026-02-18T00:31:01.887 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.7504/ceph-mon.a.asok 2026-02-18T00:31:01.887 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T00:31:01.888 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.7504/ceph-mon.a.asok config get fsid 2026-02-18T00:31:01.940 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-18T00:31:01.941 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T00:31:01.941 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-18T00:31:01.941 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-18T00:31:01.941 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-18T00:31:01.941 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-18T00:31:01.941 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:31:01.941 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:31:01.941 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:31:01.941 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:31:01.942 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.7504 2026-02-18T00:31:01.942 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.7504/ceph-mon.a.asok 2026-02-18T00:31:01.942 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T00:31:01.942 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.7504/ceph-mon.a.asok config get mon_host 2026-02-18T00:31:01.995 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:97: TEST_profile_custom_to_builtin: run_mgr td/mclock-config x 2026-02-18T00:31:01.995 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/mclock-config 2026-02-18T00:31:01.995 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-18T00:31:01.995 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-18T00:31:01.995 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-18T00:31:01.995 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/mclock-config/x 2026-02-18T00:31:01.995 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-18T00:31:02.103 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-18T00:31:02.104 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:31:02.104 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:31:02.104 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:31:02.104 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:31:02.104 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.7504 2026-02-18T00:31:02.104 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.7504/$cluster-$name.asok' 2026-02-18T00:31:02.105 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-18T00:31:02.105 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/mclock-config/x '--log-file=td/mclock-config/$name.log' '--admin-socket=/tmp/ceph-asok.7504/$cluster-$name.asok' --run-dir=td/mclock-config '--pid-file=td/mclock-config/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-18T00:31:02.124 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:98: TEST_profile_custom_to_builtin: run_osd td/mclock-config 0 --osd_op_queue=mclock_scheduler 2026-02-18T00:31:02.124 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/mclock-config 2026-02-18T00:31:02.124 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T00:31:02.124 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-18T00:31:02.124 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T00:31:02.124 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/mclock-config/0 2026-02-18T00:31:02.124 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=96923420-254b-4639-a0f2-a5afc59a1de0 --auth-supported=none --mon-host=127.0.0.1:7124 --debug-mclock 20 ' 2026-02-18T00:31:02.124 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T00:31:02.124 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T00:31:02.124 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T00:31:02.124 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/mclock-config/0' 2026-02-18T00:31:02.124 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/mclock-config/0/journal' 2026-02-18T00:31:02.124 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T00:31:02.124 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-18T00:31:02.124 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/mclock-config' 2026-02-18T00:31:02.124 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T00:31:02.124 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:31:02.124 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:31:02.124 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:31:02.124 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:31:02.124 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.7504 2026-02-18T00:31:02.124 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.7504/$cluster-$name.asok' 2026-02-18T00:31:02.124 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.7504/$cluster-$name.asok' 2026-02-18T00:31:02.124 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T00:31:02.124 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T00:31:02.124 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T00:31:02.124 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/mclock-config/$name.log' 2026-02-18T00:31:02.124 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/mclock-config/$name.pid' 2026-02-18T00:31:02.124 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T00:31:02.125 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T00:31:02.125 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T00:31:02.125 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T00:31:02.125 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T00:31:02.125 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=--osd_op_queue=mclock_scheduler 2026-02-18T00:31:02.125 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/mclock-config/0 2026-02-18T00:31:02.125 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T00:31:02.126 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=476b29c7-6122-47ae-9b81-3ef6622d5808 2026-02-18T00:31:02.126 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 476b29c7-6122-47ae-9b81-3ef6622d5808' 2026-02-18T00:31:02.126 INFO:tasks.workunit.client.0.trial069.stdout:add osd0 476b29c7-6122-47ae-9b81-3ef6622d5808 2026-02-18T00:31:02.126 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T00:31:02.137 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQBGCJVpBJYJCBAArUnBxoRfzEQqNtdrhaVTcg== 2026-02-18T00:31:02.137 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQBGCJVpBJYJCBAArUnBxoRfzEQqNtdrhaVTcg=="}' 2026-02-18T00:31:02.137 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 476b29c7-6122-47ae-9b81-3ef6622d5808 -i td/mclock-config/0/new.json 2026-02-18T00:31:02.251 INFO:tasks.workunit.client.0.trial069.stdout:0 2026-02-18T00:31:02.259 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/mclock-config/0/new.json 2026-02-18T00:31:02.260 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=96923420-254b-4639-a0f2-a5afc59a1de0 --auth-supported=none --mon-host=127.0.0.1:7124 --debug-mclock 20 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/mclock-config/0 --osd-journal=td/mclock-config/0/journal --chdir= --run-dir=td/mclock-config '--admin-socket=/tmp/ceph-asok.7504/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/mclock-config/$name.log' '--pid-file=td/mclock-config/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_op_queue=mclock_scheduler --mkfs --key AQBGCJVpBJYJCBAArUnBxoRfzEQqNtdrhaVTcg== --osd-uuid 476b29c7-6122-47ae-9b81-3ef6622d5808 2026-02-18T00:31:02.275 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:31:02.269+0000 7f8ce290ea40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:31:02.277 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:31:02.269+0000 7f8ce290ea40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:31:02.277 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:31:02.269+0000 7f8ce290ea40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:31:02.278 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:31:02.273+0000 7f8ce290ea40 -1 bdev(0x5632762cec00 td/mclock-config/0/block) open stat got: (1) Operation not permitted 2026-02-18T00:31:02.278 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:31:02.273+0000 7f8ce290ea40 -1 bluestore(td/mclock-config/0) _read_fsid unparsable uuid 2026-02-18T00:31:02.985 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/mclock-config/0/keyring 2026-02-18T00:31:02.985 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T00:31:02.987 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-18T00:31:02.987 INFO:tasks.workunit.client.0.trial069.stdout:adding osd0 key to auth repository 2026-02-18T00:31:02.987 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/mclock-config/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T00:31:03.106 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-18T00:31:03.106 INFO:tasks.workunit.client.0.trial069.stdout:start osd.0 2026-02-18T00:31:03.106 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=96923420-254b-4639-a0f2-a5afc59a1de0 --auth-supported=none --mon-host=127.0.0.1:7124 --debug-mclock 20 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/mclock-config/0 --osd-journal=td/mclock-config/0/journal --chdir= --run-dir=td/mclock-config '--admin-socket=/tmp/ceph-asok.7504/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/mclock-config/$name.log' '--pid-file=td/mclock-config/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_op_queue=mclock_scheduler 2026-02-18T00:31:03.106 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T00:31:03.107 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T00:31:03.107 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T00:31:03.128 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:31:03.121+0000 7fc8dcd22a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:31:03.130 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:31:03.125+0000 7fc8dcd22a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:31:03.132 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:31:03.125+0000 7fc8dcd22a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:31:03.213 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-18T00:31:03.214 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:31:03.214 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-18T00:31:03.214 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:31:03.214 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:31:03.214 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:31:03.215 INFO:tasks.workunit.client.0.trial069.stdout:0 2026-02-18T00:31:03.215 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:31:03.215 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:31:03.215 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T00:31:03.319 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:31:03.671 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:31:03.665+0000 7fc8dcd22a40 -1 Falling back to public interface 2026-02-18T00:31:04.320 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:31:04.321 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:31:04.321 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T00:31:04.321 INFO:tasks.workunit.client.0.trial069.stdout:1 2026-02-18T00:31:04.322 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:31:04.322 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T00:31:04.427 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:31:04.528 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:31:04.521+0000 7fc8dcd22a40 -1 osd.0 0 log_to_monitors true 2026-02-18T00:31:05.428 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:31:05.428 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:31:05.429 INFO:tasks.workunit.client.0.trial069.stdout:2 2026-02-18T00:31:05.429 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-18T00:31:05.429 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:31:05.429 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T00:31:05.634 INFO:tasks.workunit.client.0.trial069.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/2300870431,v1:127.0.0.1:6801/2300870431] [v2:127.0.0.1:6802/2300870431,v1:127.0.0.1:6803/2300870431] exists,up 476b29c7-6122-47ae-9b81-3ef6622d5808 2026-02-18T00:31:05.635 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:31:05.635 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:31:05.635 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:31:05.635 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:101: TEST_profile_custom_to_builtin: local def_mclock_profile 2026-02-18T00:31:05.635 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:102: TEST_profile_custom_to_builtin: ceph config get osd.0 osd_mclock_profile 2026-02-18T00:31:05.846 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:102: TEST_profile_custom_to_builtin: def_mclock_profile=balanced 2026-02-18T00:31:05.847 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:103: TEST_profile_custom_to_builtin: test balanced = balanced 2026-02-18T00:31:05.849 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:108: TEST_profile_custom_to_builtin: jq .osd_mclock_profile 2026-02-18T00:31:05.849 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:108: TEST_profile_custom_to_builtin: get_asok_path osd.0 2026-02-18T00:31:05.849 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-18T00:31:05.849 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-18T00:31:05.850 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:31:05.850 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:31:05.850 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.7504 2026-02-18T00:31:05.850 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.7504/ceph-osd.0.asok 2026-02-18T00:31:05.850 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:108: TEST_profile_custom_to_builtin: CEPH_ARGS= 2026-02-18T00:31:05.850 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:108: TEST_profile_custom_to_builtin: ceph --format=json daemon /tmp/ceph-asok.7504/ceph-osd.0.asok config get osd_mclock_profile 2026-02-18T00:31:05.908 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:108: TEST_profile_custom_to_builtin: local 'orig_mclock_profile="high_recovery_ops"' 2026-02-18T00:31:05.909 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:109: TEST_profile_custom_to_builtin: eval echo '"high_recovery_ops"' 2026-02-18T00:31:05.909 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:109: TEST_profile_custom_to_builtin: echo high_recovery_ops 2026-02-18T00:31:05.909 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:109: TEST_profile_custom_to_builtin: orig_mclock_profile=high_recovery_ops 2026-02-18T00:31:05.910 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:110: TEST_profile_custom_to_builtin: test high_recovery_ops = high_recovery_ops 2026-02-18T00:31:05.910 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:113: TEST_profile_custom_to_builtin: ceph tell osd.0 config set osd_mclock_profile custom 2026-02-18T00:31:05.976 INFO:tasks.workunit.client.0.trial069.stdout:{ 2026-02-18T00:31:05.976 INFO:tasks.workunit.client.0.trial069.stdout: "success": "" 2026-02-18T00:31:05.976 INFO:tasks.workunit.client.0.trial069.stdout:} 2026-02-18T00:31:05.984 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:118: TEST_profile_custom_to_builtin: jq .osd_mclock_profile 2026-02-18T00:31:05.985 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:118: TEST_profile_custom_to_builtin: get_asok_path osd.0 2026-02-18T00:31:05.985 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-18T00:31:05.985 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-18T00:31:05.985 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:31:05.985 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:31:05.986 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.7504 2026-02-18T00:31:05.986 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.7504/ceph-osd.0.asok 2026-02-18T00:31:05.986 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:118: TEST_profile_custom_to_builtin: CEPH_ARGS= 2026-02-18T00:31:05.986 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:118: TEST_profile_custom_to_builtin: ceph --format=json daemon /tmp/ceph-asok.7504/ceph-osd.0.asok config get osd_mclock_profile 2026-02-18T00:31:06.044 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:118: TEST_profile_custom_to_builtin: local 'mclock_profile="custom"' 2026-02-18T00:31:06.045 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:119: TEST_profile_custom_to_builtin: eval echo '"custom"' 2026-02-18T00:31:06.045 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:119: TEST_profile_custom_to_builtin: echo custom 2026-02-18T00:31:06.045 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:119: TEST_profile_custom_to_builtin: mclock_profile=custom 2026-02-18T00:31:06.045 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:120: TEST_profile_custom_to_builtin: test custom = custom 2026-02-18T00:31:06.045 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:123: TEST_profile_custom_to_builtin: local client_res 2026-02-18T00:31:06.046 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:126: TEST_profile_custom_to_builtin: jq .osd_mclock_scheduler_client_res 2026-02-18T00:31:06.046 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:126: TEST_profile_custom_to_builtin: bc 2026-02-18T00:31:06.047 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:126: TEST_profile_custom_to_builtin: get_asok_path osd.0 2026-02-18T00:31:06.047 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-18T00:31:06.047 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-18T00:31:06.047 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:31:06.047 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:31:06.047 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.7504 2026-02-18T00:31:06.047 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.7504/ceph-osd.0.asok 2026-02-18T00:31:06.047 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:126: TEST_profile_custom_to_builtin: CEPH_ARGS= 2026-02-18T00:31:06.047 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:126: TEST_profile_custom_to_builtin: ceph --format=json daemon /tmp/ceph-asok.7504/ceph-osd.0.asok config get osd_mclock_scheduler_client_res 2026-02-18T00:31:06.107 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:126: TEST_profile_custom_to_builtin: client_res=0.300000 2026-02-18T00:31:06.107 INFO:tasks.workunit.client.0.trial069.stdout:Original client_res for osd.0 = 0.300000 2026-02-18T00:31:06.108 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:127: TEST_profile_custom_to_builtin: echo 'Original client_res for osd.0 = 0.300000' 2026-02-18T00:31:06.108 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:130: TEST_profile_custom_to_builtin: echo '0.300000 + 0.1' 2026-02-18T00:31:06.108 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:130: TEST_profile_custom_to_builtin: bc -l 2026-02-18T00:31:06.109 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:130: TEST_profile_custom_to_builtin: local client_res_new=.400000 2026-02-18T00:31:06.109 INFO:tasks.workunit.client.0.trial069.stdout:client_res_new = .400000 2026-02-18T00:31:06.109 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:131: TEST_profile_custom_to_builtin: echo 'client_res_new = .400000' 2026-02-18T00:31:06.110 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:132: TEST_profile_custom_to_builtin: ceph config set osd osd_mclock_scheduler_client_res .400000 2026-02-18T00:31:06.329 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:136: TEST_profile_custom_to_builtin: ceph config get osd.0 osd_mclock_scheduler_client_res 2026-02-18T00:31:06.557 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:136: TEST_profile_custom_to_builtin: local res=0.400000 2026-02-18T00:31:06.557 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:137: TEST_profile_custom_to_builtin: echo '0.400000 != .400000' 2026-02-18T00:31:06.558 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:137: TEST_profile_custom_to_builtin: bc -l 2026-02-18T00:31:06.559 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:137: TEST_profile_custom_to_builtin: (( 0 )) 2026-02-18T00:31:06.560 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:143: TEST_profile_custom_to_builtin: jq .osd_mclock_scheduler_client_res 2026-02-18T00:31:06.560 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:143: TEST_profile_custom_to_builtin: bc 2026-02-18T00:31:06.560 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:143: TEST_profile_custom_to_builtin: get_asok_path osd.0 2026-02-18T00:31:06.560 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-18T00:31:06.561 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-18T00:31:06.561 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:31:06.561 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:31:06.561 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.7504 2026-02-18T00:31:06.561 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.7504/ceph-osd.0.asok 2026-02-18T00:31:06.561 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:143: TEST_profile_custom_to_builtin: CEPH_ARGS= 2026-02-18T00:31:06.562 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:143: TEST_profile_custom_to_builtin: ceph --format=json daemon /tmp/ceph-asok.7504/ceph-osd.0.asok config get osd_mclock_scheduler_client_res 2026-02-18T00:31:06.620 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:143: TEST_profile_custom_to_builtin: res=0.400000 2026-02-18T00:31:06.621 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:144: TEST_profile_custom_to_builtin: echo '0.400000 != .400000' 2026-02-18T00:31:06.621 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:144: TEST_profile_custom_to_builtin: bc -l 2026-02-18T00:31:06.622 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:144: TEST_profile_custom_to_builtin: (( 0 )) 2026-02-18T00:31:06.622 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:154: TEST_profile_custom_to_builtin: ceph tell osd.0 config set osd_mclock_profile high_recovery_ops 2026-02-18T00:31:06.696 INFO:tasks.workunit.client.0.trial069.stdout:{ 2026-02-18T00:31:06.696 INFO:tasks.workunit.client.0.trial069.stdout: "success": "" 2026-02-18T00:31:06.696 INFO:tasks.workunit.client.0.trial069.stdout:} 2026-02-18T00:31:06.703 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:158: TEST_profile_custom_to_builtin: jq .osd_mclock_profile 2026-02-18T00:31:06.705 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:158: TEST_profile_custom_to_builtin: get_asok_path osd.0 2026-02-18T00:31:06.705 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-18T00:31:06.705 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-18T00:31:06.705 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:31:06.705 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:31:06.705 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.7504 2026-02-18T00:31:06.705 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.7504/ceph-osd.0.asok 2026-02-18T00:31:06.705 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:158: TEST_profile_custom_to_builtin: CEPH_ARGS= 2026-02-18T00:31:06.705 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:158: TEST_profile_custom_to_builtin: ceph --format=json daemon /tmp/ceph-asok.7504/ceph-osd.0.asok config get osd_mclock_profile 2026-02-18T00:31:06.763 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:158: TEST_profile_custom_to_builtin: eval 'mclock_profile="high_recovery_ops"' 2026-02-18T00:31:06.763 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:158: TEST_profile_custom_to_builtin: mclock_profile=high_recovery_ops 2026-02-18T00:31:06.763 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:160: TEST_profile_custom_to_builtin: test high_recovery_ops = high_recovery_ops 2026-02-18T00:31:06.763 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:165: TEST_profile_custom_to_builtin: ceph config get osd.0 osd_mclock_scheduler_client_res 2026-02-18T00:31:06.980 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:165: TEST_profile_custom_to_builtin: local res=0.400000 2026-02-18T00:31:06.981 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:166: TEST_profile_custom_to_builtin: echo '0.400000 != .400000' 2026-02-18T00:31:06.981 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:166: TEST_profile_custom_to_builtin: bc -l 2026-02-18T00:31:06.983 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:166: TEST_profile_custom_to_builtin: (( 0 )) 2026-02-18T00:31:06.984 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:172: TEST_profile_custom_to_builtin: jq .osd_mclock_scheduler_client_res 2026-02-18T00:31:06.984 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:172: TEST_profile_custom_to_builtin: bc 2026-02-18T00:31:06.984 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:172: TEST_profile_custom_to_builtin: get_asok_path osd.0 2026-02-18T00:31:06.985 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-18T00:31:06.985 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-18T00:31:06.985 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:31:06.985 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:31:06.985 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.7504 2026-02-18T00:31:06.985 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.7504/ceph-osd.0.asok 2026-02-18T00:31:06.985 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:172: TEST_profile_custom_to_builtin: CEPH_ARGS= 2026-02-18T00:31:06.985 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:172: TEST_profile_custom_to_builtin: ceph --format=json daemon /tmp/ceph-asok.7504/ceph-osd.0.asok config get osd_mclock_scheduler_client_res 2026-02-18T00:31:07.043 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:172: TEST_profile_custom_to_builtin: res=0.400000 2026-02-18T00:31:07.044 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:173: TEST_profile_custom_to_builtin: echo '0.400000 != .400000' 2026-02-18T00:31:07.044 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:173: TEST_profile_custom_to_builtin: bc -l 2026-02-18T00:31:07.045 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:173: TEST_profile_custom_to_builtin: (( 0 )) 2026-02-18T00:31:07.045 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:178: TEST_profile_custom_to_builtin: ceph config rm osd osd_mclock_scheduler_client_res 2026-02-18T00:31:07.267 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:180: TEST_profile_custom_to_builtin: sleep 5 2026-02-18T00:31:12.269 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:185: TEST_profile_custom_to_builtin: ceph config get osd.0 osd_mclock_scheduler_client_res 2026-02-18T00:31:12.479 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:185: TEST_profile_custom_to_builtin: res=0.000000 2026-02-18T00:31:12.480 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:186: TEST_profile_custom_to_builtin: echo '0.000000 != 0.0' 2026-02-18T00:31:12.480 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:186: TEST_profile_custom_to_builtin: bc -l 2026-02-18T00:31:12.481 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:186: TEST_profile_custom_to_builtin: (( 0 )) 2026-02-18T00:31:12.482 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:193: TEST_profile_custom_to_builtin: jq .osd_mclock_scheduler_client_res 2026-02-18T00:31:12.482 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:193: TEST_profile_custom_to_builtin: bc 2026-02-18T00:31:12.483 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:193: TEST_profile_custom_to_builtin: get_asok_path osd.0 2026-02-18T00:31:12.483 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-18T00:31:12.483 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-18T00:31:12.484 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:31:12.484 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:31:12.484 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.7504 2026-02-18T00:31:12.484 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.7504/ceph-osd.0.asok 2026-02-18T00:31:12.484 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:193: TEST_profile_custom_to_builtin: CEPH_ARGS= 2026-02-18T00:31:12.484 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:193: TEST_profile_custom_to_builtin: ceph --format=json daemon /tmp/ceph-asok.7504/ceph-osd.0.asok config get osd_mclock_scheduler_client_res 2026-02-18T00:31:12.543 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:193: TEST_profile_custom_to_builtin: res=0.300000 2026-02-18T00:31:12.543 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:194: TEST_profile_custom_to_builtin: echo '0.300000 != 0.300000' 2026-02-18T00:31:12.543 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:194: TEST_profile_custom_to_builtin: bc -l 2026-02-18T00:31:12.545 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:194: TEST_profile_custom_to_builtin: (( 0 )) 2026-02-18T00:31:12.546 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:198: TEST_profile_custom_to_builtin: teardown td/mclock-config 2026-02-18T00:31:12.546 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/mclock-config 2026-02-18T00:31:12.546 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T00:31:12.546 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/mclock-config KILL 2026-02-18T00:31:12.546 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:31:12.546 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:31:12.546 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:31:12.546 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:31:12.546 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:31:12.653 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:31:12.654 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T00:31:12.654 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T00:31:12.655 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T00:31:12.656 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T00:31:12.656 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T00:31:12.657 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T00:31:12.658 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:31:12.658 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T00:31:12.658 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T00:31:12.659 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:31:12.659 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T00:31:12.660 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T00:31:12.661 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/mclock-config 2026-02-18T00:31:12.665 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T00:31:12.665 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:31:12.666 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.7504 2026-02-18T00:31:12.666 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.7504 2026-02-18T00:31:12.667 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T00:31:12.668 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T00:31:12.668 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:34: run: teardown td/mclock-config 2026-02-18T00:31:12.668 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/mclock-config 2026-02-18T00:31:12.668 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T00:31:12.668 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/mclock-config KILL 2026-02-18T00:31:12.668 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:31:12.668 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:31:12.668 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:31:12.668 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:31:12.668 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:31:12.670 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:31:12.671 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T00:31:12.671 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T00:31:12.672 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T00:31:12.673 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T00:31:12.673 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T00:31:12.673 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T00:31:12.674 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:31:12.675 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T00:31:12.675 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T00:31:12.675 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:31:12.676 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T00:31:12.677 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T00:31:12.677 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/mclock-config 2026-02-18T00:31:12.678 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T00:31:12.679 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:31:12.679 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.7504 2026-02-18T00:31:12.679 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.7504 2026-02-18T00:31:12.681 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T00:31:12.681 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T00:31:12.681 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:31: run: for func in $funcs 2026-02-18T00:31:12.681 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:32: run: setup td/mclock-config 2026-02-18T00:31:12.681 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/mclock-config 2026-02-18T00:31:12.681 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/mclock-config 2026-02-18T00:31:12.681 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/mclock-config 2026-02-18T00:31:12.681 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T00:31:12.681 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/mclock-config KILL 2026-02-18T00:31:12.682 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:31:12.682 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:31:12.682 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:31:12.682 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:31:12.682 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:31:12.683 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:31:12.683 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T00:31:12.684 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T00:31:12.684 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T00:31:12.686 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T00:31:12.686 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T00:31:12.686 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T00:31:12.687 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:31:12.688 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T00:31:12.688 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T00:31:12.688 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:31:12.689 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T00:31:12.690 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T00:31:12.691 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/mclock-config 2026-02-18T00:31:12.692 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T00:31:12.692 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:31:12.692 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.7504 2026-02-18T00:31:12.692 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.7504 2026-02-18T00:31:12.693 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T00:31:12.693 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T00:31:12.693 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/mclock-config 2026-02-18T00:31:12.695 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-18T00:31:12.695 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:31:12.695 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.7504 2026-02-18T00:31:12.695 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.7504 2026-02-18T00:31:12.696 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-18T00:31:12.699 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-18T00:31:12.699 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-18T00:31:12.699 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/mclock-config 1' TERM HUP INT 2026-02-18T00:31:12.699 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:33: run: TEST_profile_disallow_builtin_params_modify td/mclock-config 2026-02-18T00:31:12.700 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:305: TEST_profile_disallow_builtin_params_modify: local dir=td/mclock-config 2026-02-18T00:31:12.700 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:307: TEST_profile_disallow_builtin_params_modify: setup td/mclock-config 2026-02-18T00:31:12.700 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/mclock-config 2026-02-18T00:31:12.700 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/mclock-config 2026-02-18T00:31:12.700 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/mclock-config 2026-02-18T00:31:12.700 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T00:31:12.700 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/mclock-config KILL 2026-02-18T00:31:12.700 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:31:12.700 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:31:12.700 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:31:12.700 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:31:12.701 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:31:12.701 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:31:12.701 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T00:31:12.701 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T00:31:12.702 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T00:31:12.703 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T00:31:12.703 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T00:31:12.703 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T00:31:12.704 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:31:12.704 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T00:31:12.705 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T00:31:12.705 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:31:12.706 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T00:31:12.707 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T00:31:12.707 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/mclock-config 2026-02-18T00:31:12.708 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T00:31:12.709 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:31:12.709 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.7504 2026-02-18T00:31:12.709 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.7504 2026-02-18T00:31:12.709 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T00:31:12.710 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T00:31:12.710 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/mclock-config 2026-02-18T00:31:12.711 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-18T00:31:12.711 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:31:12.711 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.7504 2026-02-18T00:31:12.711 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.7504 2026-02-18T00:31:12.712 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-18T00:31:12.713 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-18T00:31:12.714 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-18T00:31:12.714 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/mclock-config 1' TERM HUP INT 2026-02-18T00:31:12.714 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:308: TEST_profile_disallow_builtin_params_modify: run_mon td/mclock-config a 2026-02-18T00:31:12.714 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/mclock-config 2026-02-18T00:31:12.714 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-18T00:31:12.714 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-18T00:31:12.714 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-18T00:31:12.714 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/mclock-config/a 2026-02-18T00:31:12.714 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/mclock-config/a --run-dir=td/mclock-config 2026-02-18T00:31:12.734 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-18T00:31:12.734 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:31:12.734 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:31:12.734 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:31:12.734 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:31:12.734 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.7504 2026-02-18T00:31:12.735 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.7504/$cluster-$name.asok' 2026-02-18T00:31:12.735 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/mclock-config/a '--log-file=td/mclock-config/$name.log' '--admin-socket=/tmp/ceph-asok.7504/$cluster-$name.asok' --mon-cluster-log-file=td/mclock-config/log --run-dir=td/mclock-config '--pid-file=td/mclock-config/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-18T00:31:12.765 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-18T00:31:12.766 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-18T00:31:12.766 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T00:31:12.766 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-18T00:31:12.766 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-18T00:31:12.766 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-18T00:31:12.767 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-18T00:31:12.767 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:31:12.767 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:31:12.768 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:31:12.768 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:31:12.768 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.7504 2026-02-18T00:31:12.768 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.7504/ceph-mon.a.asok 2026-02-18T00:31:12.768 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T00:31:12.768 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.7504/ceph-mon.a.asok config get fsid 2026-02-18T00:31:12.823 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-18T00:31:12.823 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T00:31:12.823 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-18T00:31:12.823 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-18T00:31:12.824 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-18T00:31:12.825 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-18T00:31:12.825 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:31:12.825 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:31:12.825 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:31:12.825 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:31:12.825 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.7504 2026-02-18T00:31:12.825 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.7504/ceph-mon.a.asok 2026-02-18T00:31:12.825 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T00:31:12.826 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.7504/ceph-mon.a.asok config get mon_host 2026-02-18T00:31:12.880 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:309: TEST_profile_disallow_builtin_params_modify: run_mgr td/mclock-config x 2026-02-18T00:31:12.880 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/mclock-config 2026-02-18T00:31:12.881 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-18T00:31:12.881 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-18T00:31:12.881 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-18T00:31:12.881 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/mclock-config/x 2026-02-18T00:31:12.881 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-18T00:31:12.993 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-18T00:31:12.994 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:31:12.994 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:31:12.994 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:31:12.994 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:31:12.994 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.7504 2026-02-18T00:31:12.994 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.7504/$cluster-$name.asok' 2026-02-18T00:31:12.995 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-18T00:31:12.995 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/mclock-config/x '--log-file=td/mclock-config/$name.log' '--admin-socket=/tmp/ceph-asok.7504/$cluster-$name.asok' --run-dir=td/mclock-config '--pid-file=td/mclock-config/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-18T00:31:13.015 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:311: TEST_profile_disallow_builtin_params_modify: run_osd td/mclock-config 0 --osd_op_queue=mclock_scheduler 2026-02-18T00:31:13.016 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/mclock-config 2026-02-18T00:31:13.016 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T00:31:13.016 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-18T00:31:13.016 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T00:31:13.016 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/mclock-config/0 2026-02-18T00:31:13.016 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=96923420-254b-4639-a0f2-a5afc59a1de0 --auth-supported=none --mon-host=127.0.0.1:7124 --debug-mclock 20 ' 2026-02-18T00:31:13.016 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T00:31:13.016 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T00:31:13.016 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T00:31:13.016 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/mclock-config/0' 2026-02-18T00:31:13.017 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/mclock-config/0/journal' 2026-02-18T00:31:13.017 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T00:31:13.017 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-18T00:31:13.017 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/mclock-config' 2026-02-18T00:31:13.017 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T00:31:13.017 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:31:13.017 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:31:13.017 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:31:13.017 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:31:13.017 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.7504 2026-02-18T00:31:13.017 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.7504/$cluster-$name.asok' 2026-02-18T00:31:13.017 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.7504/$cluster-$name.asok' 2026-02-18T00:31:13.017 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T00:31:13.018 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T00:31:13.018 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T00:31:13.018 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/mclock-config/$name.log' 2026-02-18T00:31:13.018 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/mclock-config/$name.pid' 2026-02-18T00:31:13.018 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T00:31:13.018 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T00:31:13.018 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T00:31:13.018 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T00:31:13.018 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T00:31:13.018 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=--osd_op_queue=mclock_scheduler 2026-02-18T00:31:13.018 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/mclock-config/0 2026-02-18T00:31:13.018 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T00:31:13.019 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=87bbab18-75cd-40a7-a48b-73415381df1e 2026-02-18T00:31:13.019 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 87bbab18-75cd-40a7-a48b-73415381df1e' 2026-02-18T00:31:13.019 INFO:tasks.workunit.client.0.trial069.stdout:add osd0 87bbab18-75cd-40a7-a48b-73415381df1e 2026-02-18T00:31:13.020 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T00:31:13.028 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQBRCJVpdGN7ARAAPhTxtLejytt9jSNV7CZ19w== 2026-02-18T00:31:13.028 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQBRCJVpdGN7ARAAPhTxtLejytt9jSNV7CZ19w=="}' 2026-02-18T00:31:13.028 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 87bbab18-75cd-40a7-a48b-73415381df1e -i td/mclock-config/0/new.json 2026-02-18T00:31:13.137 INFO:tasks.workunit.client.0.trial069.stdout:0 2026-02-18T00:31:13.146 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/mclock-config/0/new.json 2026-02-18T00:31:13.147 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=96923420-254b-4639-a0f2-a5afc59a1de0 --auth-supported=none --mon-host=127.0.0.1:7124 --debug-mclock 20 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/mclock-config/0 --osd-journal=td/mclock-config/0/journal --chdir= --run-dir=td/mclock-config '--admin-socket=/tmp/ceph-asok.7504/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/mclock-config/$name.log' '--pid-file=td/mclock-config/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_op_queue=mclock_scheduler --mkfs --key AQBRCJVpdGN7ARAAPhTxtLejytt9jSNV7CZ19w== --osd-uuid 87bbab18-75cd-40a7-a48b-73415381df1e 2026-02-18T00:31:13.162 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:31:13.156+0000 7fe811748a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:31:13.164 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:31:13.156+0000 7fe811748a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:31:13.165 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:31:13.156+0000 7fe811748a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:31:13.166 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:31:13.156+0000 7fe811748a40 -1 bdev(0x55f84a69ac00 td/mclock-config/0/block) open stat got: (1) Operation not permitted 2026-02-18T00:31:13.166 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:31:13.156+0000 7fe811748a40 -1 bluestore(td/mclock-config/0) _read_fsid unparsable uuid 2026-02-18T00:31:13.878 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/mclock-config/0/keyring 2026-02-18T00:31:13.878 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T00:31:13.879 INFO:tasks.workunit.client.0.trial069.stdout:adding osd0 key to auth repository 2026-02-18T00:31:13.880 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-18T00:31:13.880 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/mclock-config/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T00:31:14.000 INFO:tasks.workunit.client.0.trial069.stdout:start osd.0 2026-02-18T00:31:14.001 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-18T00:31:14.001 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=96923420-254b-4639-a0f2-a5afc59a1de0 --auth-supported=none --mon-host=127.0.0.1:7124 --debug-mclock 20 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/mclock-config/0 --osd-journal=td/mclock-config/0/journal --chdir= --run-dir=td/mclock-config '--admin-socket=/tmp/ceph-asok.7504/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/mclock-config/$name.log' '--pid-file=td/mclock-config/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_op_queue=mclock_scheduler 2026-02-18T00:31:14.001 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T00:31:14.001 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T00:31:14.002 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T00:31:14.025 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:31:14.016+0000 7f4f4c82ba40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:31:14.027 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:31:14.020+0000 7f4f4c82ba40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:31:14.028 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:31:14.020+0000 7f4f4c82ba40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:31:14.110 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-18T00:31:14.110 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:31:14.110 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-18T00:31:14.110 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:31:14.110 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:31:14.110 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:31:14.111 INFO:tasks.workunit.client.0.trial069.stdout:0 2026-02-18T00:31:14.111 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:31:14.111 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:31:14.111 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T00:31:14.218 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:31:14.600 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:31:14.592+0000 7f4f4c82ba40 -1 Falling back to public interface 2026-02-18T00:31:15.219 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:31:15.219 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:31:15.220 INFO:tasks.workunit.client.0.trial069.stdout:1 2026-02-18T00:31:15.220 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T00:31:15.221 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:31:15.221 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T00:31:15.327 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:31:15.556 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:31:15.548+0000 7f4f4c82ba40 -1 osd.0 0 log_to_monitors true 2026-02-18T00:31:16.328 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:31:16.329 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:31:16.329 INFO:tasks.workunit.client.0.trial069.stdout:2 2026-02-18T00:31:16.330 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-18T00:31:16.330 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:31:16.330 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T00:31:16.537 INFO:tasks.workunit.client.0.trial069.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/2982467290,v1:127.0.0.1:6801/2982467290] [v2:127.0.0.1:6802/2982467290,v1:127.0.0.1:6803/2982467290] exists,up 87bbab18-75cd-40a7-a48b-73415381df1e 2026-02-18T00:31:16.537 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:31:16.538 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:31:16.538 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:31:16.538 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:314: TEST_profile_disallow_builtin_params_modify: ceph config get osd.0 osd_mclock_profile 2026-02-18T00:31:16.753 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:314: TEST_profile_disallow_builtin_params_modify: local def_mclock_profile=balanced 2026-02-18T00:31:16.753 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:315: TEST_profile_disallow_builtin_params_modify: test balanced = balanced 2026-02-18T00:31:16.754 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:320: TEST_profile_disallow_builtin_params_modify: jq .osd_mclock_profile 2026-02-18T00:31:16.755 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:320: TEST_profile_disallow_builtin_params_modify: get_asok_path osd.0 2026-02-18T00:31:16.755 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-18T00:31:16.755 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-18T00:31:16.755 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:31:16.755 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:31:16.755 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.7504 2026-02-18T00:31:16.755 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.7504/ceph-osd.0.asok 2026-02-18T00:31:16.755 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:320: TEST_profile_disallow_builtin_params_modify: CEPH_ARGS= 2026-02-18T00:31:16.755 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:320: TEST_profile_disallow_builtin_params_modify: ceph --format=json daemon /tmp/ceph-asok.7504/ceph-osd.0.asok config get osd_mclock_profile 2026-02-18T00:31:16.814 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:320: TEST_profile_disallow_builtin_params_modify: local 'cur_mclock_profile="high_recovery_ops"' 2026-02-18T00:31:16.815 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:321: TEST_profile_disallow_builtin_params_modify: eval echo '"high_recovery_ops"' 2026-02-18T00:31:16.815 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:321: TEST_profile_disallow_builtin_params_modify: echo high_recovery_ops 2026-02-18T00:31:16.815 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:321: TEST_profile_disallow_builtin_params_modify: cur_mclock_profile=high_recovery_ops 2026-02-18T00:31:16.815 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:322: TEST_profile_disallow_builtin_params_modify: test high_recovery_ops = high_recovery_ops 2026-02-18T00:31:16.815 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:324: TEST_profile_disallow_builtin_params_modify: options=('osd_mclock_scheduler_background_recovery_res' 'osd_mclock_scheduler_client_res') 2026-02-18T00:31:16.815 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:324: TEST_profile_disallow_builtin_params_modify: declare -a options 2026-02-18T00:31:16.815 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:327: TEST_profile_disallow_builtin_params_modify: local retries=10 2026-02-18T00:31:16.815 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:328: TEST_profile_disallow_builtin_params_modify: local errors=0 2026-02-18T00:31:16.815 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:329: TEST_profile_disallow_builtin_params_modify: for opt in "${options[@]}" 2026-02-18T00:31:16.816 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:333: TEST_profile_disallow_builtin_params_modify: jq .osd_mclock_scheduler_background_recovery_res 2026-02-18T00:31:16.816 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:333: TEST_profile_disallow_builtin_params_modify: bc 2026-02-18T00:31:16.816 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:333: TEST_profile_disallow_builtin_params_modify: get_asok_path osd.0 2026-02-18T00:31:16.816 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-18T00:31:16.816 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-18T00:31:16.817 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:31:16.817 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:31:16.817 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.7504 2026-02-18T00:31:16.817 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.7504/ceph-osd.0.asok 2026-02-18T00:31:16.817 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:333: TEST_profile_disallow_builtin_params_modify: CEPH_ARGS= 2026-02-18T00:31:16.817 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:333: TEST_profile_disallow_builtin_params_modify: ceph --format=json daemon /tmp/ceph-asok.7504/ceph-osd.0.asok config get osd_mclock_scheduler_background_recovery_res 2026-02-18T00:31:16.876 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:333: TEST_profile_disallow_builtin_params_modify: local opt_val_orig=0.700000 2026-02-18T00:31:16.877 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:334: TEST_profile_disallow_builtin_params_modify: echo '0.700000 + 0.1' 2026-02-18T00:31:16.877 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:334: TEST_profile_disallow_builtin_params_modify: bc -l 2026-02-18T00:31:16.878 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:334: TEST_profile_disallow_builtin_params_modify: local opt_val_new=.800000 2026-02-18T00:31:16.878 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:335: TEST_profile_disallow_builtin_params_modify: ceph config set osd.0 osd_mclock_scheduler_background_recovery_res .800000 2026-02-18T00:31:17.093 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:338: TEST_profile_disallow_builtin_params_modify: expr 10 - 1 2026-02-18T00:31:17.094 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:338: TEST_profile_disallow_builtin_params_modify: seq 0 9 2026-02-18T00:31:17.095 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:338: TEST_profile_disallow_builtin_params_modify: for count in $(seq 0 $(expr $retries - 1)) 2026-02-18T00:31:17.095 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:340: TEST_profile_disallow_builtin_params_modify: errors=0 2026-02-18T00:31:17.095 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:341: TEST_profile_disallow_builtin_params_modify: sleep 2 2026-02-18T00:31:19.096 INFO:tasks.workunit.client.0.trial069.stdout:Check configuration values - Attempt#: 0 2026-02-18T00:31:19.097 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:343: TEST_profile_disallow_builtin_params_modify: echo 'Check configuration values - Attempt#: 0' 2026-02-18T00:31:19.097 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:345: TEST_profile_disallow_builtin_params_modify: ceph config get osd.0 osd_mclock_scheduler_background_recovery_res 2026-02-18T00:31:19.307 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:345: TEST_profile_disallow_builtin_params_modify: local res=0.000000 2026-02-18T00:31:19.307 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:346: TEST_profile_disallow_builtin_params_modify: echo 'Mon db (or default): osd.0 osd_mclock_scheduler_background_recovery_res = 0.000000' 2026-02-18T00:31:19.308 INFO:tasks.workunit.client.0.trial069.stdout:Mon db (or default): osd.0 osd_mclock_scheduler_background_recovery_res = 0.000000 2026-02-18T00:31:19.308 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:347: TEST_profile_disallow_builtin_params_modify: echo '0.000000 == .800000' 2026-02-18T00:31:19.308 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:347: TEST_profile_disallow_builtin_params_modify: bc -l 2026-02-18T00:31:19.309 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:347: TEST_profile_disallow_builtin_params_modify: (( 0 )) 2026-02-18T00:31:19.310 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:353: TEST_profile_disallow_builtin_params_modify: ceph config show osd.0 2026-02-18T00:31:19.310 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:353: TEST_profile_disallow_builtin_params_modify: grep osd_mclock_scheduler_background_recovery_res 2026-02-18T00:31:19.310 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:353: TEST_profile_disallow_builtin_params_modify: awk '{ print $2 }' 2026-02-18T00:31:19.310 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:353: TEST_profile_disallow_builtin_params_modify: bc 2026-02-18T00:31:19.520 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:353: TEST_profile_disallow_builtin_params_modify: res=.700000 2026-02-18T00:31:19.521 INFO:tasks.workunit.client.0.trial069.stdout:Running config: osd.0 osd_mclock_scheduler_background_recovery_res = .700000 2026-02-18T00:31:19.521 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:354: TEST_profile_disallow_builtin_params_modify: echo 'Running config: osd.0 osd_mclock_scheduler_background_recovery_res = .700000' 2026-02-18T00:31:19.521 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:356: TEST_profile_disallow_builtin_params_modify: echo '.700000 == .800000' 2026-02-18T00:31:19.521 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:356: TEST_profile_disallow_builtin_params_modify: bc -l 2026-02-18T00:31:19.523 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:356: TEST_profile_disallow_builtin_params_modify: echo '.700000 != 0.700000' 2026-02-18T00:31:19.523 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:356: TEST_profile_disallow_builtin_params_modify: bc -l 2026-02-18T00:31:19.524 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:356: TEST_profile_disallow_builtin_params_modify: (( 0 || 0 )) 2026-02-18T00:31:19.525 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:362: TEST_profile_disallow_builtin_params_modify: jq .osd_mclock_scheduler_background_recovery_res 2026-02-18T00:31:19.525 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:362: TEST_profile_disallow_builtin_params_modify: bc 2026-02-18T00:31:19.525 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:362: TEST_profile_disallow_builtin_params_modify: get_asok_path osd.0 2026-02-18T00:31:19.525 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-18T00:31:19.525 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-18T00:31:19.526 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:31:19.526 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:31:19.526 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.7504 2026-02-18T00:31:19.526 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.7504/ceph-osd.0.asok 2026-02-18T00:31:19.527 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:362: TEST_profile_disallow_builtin_params_modify: CEPH_ARGS= 2026-02-18T00:31:19.527 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:362: TEST_profile_disallow_builtin_params_modify: ceph --format=json daemon /tmp/ceph-asok.7504/ceph-osd.0.asok config get osd_mclock_scheduler_background_recovery_res 2026-02-18T00:31:19.587 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:362: TEST_profile_disallow_builtin_params_modify: res=0.700000 2026-02-18T00:31:19.587 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:363: TEST_profile_disallow_builtin_params_modify: echo 'Values map: osd.0 osd_mclock_scheduler_background_recovery_res = 0.700000' 2026-02-18T00:31:19.587 INFO:tasks.workunit.client.0.trial069.stdout:Values map: osd.0 osd_mclock_scheduler_background_recovery_res = 0.700000 2026-02-18T00:31:19.587 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:365: TEST_profile_disallow_builtin_params_modify: echo '0.700000 == .800000' 2026-02-18T00:31:19.587 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:365: TEST_profile_disallow_builtin_params_modify: bc -l 2026-02-18T00:31:19.589 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:365: TEST_profile_disallow_builtin_params_modify: echo '0.700000 != 0.700000' 2026-02-18T00:31:19.589 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:365: TEST_profile_disallow_builtin_params_modify: bc -l 2026-02-18T00:31:19.590 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:365: TEST_profile_disallow_builtin_params_modify: (( 0 || 0 )) 2026-02-18T00:31:19.591 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:370: TEST_profile_disallow_builtin_params_modify: '[' 0 -eq 0 ']' 2026-02-18T00:31:19.591 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:372: TEST_profile_disallow_builtin_params_modify: break 2026-02-18T00:31:19.591 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:329: TEST_profile_disallow_builtin_params_modify: for opt in "${options[@]}" 2026-02-18T00:31:19.591 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:333: TEST_profile_disallow_builtin_params_modify: jq .osd_mclock_scheduler_client_res 2026-02-18T00:31:19.591 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:333: TEST_profile_disallow_builtin_params_modify: bc 2026-02-18T00:31:19.591 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:333: TEST_profile_disallow_builtin_params_modify: get_asok_path osd.0 2026-02-18T00:31:19.591 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-18T00:31:19.591 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-18T00:31:19.592 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:31:19.592 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:31:19.592 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.7504 2026-02-18T00:31:19.592 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.7504/ceph-osd.0.asok 2026-02-18T00:31:19.592 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:333: TEST_profile_disallow_builtin_params_modify: CEPH_ARGS= 2026-02-18T00:31:19.592 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:333: TEST_profile_disallow_builtin_params_modify: ceph --format=json daemon /tmp/ceph-asok.7504/ceph-osd.0.asok config get osd_mclock_scheduler_client_res 2026-02-18T00:31:19.651 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:333: TEST_profile_disallow_builtin_params_modify: local opt_val_orig=0.300000 2026-02-18T00:31:19.652 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:334: TEST_profile_disallow_builtin_params_modify: echo '0.300000 + 0.1' 2026-02-18T00:31:19.652 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:334: TEST_profile_disallow_builtin_params_modify: bc -l 2026-02-18T00:31:19.653 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:334: TEST_profile_disallow_builtin_params_modify: local opt_val_new=.400000 2026-02-18T00:31:19.653 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:335: TEST_profile_disallow_builtin_params_modify: ceph config set osd.0 osd_mclock_scheduler_client_res .400000 2026-02-18T00:31:19.876 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:338: TEST_profile_disallow_builtin_params_modify: expr 10 - 1 2026-02-18T00:31:19.877 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:338: TEST_profile_disallow_builtin_params_modify: seq 0 9 2026-02-18T00:31:19.879 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:338: TEST_profile_disallow_builtin_params_modify: for count in $(seq 0 $(expr $retries - 1)) 2026-02-18T00:31:19.879 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:340: TEST_profile_disallow_builtin_params_modify: errors=0 2026-02-18T00:31:19.879 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:341: TEST_profile_disallow_builtin_params_modify: sleep 2 2026-02-18T00:31:21.880 INFO:tasks.workunit.client.0.trial069.stdout:Check configuration values - Attempt#: 0 2026-02-18T00:31:21.881 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:343: TEST_profile_disallow_builtin_params_modify: echo 'Check configuration values - Attempt#: 0' 2026-02-18T00:31:21.881 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:345: TEST_profile_disallow_builtin_params_modify: ceph config get osd.0 osd_mclock_scheduler_client_res 2026-02-18T00:31:22.095 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:345: TEST_profile_disallow_builtin_params_modify: local res=0.000000 2026-02-18T00:31:22.095 INFO:tasks.workunit.client.0.trial069.stdout:Mon db (or default): osd.0 osd_mclock_scheduler_client_res = 0.000000 2026-02-18T00:31:22.096 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:346: TEST_profile_disallow_builtin_params_modify: echo 'Mon db (or default): osd.0 osd_mclock_scheduler_client_res = 0.000000' 2026-02-18T00:31:22.096 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:347: TEST_profile_disallow_builtin_params_modify: echo '0.000000 == .400000' 2026-02-18T00:31:22.096 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:347: TEST_profile_disallow_builtin_params_modify: bc -l 2026-02-18T00:31:22.097 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:347: TEST_profile_disallow_builtin_params_modify: (( 0 )) 2026-02-18T00:31:22.098 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:353: TEST_profile_disallow_builtin_params_modify: ceph config show osd.0 2026-02-18T00:31:22.098 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:353: TEST_profile_disallow_builtin_params_modify: grep osd_mclock_scheduler_client_res 2026-02-18T00:31:22.098 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:353: TEST_profile_disallow_builtin_params_modify: awk '{ print $2 }' 2026-02-18T00:31:22.098 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:353: TEST_profile_disallow_builtin_params_modify: bc 2026-02-18T00:31:22.305 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:353: TEST_profile_disallow_builtin_params_modify: res=.300000 2026-02-18T00:31:22.306 INFO:tasks.workunit.client.0.trial069.stdout:Running config: osd.0 osd_mclock_scheduler_client_res = .300000 2026-02-18T00:31:22.306 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:354: TEST_profile_disallow_builtin_params_modify: echo 'Running config: osd.0 osd_mclock_scheduler_client_res = .300000' 2026-02-18T00:31:22.307 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:356: TEST_profile_disallow_builtin_params_modify: echo '.300000 == .400000' 2026-02-18T00:31:22.307 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:356: TEST_profile_disallow_builtin_params_modify: bc -l 2026-02-18T00:31:22.308 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:356: TEST_profile_disallow_builtin_params_modify: echo '.300000 != 0.300000' 2026-02-18T00:31:22.308 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:356: TEST_profile_disallow_builtin_params_modify: bc -l 2026-02-18T00:31:22.309 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:356: TEST_profile_disallow_builtin_params_modify: (( 0 || 0 )) 2026-02-18T00:31:22.310 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:362: TEST_profile_disallow_builtin_params_modify: jq .osd_mclock_scheduler_client_res 2026-02-18T00:31:22.311 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:362: TEST_profile_disallow_builtin_params_modify: bc 2026-02-18T00:31:22.311 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:362: TEST_profile_disallow_builtin_params_modify: get_asok_path osd.0 2026-02-18T00:31:22.311 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-18T00:31:22.311 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-18T00:31:22.312 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:31:22.312 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:31:22.312 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.7504 2026-02-18T00:31:22.312 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.7504/ceph-osd.0.asok 2026-02-18T00:31:22.312 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:362: TEST_profile_disallow_builtin_params_modify: CEPH_ARGS= 2026-02-18T00:31:22.312 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:362: TEST_profile_disallow_builtin_params_modify: ceph --format=json daemon /tmp/ceph-asok.7504/ceph-osd.0.asok config get osd_mclock_scheduler_client_res 2026-02-18T00:31:22.370 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:362: TEST_profile_disallow_builtin_params_modify: res=0.300000 2026-02-18T00:31:22.370 INFO:tasks.workunit.client.0.trial069.stdout:Values map: osd.0 osd_mclock_scheduler_client_res = 0.300000 2026-02-18T00:31:22.370 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:363: TEST_profile_disallow_builtin_params_modify: echo 'Values map: osd.0 osd_mclock_scheduler_client_res = 0.300000' 2026-02-18T00:31:22.370 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:365: TEST_profile_disallow_builtin_params_modify: echo '0.300000 == .400000' 2026-02-18T00:31:22.371 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:365: TEST_profile_disallow_builtin_params_modify: bc -l 2026-02-18T00:31:22.372 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:365: TEST_profile_disallow_builtin_params_modify: echo '0.300000 != 0.300000' 2026-02-18T00:31:22.372 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:365: TEST_profile_disallow_builtin_params_modify: bc -l 2026-02-18T00:31:22.374 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:365: TEST_profile_disallow_builtin_params_modify: (( 0 || 0 )) 2026-02-18T00:31:22.374 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:370: TEST_profile_disallow_builtin_params_modify: '[' 0 -eq 0 ']' 2026-02-18T00:31:22.374 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:372: TEST_profile_disallow_builtin_params_modify: break 2026-02-18T00:31:22.374 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:380: TEST_profile_disallow_builtin_params_modify: teardown td/mclock-config 2026-02-18T00:31:22.374 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/mclock-config 2026-02-18T00:31:22.374 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T00:31:22.374 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/mclock-config KILL 2026-02-18T00:31:22.375 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:31:22.375 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:31:22.375 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:31:22.375 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:31:22.375 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:31:22.483 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:31:22.483 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T00:31:22.484 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T00:31:22.484 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T00:31:22.485 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T00:31:22.486 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T00:31:22.486 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T00:31:22.487 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:31:22.487 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T00:31:22.487 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T00:31:22.487 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:31:22.488 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T00:31:22.490 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T00:31:22.490 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/mclock-config 2026-02-18T00:31:22.495 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T00:31:22.495 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:31:22.495 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.7504 2026-02-18T00:31:22.495 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.7504 2026-02-18T00:31:22.497 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T00:31:22.497 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T00:31:22.497 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:34: run: teardown td/mclock-config 2026-02-18T00:31:22.497 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/mclock-config 2026-02-18T00:31:22.497 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T00:31:22.497 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/mclock-config KILL 2026-02-18T00:31:22.497 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:31:22.497 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:31:22.498 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:31:22.498 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:31:22.499 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:31:22.499 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:31:22.500 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T00:31:22.500 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T00:31:22.501 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T00:31:22.502 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T00:31:22.502 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T00:31:22.502 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T00:31:22.503 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:31:22.504 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T00:31:22.504 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T00:31:22.504 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:31:22.505 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T00:31:22.506 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T00:31:22.506 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/mclock-config 2026-02-18T00:31:22.507 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T00:31:22.507 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:31:22.508 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.7504 2026-02-18T00:31:22.508 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.7504 2026-02-18T00:31:22.510 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T00:31:22.510 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T00:31:22.510 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:31: run: for func in $funcs 2026-02-18T00:31:22.510 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:32: run: setup td/mclock-config 2026-02-18T00:31:22.510 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/mclock-config 2026-02-18T00:31:22.510 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/mclock-config 2026-02-18T00:31:22.510 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/mclock-config 2026-02-18T00:31:22.510 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T00:31:22.510 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/mclock-config KILL 2026-02-18T00:31:22.510 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:31:22.511 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:31:22.511 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:31:22.511 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:31:22.511 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:31:22.512 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:31:22.512 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T00:31:22.513 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T00:31:22.514 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T00:31:22.515 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T00:31:22.515 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T00:31:22.515 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T00:31:22.516 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:31:22.516 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T00:31:22.517 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T00:31:22.517 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:31:22.518 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T00:31:22.519 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T00:31:22.519 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/mclock-config 2026-02-18T00:31:22.521 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T00:31:22.521 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:31:22.521 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.7504 2026-02-18T00:31:22.521 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.7504 2026-02-18T00:31:22.522 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T00:31:22.522 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T00:31:22.522 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/mclock-config 2026-02-18T00:31:22.523 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-18T00:31:22.523 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:31:22.523 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.7504 2026-02-18T00:31:22.523 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.7504 2026-02-18T00:31:22.525 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-18T00:31:22.527 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-18T00:31:22.527 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-18T00:31:22.527 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/mclock-config 1' TERM HUP INT 2026-02-18T00:31:22.527 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:33: run: TEST_profile_disallow_builtin_params_override td/mclock-config 2026-02-18T00:31:22.527 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:384: TEST_profile_disallow_builtin_params_override: local dir=td/mclock-config 2026-02-18T00:31:22.527 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:386: TEST_profile_disallow_builtin_params_override: setup td/mclock-config 2026-02-18T00:31:22.527 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/mclock-config 2026-02-18T00:31:22.527 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/mclock-config 2026-02-18T00:31:22.527 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/mclock-config 2026-02-18T00:31:22.527 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T00:31:22.528 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/mclock-config KILL 2026-02-18T00:31:22.528 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:31:22.528 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:31:22.528 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:31:22.528 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:31:22.528 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:31:22.529 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:31:22.529 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T00:31:22.530 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T00:31:22.530 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T00:31:22.532 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T00:31:22.532 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T00:31:22.532 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T00:31:22.533 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:31:22.533 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T00:31:22.534 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T00:31:22.534 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:31:22.535 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T00:31:22.536 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T00:31:22.536 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/mclock-config 2026-02-18T00:31:22.537 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T00:31:22.537 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:31:22.537 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.7504 2026-02-18T00:31:22.537 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.7504 2026-02-18T00:31:22.538 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T00:31:22.538 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T00:31:22.538 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/mclock-config 2026-02-18T00:31:22.540 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-18T00:31:22.540 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:31:22.540 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.7504 2026-02-18T00:31:22.540 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.7504 2026-02-18T00:31:22.541 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-18T00:31:22.543 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-18T00:31:22.543 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-18T00:31:22.543 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/mclock-config 1' TERM HUP INT 2026-02-18T00:31:22.543 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:387: TEST_profile_disallow_builtin_params_override: run_mon td/mclock-config a 2026-02-18T00:31:22.543 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/mclock-config 2026-02-18T00:31:22.543 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-18T00:31:22.543 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-18T00:31:22.543 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-18T00:31:22.543 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/mclock-config/a 2026-02-18T00:31:22.543 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/mclock-config/a --run-dir=td/mclock-config 2026-02-18T00:31:22.563 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-18T00:31:22.563 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:31:22.563 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:31:22.564 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:31:22.564 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:31:22.564 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.7504 2026-02-18T00:31:22.565 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.7504/$cluster-$name.asok' 2026-02-18T00:31:22.565 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/mclock-config/a '--log-file=td/mclock-config/$name.log' '--admin-socket=/tmp/ceph-asok.7504/$cluster-$name.asok' --mon-cluster-log-file=td/mclock-config/log --run-dir=td/mclock-config '--pid-file=td/mclock-config/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-18T00:31:22.593 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-18T00:31:22.594 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-18T00:31:22.594 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T00:31:22.594 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-18T00:31:22.594 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-18T00:31:22.596 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-18T00:31:22.596 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-18T00:31:22.596 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:31:22.596 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:31:22.596 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:31:22.596 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:31:22.596 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.7504 2026-02-18T00:31:22.596 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.7504/ceph-mon.a.asok 2026-02-18T00:31:22.596 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T00:31:22.596 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.7504/ceph-mon.a.asok config get fsid 2026-02-18T00:31:22.650 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-18T00:31:22.650 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T00:31:22.651 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-18T00:31:22.651 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-18T00:31:22.651 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-18T00:31:22.652 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-18T00:31:22.652 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:31:22.652 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:31:22.652 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:31:22.652 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:31:22.652 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.7504 2026-02-18T00:31:22.652 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.7504/ceph-mon.a.asok 2026-02-18T00:31:22.653 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T00:31:22.653 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.7504/ceph-mon.a.asok config get mon_host 2026-02-18T00:31:22.706 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:388: TEST_profile_disallow_builtin_params_override: run_mgr td/mclock-config x 2026-02-18T00:31:22.707 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/mclock-config 2026-02-18T00:31:22.707 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-18T00:31:22.707 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-18T00:31:22.707 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-18T00:31:22.707 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/mclock-config/x 2026-02-18T00:31:22.707 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-18T00:31:22.812 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-18T00:31:22.812 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:31:22.813 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:31:22.813 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:31:22.813 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:31:22.813 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.7504 2026-02-18T00:31:22.813 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.7504/$cluster-$name.asok' 2026-02-18T00:31:22.813 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-18T00:31:22.814 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/mclock-config/x '--log-file=td/mclock-config/$name.log' '--admin-socket=/tmp/ceph-asok.7504/$cluster-$name.asok' --run-dir=td/mclock-config '--pid-file=td/mclock-config/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-18T00:31:22.835 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:390: TEST_profile_disallow_builtin_params_override: run_osd td/mclock-config 0 --osd_op_queue=mclock_scheduler 2026-02-18T00:31:22.835 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/mclock-config 2026-02-18T00:31:22.835 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T00:31:22.835 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-18T00:31:22.835 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T00:31:22.835 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/mclock-config/0 2026-02-18T00:31:22.835 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=96923420-254b-4639-a0f2-a5afc59a1de0 --auth-supported=none --mon-host=127.0.0.1:7124 --debug-mclock 20 ' 2026-02-18T00:31:22.835 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T00:31:22.835 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T00:31:22.835 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T00:31:22.836 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/mclock-config/0' 2026-02-18T00:31:22.836 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/mclock-config/0/journal' 2026-02-18T00:31:22.836 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T00:31:22.836 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-18T00:31:22.836 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/mclock-config' 2026-02-18T00:31:22.836 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T00:31:22.836 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:31:22.836 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:31:22.836 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:31:22.836 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:31:22.836 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.7504 2026-02-18T00:31:22.836 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.7504/$cluster-$name.asok' 2026-02-18T00:31:22.837 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.7504/$cluster-$name.asok' 2026-02-18T00:31:22.837 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T00:31:22.837 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T00:31:22.837 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T00:31:22.837 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/mclock-config/$name.log' 2026-02-18T00:31:22.837 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/mclock-config/$name.pid' 2026-02-18T00:31:22.837 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T00:31:22.837 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T00:31:22.837 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T00:31:22.837 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T00:31:22.837 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T00:31:22.837 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=--osd_op_queue=mclock_scheduler 2026-02-18T00:31:22.838 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/mclock-config/0 2026-02-18T00:31:22.838 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T00:31:22.838 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=43e5bed2-339e-4014-a056-011a7ab38e79 2026-02-18T00:31:22.839 INFO:tasks.workunit.client.0.trial069.stdout:add osd0 43e5bed2-339e-4014-a056-011a7ab38e79 2026-02-18T00:31:22.839 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 43e5bed2-339e-4014-a056-011a7ab38e79' 2026-02-18T00:31:22.839 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T00:31:22.848 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQBaCJVp+kJeMhAABRlG0KGzbVQDt5ZJPlpMVg== 2026-02-18T00:31:22.848 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQBaCJVp+kJeMhAABRlG0KGzbVQDt5ZJPlpMVg=="}' 2026-02-18T00:31:22.848 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 43e5bed2-339e-4014-a056-011a7ab38e79 -i td/mclock-config/0/new.json 2026-02-18T00:31:22.961 INFO:tasks.workunit.client.0.trial069.stdout:0 2026-02-18T00:31:22.969 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/mclock-config/0/new.json 2026-02-18T00:31:22.970 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=96923420-254b-4639-a0f2-a5afc59a1de0 --auth-supported=none --mon-host=127.0.0.1:7124 --debug-mclock 20 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/mclock-config/0 --osd-journal=td/mclock-config/0/journal --chdir= --run-dir=td/mclock-config '--admin-socket=/tmp/ceph-asok.7504/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/mclock-config/$name.log' '--pid-file=td/mclock-config/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_op_queue=mclock_scheduler --mkfs --key AQBaCJVp+kJeMhAABRlG0KGzbVQDt5ZJPlpMVg== --osd-uuid 43e5bed2-339e-4014-a056-011a7ab38e79 2026-02-18T00:31:22.986 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:31:22.980+0000 7f0a27336a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:31:22.988 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:31:22.980+0000 7f0a27336a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:31:22.990 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:31:22.980+0000 7f0a27336a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:31:22.990 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:31:22.984+0000 7f0a27336a40 -1 bdev(0x56080bac4c00 td/mclock-config/0/block) open stat got: (1) Operation not permitted 2026-02-18T00:31:22.990 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:31:22.984+0000 7f0a27336a40 -1 bluestore(td/mclock-config/0) _read_fsid unparsable uuid 2026-02-18T00:31:23.834 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/mclock-config/0/keyring 2026-02-18T00:31:23.834 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T00:31:23.835 INFO:tasks.workunit.client.0.trial069.stdout:adding osd0 key to auth repository 2026-02-18T00:31:23.836 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-18T00:31:23.836 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/mclock-config/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T00:31:23.949 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-18T00:31:23.949 INFO:tasks.workunit.client.0.trial069.stdout:start osd.0 2026-02-18T00:31:23.949 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=96923420-254b-4639-a0f2-a5afc59a1de0 --auth-supported=none --mon-host=127.0.0.1:7124 --debug-mclock 20 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/mclock-config/0 --osd-journal=td/mclock-config/0/journal --chdir= --run-dir=td/mclock-config '--admin-socket=/tmp/ceph-asok.7504/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/mclock-config/$name.log' '--pid-file=td/mclock-config/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_op_queue=mclock_scheduler 2026-02-18T00:31:23.949 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T00:31:23.950 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T00:31:23.950 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T00:31:23.964 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:31:23.956+0000 7fae9933ea40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:31:23.965 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:31:23.956+0000 7fae9933ea40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:31:23.966 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:31:23.960+0000 7fae9933ea40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:31:24.059 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-18T00:31:24.059 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:31:24.059 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-18T00:31:24.059 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:31:24.059 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:31:24.059 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:31:24.059 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:31:24.060 INFO:tasks.workunit.client.0.trial069.stdout:0 2026-02-18T00:31:24.060 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:31:24.060 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T00:31:24.168 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:31:24.392 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:31:24.384+0000 7fae9933ea40 -1 Falling back to public interface 2026-02-18T00:31:25.108 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:31:25.100+0000 7fae9933ea40 -1 osd.0 0 log_to_monitors true 2026-02-18T00:31:25.169 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:31:25.169 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:31:25.169 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T00:31:25.170 INFO:tasks.workunit.client.0.trial069.stdout:1 2026-02-18T00:31:25.170 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:31:25.170 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T00:31:25.374 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:31:26.376 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:31:26.376 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:31:26.377 INFO:tasks.workunit.client.0.trial069.stdout:2 2026-02-18T00:31:26.377 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-18T00:31:26.377 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:31:26.378 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T00:31:26.581 INFO:tasks.workunit.client.0.trial069.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/3330155937,v1:127.0.0.1:6801/3330155937] [v2:127.0.0.1:6802/3330155937,v1:127.0.0.1:6803/3330155937] exists,up 43e5bed2-339e-4014-a056-011a7ab38e79 2026-02-18T00:31:26.581 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:31:26.581 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:31:26.582 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:31:26.582 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:393: TEST_profile_disallow_builtin_params_override: ceph config get osd.0 osd_mclock_profile 2026-02-18T00:31:26.783 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:393: TEST_profile_disallow_builtin_params_override: local def_mclock_profile=balanced 2026-02-18T00:31:26.784 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:394: TEST_profile_disallow_builtin_params_override: test balanced = balanced 2026-02-18T00:31:26.784 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:399: TEST_profile_disallow_builtin_params_override: jq .osd_mclock_profile 2026-02-18T00:31:26.785 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:399: TEST_profile_disallow_builtin_params_override: get_asok_path osd.0 2026-02-18T00:31:26.785 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-18T00:31:26.785 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-18T00:31:26.785 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:31:26.785 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:31:26.785 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.7504 2026-02-18T00:31:26.786 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.7504/ceph-osd.0.asok 2026-02-18T00:31:26.786 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:399: TEST_profile_disallow_builtin_params_override: CEPH_ARGS= 2026-02-18T00:31:26.786 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:399: TEST_profile_disallow_builtin_params_override: ceph --format=json daemon /tmp/ceph-asok.7504/ceph-osd.0.asok config get osd_mclock_profile 2026-02-18T00:31:26.845 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:399: TEST_profile_disallow_builtin_params_override: local 'cur_mclock_profile="high_recovery_ops"' 2026-02-18T00:31:26.846 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:400: TEST_profile_disallow_builtin_params_override: eval echo '"high_recovery_ops"' 2026-02-18T00:31:26.846 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:400: TEST_profile_disallow_builtin_params_override: echo high_recovery_ops 2026-02-18T00:31:26.846 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:400: TEST_profile_disallow_builtin_params_override: cur_mclock_profile=high_recovery_ops 2026-02-18T00:31:26.846 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:401: TEST_profile_disallow_builtin_params_override: test high_recovery_ops = high_recovery_ops 2026-02-18T00:31:26.846 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:403: TEST_profile_disallow_builtin_params_override: options=('osd_mclock_scheduler_background_recovery_res' 'osd_mclock_scheduler_client_res') 2026-02-18T00:31:26.846 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:403: TEST_profile_disallow_builtin_params_override: declare -a options 2026-02-18T00:31:26.846 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:406: TEST_profile_disallow_builtin_params_override: local retries=10 2026-02-18T00:31:26.846 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:407: TEST_profile_disallow_builtin_params_override: local errors=0 2026-02-18T00:31:26.847 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:408: TEST_profile_disallow_builtin_params_override: for opt in "${options[@]}" 2026-02-18T00:31:26.847 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:412: TEST_profile_disallow_builtin_params_override: jq .osd_mclock_scheduler_background_recovery_res 2026-02-18T00:31:26.847 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:412: TEST_profile_disallow_builtin_params_override: bc 2026-02-18T00:31:26.848 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:412: TEST_profile_disallow_builtin_params_override: get_asok_path osd.0 2026-02-18T00:31:26.848 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-18T00:31:26.848 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-18T00:31:26.849 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:31:26.849 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:31:26.849 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.7504 2026-02-18T00:31:26.849 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.7504/ceph-osd.0.asok 2026-02-18T00:31:26.849 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:412: TEST_profile_disallow_builtin_params_override: CEPH_ARGS= 2026-02-18T00:31:26.849 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:412: TEST_profile_disallow_builtin_params_override: ceph --format=json daemon /tmp/ceph-asok.7504/ceph-osd.0.asok config get osd_mclock_scheduler_background_recovery_res 2026-02-18T00:31:26.908 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:412: TEST_profile_disallow_builtin_params_override: local opt_val_orig=0.700000 2026-02-18T00:31:26.909 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:413: TEST_profile_disallow_builtin_params_override: echo '0.700000 + 0.1' 2026-02-18T00:31:26.909 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:413: TEST_profile_disallow_builtin_params_override: bc -l 2026-02-18T00:31:26.910 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:413: TEST_profile_disallow_builtin_params_override: local opt_val_new=.800000 2026-02-18T00:31:26.911 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:414: TEST_profile_disallow_builtin_params_override: ceph tell osd.0 config set osd_mclock_scheduler_background_recovery_res .800000 2026-02-18T00:31:26.979 INFO:tasks.workunit.client.0.trial069.stdout:{ 2026-02-18T00:31:26.979 INFO:tasks.workunit.client.0.trial069.stdout: "success": "osd_mclock_scheduler_background_recovery_res = '' " 2026-02-18T00:31:26.979 INFO:tasks.workunit.client.0.trial069.stdout:} 2026-02-18T00:31:26.986 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:417: TEST_profile_disallow_builtin_params_override: expr 10 - 1 2026-02-18T00:31:26.987 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:417: TEST_profile_disallow_builtin_params_override: seq 0 9 2026-02-18T00:31:26.988 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:417: TEST_profile_disallow_builtin_params_override: for count in $(seq 0 $(expr $retries - 1)) 2026-02-18T00:31:26.989 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:419: TEST_profile_disallow_builtin_params_override: errors=0 2026-02-18T00:31:26.989 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:420: TEST_profile_disallow_builtin_params_override: sleep 2 2026-02-18T00:31:28.990 INFO:tasks.workunit.client.0.trial069.stdout:Check configuration values - Attempt#: 0 2026-02-18T00:31:28.991 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:422: TEST_profile_disallow_builtin_params_override: echo 'Check configuration values - Attempt#: 0' 2026-02-18T00:31:28.991 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:424: TEST_profile_disallow_builtin_params_override: ceph config get osd.0 osd_mclock_scheduler_background_recovery_res 2026-02-18T00:31:29.203 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:424: TEST_profile_disallow_builtin_params_override: local res=0.000000 2026-02-18T00:31:29.204 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:425: TEST_profile_disallow_builtin_params_override: echo 'Mon db (or default): osd.0 osd_mclock_scheduler_background_recovery_res = 0.000000' 2026-02-18T00:31:29.204 INFO:tasks.workunit.client.0.trial069.stdout:Mon db (or default): osd.0 osd_mclock_scheduler_background_recovery_res = 0.000000 2026-02-18T00:31:29.204 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:426: TEST_profile_disallow_builtin_params_override: echo '0.000000 == .800000' 2026-02-18T00:31:29.204 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:426: TEST_profile_disallow_builtin_params_override: bc -l 2026-02-18T00:31:29.205 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:426: TEST_profile_disallow_builtin_params_override: (( 0 )) 2026-02-18T00:31:29.206 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:432: TEST_profile_disallow_builtin_params_override: ceph config show osd.0 2026-02-18T00:31:29.206 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:432: TEST_profile_disallow_builtin_params_override: grep osd_mclock_scheduler_background_recovery_res 2026-02-18T00:31:29.206 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:432: TEST_profile_disallow_builtin_params_override: awk '{ print $2 }' 2026-02-18T00:31:29.206 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:432: TEST_profile_disallow_builtin_params_override: bc 2026-02-18T00:31:29.413 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:432: TEST_profile_disallow_builtin_params_override: res=.700000 2026-02-18T00:31:29.414 INFO:tasks.workunit.client.0.trial069.stdout:Running config: osd.0 osd_mclock_scheduler_background_recovery_res = .700000 2026-02-18T00:31:29.414 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:433: TEST_profile_disallow_builtin_params_override: echo 'Running config: osd.0 osd_mclock_scheduler_background_recovery_res = .700000' 2026-02-18T00:31:29.415 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:435: TEST_profile_disallow_builtin_params_override: echo '.700000 == .800000' 2026-02-18T00:31:29.415 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:435: TEST_profile_disallow_builtin_params_override: bc -l 2026-02-18T00:31:29.416 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:435: TEST_profile_disallow_builtin_params_override: echo '.700000 != 0.700000' 2026-02-18T00:31:29.416 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:435: TEST_profile_disallow_builtin_params_override: bc -l 2026-02-18T00:31:29.417 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:435: TEST_profile_disallow_builtin_params_override: (( 0 || 0 )) 2026-02-18T00:31:29.418 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:441: TEST_profile_disallow_builtin_params_override: jq .osd_mclock_scheduler_background_recovery_res 2026-02-18T00:31:29.418 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:441: TEST_profile_disallow_builtin_params_override: bc 2026-02-18T00:31:29.418 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:441: TEST_profile_disallow_builtin_params_override: get_asok_path osd.0 2026-02-18T00:31:29.418 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-18T00:31:29.419 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-18T00:31:29.419 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:31:29.420 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:31:29.420 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.7504 2026-02-18T00:31:29.420 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.7504/ceph-osd.0.asok 2026-02-18T00:31:29.420 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:441: TEST_profile_disallow_builtin_params_override: CEPH_ARGS= 2026-02-18T00:31:29.420 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:441: TEST_profile_disallow_builtin_params_override: ceph --format=json daemon /tmp/ceph-asok.7504/ceph-osd.0.asok config get osd_mclock_scheduler_background_recovery_res 2026-02-18T00:31:29.477 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:441: TEST_profile_disallow_builtin_params_override: res=0.700000 2026-02-18T00:31:29.477 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:442: TEST_profile_disallow_builtin_params_override: echo 'Values map: osd.0 osd_mclock_scheduler_background_recovery_res = 0.700000' 2026-02-18T00:31:29.477 INFO:tasks.workunit.client.0.trial069.stdout:Values map: osd.0 osd_mclock_scheduler_background_recovery_res = 0.700000 2026-02-18T00:31:29.478 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:444: TEST_profile_disallow_builtin_params_override: echo '0.700000 == .800000' 2026-02-18T00:31:29.478 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:444: TEST_profile_disallow_builtin_params_override: bc -l 2026-02-18T00:31:29.480 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:444: TEST_profile_disallow_builtin_params_override: echo '0.700000 != 0.700000' 2026-02-18T00:31:29.480 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:444: TEST_profile_disallow_builtin_params_override: bc -l 2026-02-18T00:31:29.481 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:444: TEST_profile_disallow_builtin_params_override: (( 0 || 0 )) 2026-02-18T00:31:29.481 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:449: TEST_profile_disallow_builtin_params_override: '[' 0 -eq 0 ']' 2026-02-18T00:31:29.481 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:451: TEST_profile_disallow_builtin_params_override: break 2026-02-18T00:31:29.481 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:408: TEST_profile_disallow_builtin_params_override: for opt in "${options[@]}" 2026-02-18T00:31:29.482 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:412: TEST_profile_disallow_builtin_params_override: jq .osd_mclock_scheduler_client_res 2026-02-18T00:31:29.483 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:412: TEST_profile_disallow_builtin_params_override: bc 2026-02-18T00:31:29.483 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:412: TEST_profile_disallow_builtin_params_override: get_asok_path osd.0 2026-02-18T00:31:29.483 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-18T00:31:29.483 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-18T00:31:29.483 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:31:29.483 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:31:29.483 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.7504 2026-02-18T00:31:29.483 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.7504/ceph-osd.0.asok 2026-02-18T00:31:29.484 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:412: TEST_profile_disallow_builtin_params_override: CEPH_ARGS= 2026-02-18T00:31:29.484 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:412: TEST_profile_disallow_builtin_params_override: ceph --format=json daemon /tmp/ceph-asok.7504/ceph-osd.0.asok config get osd_mclock_scheduler_client_res 2026-02-18T00:31:29.540 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:412: TEST_profile_disallow_builtin_params_override: local opt_val_orig=0.300000 2026-02-18T00:31:29.540 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:413: TEST_profile_disallow_builtin_params_override: echo '0.300000 + 0.1' 2026-02-18T00:31:29.541 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:413: TEST_profile_disallow_builtin_params_override: bc -l 2026-02-18T00:31:29.542 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:413: TEST_profile_disallow_builtin_params_override: local opt_val_new=.400000 2026-02-18T00:31:29.542 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:414: TEST_profile_disallow_builtin_params_override: ceph tell osd.0 config set osd_mclock_scheduler_client_res .400000 2026-02-18T00:31:29.619 INFO:tasks.workunit.client.0.trial069.stdout:{ 2026-02-18T00:31:29.619 INFO:tasks.workunit.client.0.trial069.stdout: "success": "osd_mclock_scheduler_client_res = '' " 2026-02-18T00:31:29.619 INFO:tasks.workunit.client.0.trial069.stdout:} 2026-02-18T00:31:29.629 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:417: TEST_profile_disallow_builtin_params_override: expr 10 - 1 2026-02-18T00:31:29.630 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:417: TEST_profile_disallow_builtin_params_override: seq 0 9 2026-02-18T00:31:29.631 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:417: TEST_profile_disallow_builtin_params_override: for count in $(seq 0 $(expr $retries - 1)) 2026-02-18T00:31:29.631 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:419: TEST_profile_disallow_builtin_params_override: errors=0 2026-02-18T00:31:29.632 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:420: TEST_profile_disallow_builtin_params_override: sleep 2 2026-02-18T00:31:31.633 INFO:tasks.workunit.client.0.trial069.stdout:Check configuration values - Attempt#: 0 2026-02-18T00:31:31.634 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:422: TEST_profile_disallow_builtin_params_override: echo 'Check configuration values - Attempt#: 0' 2026-02-18T00:31:31.634 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:424: TEST_profile_disallow_builtin_params_override: ceph config get osd.0 osd_mclock_scheduler_client_res 2026-02-18T00:31:31.842 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:424: TEST_profile_disallow_builtin_params_override: local res=0.000000 2026-02-18T00:31:31.843 INFO:tasks.workunit.client.0.trial069.stdout:Mon db (or default): osd.0 osd_mclock_scheduler_client_res = 0.000000 2026-02-18T00:31:31.844 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:425: TEST_profile_disallow_builtin_params_override: echo 'Mon db (or default): osd.0 osd_mclock_scheduler_client_res = 0.000000' 2026-02-18T00:31:31.845 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:426: TEST_profile_disallow_builtin_params_override: echo '0.000000 == .400000' 2026-02-18T00:31:31.845 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:426: TEST_profile_disallow_builtin_params_override: bc -l 2026-02-18T00:31:31.845 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:426: TEST_profile_disallow_builtin_params_override: (( 0 )) 2026-02-18T00:31:31.846 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:432: TEST_profile_disallow_builtin_params_override: ceph config show osd.0 2026-02-18T00:31:31.846 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:432: TEST_profile_disallow_builtin_params_override: grep osd_mclock_scheduler_client_res 2026-02-18T00:31:31.847 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:432: TEST_profile_disallow_builtin_params_override: awk '{ print $2 }' 2026-02-18T00:31:31.847 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:432: TEST_profile_disallow_builtin_params_override: bc 2026-02-18T00:31:32.058 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:432: TEST_profile_disallow_builtin_params_override: res=.300000 2026-02-18T00:31:32.059 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:433: TEST_profile_disallow_builtin_params_override: echo 'Running config: osd.0 osd_mclock_scheduler_client_res = .300000' 2026-02-18T00:31:32.059 INFO:tasks.workunit.client.0.trial069.stdout:Running config: osd.0 osd_mclock_scheduler_client_res = .300000 2026-02-18T00:31:32.060 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:435: TEST_profile_disallow_builtin_params_override: echo '.300000 == .400000' 2026-02-18T00:31:32.060 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:435: TEST_profile_disallow_builtin_params_override: bc -l 2026-02-18T00:31:32.061 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:435: TEST_profile_disallow_builtin_params_override: echo '.300000 != 0.300000' 2026-02-18T00:31:32.061 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:435: TEST_profile_disallow_builtin_params_override: bc -l 2026-02-18T00:31:32.062 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:435: TEST_profile_disallow_builtin_params_override: (( 0 || 0 )) 2026-02-18T00:31:32.062 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:441: TEST_profile_disallow_builtin_params_override: jq .osd_mclock_scheduler_client_res 2026-02-18T00:31:32.063 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:441: TEST_profile_disallow_builtin_params_override: bc 2026-02-18T00:31:32.064 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:441: TEST_profile_disallow_builtin_params_override: get_asok_path osd.0 2026-02-18T00:31:32.064 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-18T00:31:32.064 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-18T00:31:32.064 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:31:32.064 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:31:32.064 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.7504 2026-02-18T00:31:32.064 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.7504/ceph-osd.0.asok 2026-02-18T00:31:32.064 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:441: TEST_profile_disallow_builtin_params_override: CEPH_ARGS= 2026-02-18T00:31:32.064 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:441: TEST_profile_disallow_builtin_params_override: ceph --format=json daemon /tmp/ceph-asok.7504/ceph-osd.0.asok config get osd_mclock_scheduler_client_res 2026-02-18T00:31:32.124 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:441: TEST_profile_disallow_builtin_params_override: res=0.300000 2026-02-18T00:31:32.124 INFO:tasks.workunit.client.0.trial069.stdout:Values map: osd.0 osd_mclock_scheduler_client_res = 0.300000 2026-02-18T00:31:32.125 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:442: TEST_profile_disallow_builtin_params_override: echo 'Values map: osd.0 osd_mclock_scheduler_client_res = 0.300000' 2026-02-18T00:31:32.125 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:444: TEST_profile_disallow_builtin_params_override: echo '0.300000 == .400000' 2026-02-18T00:31:32.125 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:444: TEST_profile_disallow_builtin_params_override: bc -l 2026-02-18T00:31:32.127 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:444: TEST_profile_disallow_builtin_params_override: echo '0.300000 != 0.300000' 2026-02-18T00:31:32.127 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:444: TEST_profile_disallow_builtin_params_override: bc -l 2026-02-18T00:31:32.129 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:444: TEST_profile_disallow_builtin_params_override: (( 0 || 0 )) 2026-02-18T00:31:32.129 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:449: TEST_profile_disallow_builtin_params_override: '[' 0 -eq 0 ']' 2026-02-18T00:31:32.129 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:451: TEST_profile_disallow_builtin_params_override: break 2026-02-18T00:31:32.129 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:459: TEST_profile_disallow_builtin_params_override: teardown td/mclock-config 2026-02-18T00:31:32.129 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/mclock-config 2026-02-18T00:31:32.129 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T00:31:32.129 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/mclock-config KILL 2026-02-18T00:31:32.130 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:31:32.130 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:31:32.130 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:31:32.130 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:31:32.130 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:31:32.237 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:31:32.238 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T00:31:32.238 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T00:31:32.239 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T00:31:32.240 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T00:31:32.240 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T00:31:32.241 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T00:31:32.242 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:31:32.242 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T00:31:32.243 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T00:31:32.243 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:31:32.244 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T00:31:32.245 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T00:31:32.245 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/mclock-config 2026-02-18T00:31:32.250 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T00:31:32.250 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:31:32.250 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.7504 2026-02-18T00:31:32.251 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.7504 2026-02-18T00:31:32.253 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T00:31:32.253 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T00:31:32.253 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:34: run: teardown td/mclock-config 2026-02-18T00:31:32.253 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/mclock-config 2026-02-18T00:31:32.254 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T00:31:32.254 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/mclock-config KILL 2026-02-18T00:31:32.254 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:31:32.254 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:31:32.254 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:31:32.254 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:31:32.254 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:31:32.255 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:31:32.255 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T00:31:32.256 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T00:31:32.256 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T00:31:32.257 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T00:31:32.257 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T00:31:32.257 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T00:31:32.258 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:31:32.259 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T00:31:32.259 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T00:31:32.259 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:31:32.260 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T00:31:32.261 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T00:31:32.261 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/mclock-config 2026-02-18T00:31:32.263 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T00:31:32.263 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:31:32.263 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.7504 2026-02-18T00:31:32.263 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.7504 2026-02-18T00:31:32.265 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T00:31:32.265 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T00:31:32.265 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:31: run: for func in $funcs 2026-02-18T00:31:32.265 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:32: run: setup td/mclock-config 2026-02-18T00:31:32.265 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/mclock-config 2026-02-18T00:31:32.265 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/mclock-config 2026-02-18T00:31:32.266 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/mclock-config 2026-02-18T00:31:32.266 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T00:31:32.266 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/mclock-config KILL 2026-02-18T00:31:32.266 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:31:32.266 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:31:32.266 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:31:32.266 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:31:32.266 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:31:32.267 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:31:32.268 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T00:31:32.268 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T00:31:32.269 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T00:31:32.270 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T00:31:32.270 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T00:31:32.271 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T00:31:32.272 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:31:32.272 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T00:31:32.272 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T00:31:32.272 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:31:32.273 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T00:31:32.274 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T00:31:32.275 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/mclock-config 2026-02-18T00:31:32.276 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T00:31:32.276 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:31:32.276 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.7504 2026-02-18T00:31:32.276 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.7504 2026-02-18T00:31:32.277 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T00:31:32.278 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T00:31:32.278 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/mclock-config 2026-02-18T00:31:32.279 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-18T00:31:32.279 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:31:32.279 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.7504 2026-02-18T00:31:32.279 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.7504 2026-02-18T00:31:32.281 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-18T00:31:32.283 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-18T00:31:32.283 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-18T00:31:32.283 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/mclock-config 1' TERM HUP INT 2026-02-18T00:31:32.283 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:33: run: TEST_recovery_limit_adjustment_mclock td/mclock-config 2026-02-18T00:31:32.283 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:202: TEST_recovery_limit_adjustment_mclock: local dir=td/mclock-config 2026-02-18T00:31:32.283 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:204: TEST_recovery_limit_adjustment_mclock: setup td/mclock-config 2026-02-18T00:31:32.284 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/mclock-config 2026-02-18T00:31:32.284 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/mclock-config 2026-02-18T00:31:32.284 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/mclock-config 2026-02-18T00:31:32.284 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T00:31:32.284 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/mclock-config KILL 2026-02-18T00:31:32.284 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:31:32.284 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:31:32.284 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:31:32.284 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:31:32.284 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:31:32.285 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:31:32.285 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T00:31:32.286 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T00:31:32.286 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T00:31:32.287 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T00:31:32.287 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T00:31:32.287 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T00:31:32.289 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:31:32.289 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T00:31:32.289 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T00:31:32.289 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:31:32.290 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T00:31:32.291 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T00:31:32.292 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/mclock-config 2026-02-18T00:31:32.293 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T00:31:32.293 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:31:32.293 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.7504 2026-02-18T00:31:32.293 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.7504 2026-02-18T00:31:32.294 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T00:31:32.294 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T00:31:32.295 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/mclock-config 2026-02-18T00:31:32.296 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-18T00:31:32.296 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:31:32.296 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.7504 2026-02-18T00:31:32.297 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.7504 2026-02-18T00:31:32.298 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-18T00:31:32.300 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-18T00:31:32.300 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-18T00:31:32.300 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/mclock-config 1' TERM HUP INT 2026-02-18T00:31:32.300 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:205: TEST_recovery_limit_adjustment_mclock: run_mon td/mclock-config a 2026-02-18T00:31:32.300 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/mclock-config 2026-02-18T00:31:32.301 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-18T00:31:32.301 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-18T00:31:32.301 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-18T00:31:32.301 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/mclock-config/a 2026-02-18T00:31:32.301 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/mclock-config/a --run-dir=td/mclock-config 2026-02-18T00:31:32.319 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-18T00:31:32.319 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:31:32.319 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:31:32.319 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:31:32.319 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:31:32.319 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.7504 2026-02-18T00:31:32.319 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.7504/$cluster-$name.asok' 2026-02-18T00:31:32.320 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/mclock-config/a '--log-file=td/mclock-config/$name.log' '--admin-socket=/tmp/ceph-asok.7504/$cluster-$name.asok' --mon-cluster-log-file=td/mclock-config/log --run-dir=td/mclock-config '--pid-file=td/mclock-config/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-18T00:31:32.348 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-18T00:31:32.351 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-18T00:31:32.351 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T00:31:32.352 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-18T00:31:32.352 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-18T00:31:32.352 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-18T00:31:32.352 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-18T00:31:32.352 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:31:32.352 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:31:32.352 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:31:32.352 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:31:32.353 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.7504 2026-02-18T00:31:32.353 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.7504/ceph-mon.a.asok 2026-02-18T00:31:32.353 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T00:31:32.353 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.7504/ceph-mon.a.asok config get fsid 2026-02-18T00:31:32.408 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-18T00:31:32.408 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T00:31:32.408 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-18T00:31:32.408 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-18T00:31:32.409 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-18T00:31:32.409 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-18T00:31:32.409 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:31:32.409 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:31:32.409 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:31:32.409 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:31:32.409 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.7504 2026-02-18T00:31:32.409 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.7504/ceph-mon.a.asok 2026-02-18T00:31:32.409 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T00:31:32.409 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.7504/ceph-mon.a.asok config get mon_host 2026-02-18T00:31:32.460 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:206: TEST_recovery_limit_adjustment_mclock: run_mgr td/mclock-config x 2026-02-18T00:31:32.460 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/mclock-config 2026-02-18T00:31:32.460 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-18T00:31:32.460 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-18T00:31:32.460 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-18T00:31:32.460 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/mclock-config/x 2026-02-18T00:31:32.460 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-18T00:31:32.567 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-18T00:31:32.567 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:31:32.567 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:31:32.567 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:31:32.567 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:31:32.567 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.7504 2026-02-18T00:31:32.568 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.7504/$cluster-$name.asok' 2026-02-18T00:31:32.568 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-18T00:31:32.570 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/mclock-config/x '--log-file=td/mclock-config/$name.log' '--admin-socket=/tmp/ceph-asok.7504/$cluster-$name.asok' --run-dir=td/mclock-config '--pid-file=td/mclock-config/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-18T00:31:32.591 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:208: TEST_recovery_limit_adjustment_mclock: run_osd td/mclock-config 0 --osd_op_queue=mclock_scheduler 2026-02-18T00:31:32.591 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/mclock-config 2026-02-18T00:31:32.591 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T00:31:32.591 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-18T00:31:32.591 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T00:31:32.591 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/mclock-config/0 2026-02-18T00:31:32.591 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=96923420-254b-4639-a0f2-a5afc59a1de0 --auth-supported=none --mon-host=127.0.0.1:7124 --debug-mclock 20 ' 2026-02-18T00:31:32.591 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T00:31:32.591 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T00:31:32.591 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T00:31:32.592 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/mclock-config/0' 2026-02-18T00:31:32.592 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/mclock-config/0/journal' 2026-02-18T00:31:32.592 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T00:31:32.592 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-18T00:31:32.592 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/mclock-config' 2026-02-18T00:31:32.592 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T00:31:32.592 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:31:32.592 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:31:32.592 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:31:32.592 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:31:32.592 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.7504 2026-02-18T00:31:32.592 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.7504/$cluster-$name.asok' 2026-02-18T00:31:32.592 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.7504/$cluster-$name.asok' 2026-02-18T00:31:32.592 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T00:31:32.592 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T00:31:32.592 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T00:31:32.592 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/mclock-config/$name.log' 2026-02-18T00:31:32.592 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/mclock-config/$name.pid' 2026-02-18T00:31:32.592 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T00:31:32.592 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T00:31:32.592 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T00:31:32.592 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T00:31:32.592 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T00:31:32.592 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=--osd_op_queue=mclock_scheduler 2026-02-18T00:31:32.592 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/mclock-config/0 2026-02-18T00:31:32.592 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T00:31:32.592 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=c8954bfa-1130-4cc6-8b2e-871804a6a75f 2026-02-18T00:31:32.592 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 c8954bfa-1130-4cc6-8b2e-871804a6a75f' 2026-02-18T00:31:32.592 INFO:tasks.workunit.client.0.trial069.stdout:add osd0 c8954bfa-1130-4cc6-8b2e-871804a6a75f 2026-02-18T00:31:32.592 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T00:31:32.603 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQBkCJVpCLWxIxAAgghxHbcXSUZQcGNBornC0A== 2026-02-18T00:31:32.603 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQBkCJVpCLWxIxAAgghxHbcXSUZQcGNBornC0A=="}' 2026-02-18T00:31:32.603 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new c8954bfa-1130-4cc6-8b2e-871804a6a75f -i td/mclock-config/0/new.json 2026-02-18T00:31:32.714 INFO:tasks.workunit.client.0.trial069.stdout:0 2026-02-18T00:31:32.722 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/mclock-config/0/new.json 2026-02-18T00:31:32.723 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=96923420-254b-4639-a0f2-a5afc59a1de0 --auth-supported=none --mon-host=127.0.0.1:7124 --debug-mclock 20 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/mclock-config/0 --osd-journal=td/mclock-config/0/journal --chdir= --run-dir=td/mclock-config '--admin-socket=/tmp/ceph-asok.7504/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/mclock-config/$name.log' '--pid-file=td/mclock-config/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_op_queue=mclock_scheduler --mkfs --key AQBkCJVpCLWxIxAAgghxHbcXSUZQcGNBornC0A== --osd-uuid c8954bfa-1130-4cc6-8b2e-871804a6a75f 2026-02-18T00:31:32.739 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:31:32.732+0000 7fefe1fbaa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:31:32.741 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:31:32.732+0000 7fefe1fbaa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:31:32.742 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:31:32.732+0000 7fefe1fbaa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:31:32.742 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:31:32.732+0000 7fefe1fbaa40 -1 bdev(0x559708de0c00 td/mclock-config/0/block) open stat got: (1) Operation not permitted 2026-02-18T00:31:32.742 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:31:32.732+0000 7fefe1fbaa40 -1 bluestore(td/mclock-config/0) _read_fsid unparsable uuid 2026-02-18T00:31:33.506 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/mclock-config/0/keyring 2026-02-18T00:31:33.506 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T00:31:33.507 INFO:tasks.workunit.client.0.trial069.stdout:adding osd0 key to auth repository 2026-02-18T00:31:33.507 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-18T00:31:33.508 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/mclock-config/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T00:31:33.627 INFO:tasks.workunit.client.0.trial069.stdout:start osd.0 2026-02-18T00:31:33.628 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-18T00:31:33.628 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=96923420-254b-4639-a0f2-a5afc59a1de0 --auth-supported=none --mon-host=127.0.0.1:7124 --debug-mclock 20 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/mclock-config/0 --osd-journal=td/mclock-config/0/journal --chdir= --run-dir=td/mclock-config '--admin-socket=/tmp/ceph-asok.7504/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/mclock-config/$name.log' '--pid-file=td/mclock-config/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_op_queue=mclock_scheduler 2026-02-18T00:31:33.628 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T00:31:33.628 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T00:31:33.628 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T00:31:33.650 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:31:33.640+0000 7f9325325a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:31:33.652 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:31:33.644+0000 7f9325325a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:31:33.653 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:31:33.644+0000 7f9325325a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:31:33.734 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-18T00:31:33.735 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:31:33.735 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-18T00:31:33.735 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:31:33.735 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:31:33.735 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:31:33.735 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:31:33.735 INFO:tasks.workunit.client.0.trial069.stdout:0 2026-02-18T00:31:33.736 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:31:33.736 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T00:31:33.840 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:31:34.076 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:31:34.068+0000 7f9325325a40 -1 Falling back to public interface 2026-02-18T00:31:34.795 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:31:34.788+0000 7f9325325a40 -1 osd.0 0 log_to_monitors true 2026-02-18T00:31:34.842 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:31:34.842 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:31:34.842 INFO:tasks.workunit.client.0.trial069.stdout:1 2026-02-18T00:31:34.843 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T00:31:34.843 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:31:34.843 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T00:31:34.945 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:31:35.947 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:31:35.947 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:31:35.947 INFO:tasks.workunit.client.0.trial069.stdout:2 2026-02-18T00:31:35.948 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-18T00:31:35.949 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:31:35.949 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T00:31:36.155 INFO:tasks.workunit.client.0.trial069.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/568608001,v1:127.0.0.1:6801/568608001] [v2:127.0.0.1:6802/568608001,v1:127.0.0.1:6803/568608001] exists,up c8954bfa-1130-4cc6-8b2e-871804a6a75f 2026-02-18T00:31:36.155 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:31:36.155 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:31:36.155 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:31:36.156 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:210: TEST_recovery_limit_adjustment_mclock: get_asok_path osd.0 2026-02-18T00:31:36.156 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-18T00:31:36.156 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-18T00:31:36.157 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:31:36.157 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:31:36.157 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.7504 2026-02-18T00:31:36.157 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.7504/ceph-osd.0.asok 2026-02-18T00:31:36.157 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:210: TEST_recovery_limit_adjustment_mclock: CEPH_ARGS= 2026-02-18T00:31:36.157 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:210: TEST_recovery_limit_adjustment_mclock: ceph --format=json daemon /tmp/ceph-asok.7504/ceph-osd.0.asok config get osd_recovery_max_active 2026-02-18T00:31:36.214 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:210: TEST_recovery_limit_adjustment_mclock: local 'recoveries={"osd_recovery_max_active":"0"}' 2026-02-18T00:31:36.215 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:212: TEST_recovery_limit_adjustment_mclock: echo '{"osd_recovery_max_active":"0"}' 2026-02-18T00:31:36.215 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:212: TEST_recovery_limit_adjustment_mclock: grep --quiet osd_recovery_max_active 2026-02-18T00:31:36.216 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:217: TEST_recovery_limit_adjustment_mclock: ceph config set osd.0 osd_recovery_max_active 10 2026-02-18T00:31:36.441 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:218: TEST_recovery_limit_adjustment_mclock: sleep 2 2026-02-18T00:31:38.444 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:220: TEST_recovery_limit_adjustment_mclock: get_asok_path osd.0 2026-02-18T00:31:38.444 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-18T00:31:38.444 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-18T00:31:38.445 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:31:38.446 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:31:38.446 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.7504 2026-02-18T00:31:38.446 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.7504/ceph-osd.0.asok 2026-02-18T00:31:38.447 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:220: TEST_recovery_limit_adjustment_mclock: CEPH_ARGS= 2026-02-18T00:31:38.447 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:220: TEST_recovery_limit_adjustment_mclock: ceph --format=json daemon /tmp/ceph-asok.7504/ceph-osd.0.asok config get osd_recovery_max_active 2026-02-18T00:31:38.505 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:220: TEST_recovery_limit_adjustment_mclock: local 'max_recoveries={"osd_recovery_max_active":"0"}' 2026-02-18T00:31:38.505 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:221: TEST_recovery_limit_adjustment_mclock: test '{"osd_recovery_max_active":"0"}' = '{"osd_recovery_max_active":"0"}' 2026-02-18T00:31:38.505 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:225: TEST_recovery_limit_adjustment_mclock: ceph config set osd.0 osd_mclock_override_recovery_settings true 2026-02-18T00:31:38.711 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:226: TEST_recovery_limit_adjustment_mclock: ceph config set osd.0 osd_recovery_max_active 10 2026-02-18T00:31:38.941 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:227: TEST_recovery_limit_adjustment_mclock: sleep 2 2026-02-18T00:31:40.944 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:229: TEST_recovery_limit_adjustment_mclock: get_asok_path osd.0 2026-02-18T00:31:40.945 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-18T00:31:40.945 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-18T00:31:40.945 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:31:40.945 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:31:40.945 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.7504 2026-02-18T00:31:40.946 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.7504/ceph-osd.0.asok 2026-02-18T00:31:40.946 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:229: TEST_recovery_limit_adjustment_mclock: CEPH_ARGS= 2026-02-18T00:31:40.946 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:229: TEST_recovery_limit_adjustment_mclock: ceph --format=json daemon /tmp/ceph-asok.7504/ceph-osd.0.asok config get osd_recovery_max_active 2026-02-18T00:31:41.005 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:229: TEST_recovery_limit_adjustment_mclock: max_recoveries='{"osd_recovery_max_active":"10"}' 2026-02-18T00:31:41.005 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:230: TEST_recovery_limit_adjustment_mclock: test '{"osd_recovery_max_active":"10"}' = '{"osd_recovery_max_active":"10"}' 2026-02-18T00:31:41.005 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:232: TEST_recovery_limit_adjustment_mclock: teardown td/mclock-config 2026-02-18T00:31:41.005 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/mclock-config 2026-02-18T00:31:41.005 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T00:31:41.005 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/mclock-config KILL 2026-02-18T00:31:41.005 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:31:41.006 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:31:41.006 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:31:41.006 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:31:41.006 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:31:41.113 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:31:41.113 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T00:31:41.114 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T00:31:41.115 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T00:31:41.116 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T00:31:41.116 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T00:31:41.117 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T00:31:41.118 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:31:41.118 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T00:31:41.118 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T00:31:41.118 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:31:41.119 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T00:31:41.120 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T00:31:41.120 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/mclock-config 2026-02-18T00:31:41.125 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T00:31:41.125 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:31:41.125 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.7504 2026-02-18T00:31:41.125 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.7504 2026-02-18T00:31:41.127 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T00:31:41.127 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T00:31:41.127 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:34: run: teardown td/mclock-config 2026-02-18T00:31:41.127 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/mclock-config 2026-02-18T00:31:41.128 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T00:31:41.128 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/mclock-config KILL 2026-02-18T00:31:41.128 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:31:41.128 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:31:41.128 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:31:41.128 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:31:41.128 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:31:41.130 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:31:41.130 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T00:31:41.131 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T00:31:41.131 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T00:31:41.132 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T00:31:41.133 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T00:31:41.133 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T00:31:41.134 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:31:41.134 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T00:31:41.135 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T00:31:41.135 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:31:41.136 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T00:31:41.137 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T00:31:41.137 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/mclock-config 2026-02-18T00:31:41.138 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T00:31:41.138 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:31:41.139 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.7504 2026-02-18T00:31:41.139 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.7504 2026-02-18T00:31:41.141 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T00:31:41.141 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T00:31:41.141 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2401: main: code=0 2026-02-18T00:31:41.141 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2405: main: teardown td/mclock-config 0 2026-02-18T00:31:41.141 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/mclock-config 2026-02-18T00:31:41.141 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs=0 2026-02-18T00:31:41.141 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/mclock-config KILL 2026-02-18T00:31:41.141 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:31:41.141 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:31:41.141 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:31:41.141 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:31:41.142 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:31:41.143 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:31:41.143 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T00:31:41.144 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T00:31:41.144 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T00:31:41.145 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T00:31:41.145 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T00:31:41.146 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T00:31:41.146 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:31:41.146 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T00:31:41.147 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T00:31:41.147 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:31:41.148 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T00:31:41.149 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o 0 = 1 ']' 2026-02-18T00:31:41.149 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/mclock-config 2026-02-18T00:31:41.150 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T00:31:41.151 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:31:41.151 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.7504 2026-02-18T00:31:41.151 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.7504 2026-02-18T00:31:41.152 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T00:31:41.152 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T00:31:41.152 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2406: main: return 0 2026-02-18T00:31:41.154 INFO:teuthology.orchestra.run:Running command with timeout 3600 2026-02-18T00:31:41.155 DEBUG:teuthology.orchestra.run.trial069:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2026-02-18T00:31:41.211 INFO:tasks.workunit:Running workunit misc/network-ping.sh... 2026-02-18T00:31:41.211 DEBUG:teuthology.orchestra.run.trial069:workunit test misc/network-ping.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=adc1923395f2bcd6ae89b5d331d278364d1848ed TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh 2026-02-18T00:31:41.268 INFO:tasks.workunit.client.0.trial069.stderr:stty: 'standard input': Inappropriate ioctl for device 2026-02-18T00:31:41.271 INFO:tasks.workunit.client.0.trial069.stderr:+ PS4='${BASH_SOURCE[0]}:$LINENO: ${FUNCNAME[0]}: ' 2026-02-18T00:31:41.272 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2394: main: export PATH=.:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2026-02-18T00:31:41.272 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2394: main: PATH=.:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2026-02-18T00:31:41.272 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2395: main: export PYTHONWARNINGS=ignore 2026-02-18T00:31:41.272 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2395: main: PYTHONWARNINGS=ignore 2026-02-18T00:31:41.272 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2396: main: export CEPH_CONF=/dev/null 2026-02-18T00:31:41.272 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2396: main: CEPH_CONF=/dev/null 2026-02-18T00:31:41.272 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2397: main: unset CEPH_ARGS 2026-02-18T00:31:41.272 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2399: main: local code 2026-02-18T00:31:41.273 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2400: main: run td/network-ping 2026-02-18T00:31:41.273 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:6: run: local dir=td/network-ping 2026-02-18T00:31:41.273 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:7: run: shift 2026-02-18T00:31:41.273 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:9: run: export CEPH_MON=127.0.0.1:7146 2026-02-18T00:31:41.273 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:9: run: CEPH_MON=127.0.0.1:7146 2026-02-18T00:31:41.273 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:10: run: export CEPH_ARGS 2026-02-18T00:31:41.273 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:11: run: uuidgen 2026-02-18T00:31:41.274 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:11: run: CEPH_ARGS+='--fsid=5622f510-6141-4057-a1e1-f8d3df558f57 --auth-supported=none ' 2026-02-18T00:31:41.274 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:12: run: CEPH_ARGS+='--mon-host=127.0.0.1:7146 ' 2026-02-18T00:31:41.274 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:13: run: CEPH_ARGS+='--debug_disable_randomized_ping=true ' 2026-02-18T00:31:41.274 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:14: run: CEPH_ARGS+='--debug_heartbeat_testing_span=5 ' 2026-02-18T00:31:41.274 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:15: run: CEPH_ARGS+='--osd_heartbeat_interval=1 ' 2026-02-18T00:31:41.274 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:16: run: set 2026-02-18T00:31:41.274 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:16: run: sed -n -e 's/^\(TEST_[0-9a-z_]*\) .*/\1/p' 2026-02-18T00:31:41.276 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:16: run: local 'funcs=TEST_network_ping_test1 2026-02-18T00:31:41.276 INFO:tasks.workunit.client.0.trial069.stderr:TEST_network_ping_test2' 2026-02-18T00:31:41.276 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:17: run: for func in $funcs 2026-02-18T00:31:41.276 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:18: run: setup td/network-ping 2026-02-18T00:31:41.276 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/network-ping 2026-02-18T00:31:41.276 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/network-ping 2026-02-18T00:31:41.276 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/network-ping 2026-02-18T00:31:41.276 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T00:31:41.276 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/network-ping KILL 2026-02-18T00:31:41.276 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:31:41.277 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:31:41.277 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:31:41.277 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:31:41.277 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:31:41.277 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:31:41.278 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T00:31:41.279 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T00:31:41.279 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T00:31:41.280 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T00:31:41.280 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T00:31:41.281 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T00:31:41.282 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:31:41.282 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T00:31:41.282 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T00:31:41.283 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:31:41.283 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T00:31:41.285 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T00:31:41.285 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/network-ping 2026-02-18T00:31:41.286 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T00:31:41.286 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:31:41.286 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.24589 2026-02-18T00:31:41.286 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.24589 2026-02-18T00:31:41.287 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T00:31:41.287 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T00:31:41.287 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/network-ping 2026-02-18T00:31:41.289 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-18T00:31:41.289 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:31:41.289 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.24589 2026-02-18T00:31:41.289 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.24589 2026-02-18T00:31:41.291 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-18T00:31:41.291 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 1024 -le 1024 ']' 2026-02-18T00:31:41.291 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:127: setup: ulimit -n 4096 2026-02-18T00:31:41.291 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-18T00:31:41.291 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/network-ping 1' TERM HUP INT 2026-02-18T00:31:41.291 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:19: run: TEST_network_ping_test1 td/network-ping 2026-02-18T00:31:41.292 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:25: TEST_network_ping_test1: local dir=td/network-ping 2026-02-18T00:31:41.292 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:27: TEST_network_ping_test1: run_mon td/network-ping a 2026-02-18T00:31:41.292 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/network-ping 2026-02-18T00:31:41.292 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-18T00:31:41.292 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-18T00:31:41.292 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-18T00:31:41.292 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/network-ping/a 2026-02-18T00:31:41.292 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/network-ping/a --run-dir=td/network-ping 2026-02-18T00:31:41.318 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-18T00:31:41.318 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:31:41.318 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:31:41.319 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:31:41.319 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:31:41.319 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.24589 2026-02-18T00:31:41.319 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.24589/$cluster-$name.asok' 2026-02-18T00:31:41.319 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/network-ping/a '--log-file=td/network-ping/$name.log' '--admin-socket=/tmp/ceph-asok.24589/$cluster-$name.asok' --mon-cluster-log-file=td/network-ping/log --run-dir=td/network-ping '--pid-file=td/network-ping/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-18T00:31:41.348 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-18T00:31:41.350 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-18T00:31:41.350 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T00:31:41.350 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-18T00:31:41.350 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-18T00:31:41.350 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-18T00:31:41.350 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-18T00:31:41.350 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:31:41.351 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:31:41.351 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:31:41.351 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:31:41.351 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.24589 2026-02-18T00:31:41.351 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.24589/ceph-mon.a.asok 2026-02-18T00:31:41.351 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T00:31:41.352 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.24589/ceph-mon.a.asok config get fsid 2026-02-18T00:31:41.408 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-18T00:31:41.408 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T00:31:41.408 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-18T00:31:41.408 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-18T00:31:41.409 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-18T00:31:41.409 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-18T00:31:41.409 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:31:41.409 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:31:41.409 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:31:41.409 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:31:41.409 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.24589 2026-02-18T00:31:41.409 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.24589/ceph-mon.a.asok 2026-02-18T00:31:41.409 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T00:31:41.409 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.24589/ceph-mon.a.asok config get mon_host 2026-02-18T00:31:41.463 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:28: TEST_network_ping_test1: run_mgr td/network-ping x 2026-02-18T00:31:41.463 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/network-ping 2026-02-18T00:31:41.463 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-18T00:31:41.463 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-18T00:31:41.463 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-18T00:31:41.463 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/network-ping/x 2026-02-18T00:31:41.464 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-18T00:31:41.580 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-18T00:31:41.580 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:31:41.581 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:31:41.581 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:31:41.581 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:31:41.581 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.24589 2026-02-18T00:31:41.581 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.24589/$cluster-$name.asok' 2026-02-18T00:31:41.581 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-18T00:31:41.582 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/network-ping/x '--log-file=td/network-ping/$name.log' '--admin-socket=/tmp/ceph-asok.24589/$cluster-$name.asok' --run-dir=td/network-ping '--pid-file=td/network-ping/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-18T00:31:41.602 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:29: TEST_network_ping_test1: run_osd td/network-ping 0 2026-02-18T00:31:41.603 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/network-ping 2026-02-18T00:31:41.603 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T00:31:41.603 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-18T00:31:41.603 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T00:31:41.603 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/network-ping/0 2026-02-18T00:31:41.603 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=5622f510-6141-4057-a1e1-f8d3df558f57 --auth-supported=none --mon-host=127.0.0.1:7146 --debug_disable_randomized_ping=true --debug_heartbeat_testing_span=5 --osd_heartbeat_interval=1 ' 2026-02-18T00:31:41.603 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T00:31:41.603 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T00:31:41.603 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T00:31:41.603 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/network-ping/0' 2026-02-18T00:31:41.604 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/network-ping/0/journal' 2026-02-18T00:31:41.604 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T00:31:41.604 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-18T00:31:41.604 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/network-ping' 2026-02-18T00:31:41.604 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T00:31:41.604 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:31:41.604 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:31:41.604 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:31:41.604 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:31:41.604 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.24589 2026-02-18T00:31:41.604 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.24589/$cluster-$name.asok' 2026-02-18T00:31:41.604 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.24589/$cluster-$name.asok' 2026-02-18T00:31:41.604 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T00:31:41.605 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T00:31:41.605 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T00:31:41.605 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/network-ping/$name.log' 2026-02-18T00:31:41.605 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/network-ping/$name.pid' 2026-02-18T00:31:41.605 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T00:31:41.605 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T00:31:41.605 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T00:31:41.605 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T00:31:41.605 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T00:31:41.605 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-18T00:31:41.605 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/network-ping/0 2026-02-18T00:31:41.605 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T00:31:41.606 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=326e310f-ab2d-4aa9-aa0b-4a8467ecb405 2026-02-18T00:31:41.606 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 326e310f-ab2d-4aa9-aa0b-4a8467ecb405' 2026-02-18T00:31:41.606 INFO:tasks.workunit.client.0.trial069.stdout:add osd0 326e310f-ab2d-4aa9-aa0b-4a8467ecb405 2026-02-18T00:31:41.607 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T00:31:41.614 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQBtCJVpSh9hJBAARpnR9lI99mpsxj75sGORTg== 2026-02-18T00:31:41.614 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQBtCJVpSh9hJBAARpnR9lI99mpsxj75sGORTg=="}' 2026-02-18T00:31:41.614 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 326e310f-ab2d-4aa9-aa0b-4a8467ecb405 -i td/network-ping/0/new.json 2026-02-18T00:31:41.723 INFO:tasks.workunit.client.0.trial069.stdout:0 2026-02-18T00:31:41.731 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/network-ping/0/new.json 2026-02-18T00:31:41.732 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=5622f510-6141-4057-a1e1-f8d3df558f57 --auth-supported=none --mon-host=127.0.0.1:7146 --debug_disable_randomized_ping=true --debug_heartbeat_testing_span=5 --osd_heartbeat_interval=1 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/network-ping/0 --osd-journal=td/network-ping/0/journal --chdir= --run-dir=td/network-ping '--admin-socket=/tmp/ceph-asok.24589/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/network-ping/$name.log' '--pid-file=td/network-ping/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQBtCJVpSh9hJBAARpnR9lI99mpsxj75sGORTg== --osd-uuid 326e310f-ab2d-4aa9-aa0b-4a8467ecb405 2026-02-18T00:31:41.748 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:31:41.740+0000 7f75417d1a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:31:41.750 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:31:41.740+0000 7f75417d1a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:31:41.751 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:31:41.744+0000 7f75417d1a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:31:41.751 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:31:41.744+0000 7f75417d1a40 -1 bdev(0x562324bd0c00 td/network-ping/0/block) open stat got: (1) Operation not permitted 2026-02-18T00:31:41.751 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:31:41.744+0000 7f75417d1a40 -1 bluestore(td/network-ping/0) _read_fsid unparsable uuid 2026-02-18T00:31:42.490 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/network-ping/0/keyring 2026-02-18T00:31:42.491 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T00:31:42.492 INFO:tasks.workunit.client.0.trial069.stdout:adding osd0 key to auth repository 2026-02-18T00:31:42.492 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-18T00:31:42.492 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/network-ping/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T00:31:42.617 INFO:tasks.workunit.client.0.trial069.stdout:start osd.0 2026-02-18T00:31:42.617 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-18T00:31:42.617 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=5622f510-6141-4057-a1e1-f8d3df558f57 --auth-supported=none --mon-host=127.0.0.1:7146 --debug_disable_randomized_ping=true --debug_heartbeat_testing_span=5 --osd_heartbeat_interval=1 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/network-ping/0 --osd-journal=td/network-ping/0/journal --chdir= --run-dir=td/network-ping '--admin-socket=/tmp/ceph-asok.24589/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/network-ping/$name.log' '--pid-file=td/network-ping/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T00:31:42.617 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T00:31:42.617 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T00:31:42.617 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T00:31:42.643 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:31:42.636+0000 7f8cfdf19a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:31:42.645 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:31:42.636+0000 7f8cfdf19a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:31:42.647 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:31:42.640+0000 7f8cfdf19a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:31:42.727 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-18T00:31:42.727 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:31:42.727 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-18T00:31:42.727 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:31:42.727 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:31:42.727 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:31:42.727 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:31:42.727 INFO:tasks.workunit.client.0.trial069.stdout:0 2026-02-18T00:31:42.728 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:31:42.728 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T00:31:42.835 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:31:43.144 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:31:43.136+0000 7f8cfdf19a40 -1 Falling back to public interface 2026-02-18T00:31:43.837 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:31:43.837 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:31:43.838 INFO:tasks.workunit.client.0.trial069.stdout:1 2026-02-18T00:31:43.838 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T00:31:43.838 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:31:43.839 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T00:31:43.890 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:31:43.880+0000 7f8cfdf19a40 -1 osd.0 0 log_to_monitors true 2026-02-18T00:31:43.945 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:31:44.947 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:31:44.947 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:31:44.947 INFO:tasks.workunit.client.0.trial069.stdout:2 2026-02-18T00:31:44.948 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-18T00:31:44.948 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:31:44.948 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T00:31:45.163 INFO:tasks.workunit.client.0.trial069.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/1013714301,v1:127.0.0.1:6801/1013714301] [v2:127.0.0.1:6802/1013714301,v1:127.0.0.1:6803/1013714301] exists,up 326e310f-ab2d-4aa9-aa0b-4a8467ecb405 2026-02-18T00:31:45.166 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:31:45.166 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:31:45.166 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:31:45.166 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:30: TEST_network_ping_test1: run_osd td/network-ping 1 2026-02-18T00:31:45.166 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/network-ping 2026-02-18T00:31:45.167 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T00:31:45.167 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2026-02-18T00:31:45.167 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T00:31:45.167 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/network-ping/1 2026-02-18T00:31:45.167 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=5622f510-6141-4057-a1e1-f8d3df558f57 --auth-supported=none --mon-host=127.0.0.1:7146 --debug_disable_randomized_ping=true --debug_heartbeat_testing_span=5 --osd_heartbeat_interval=1 ' 2026-02-18T00:31:45.167 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T00:31:45.167 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T00:31:45.167 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T00:31:45.167 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/network-ping/1' 2026-02-18T00:31:45.167 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/network-ping/1/journal' 2026-02-18T00:31:45.167 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T00:31:45.167 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-18T00:31:45.168 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/network-ping' 2026-02-18T00:31:45.168 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T00:31:45.168 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:31:45.168 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:31:45.168 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:31:45.168 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:31:45.168 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.24589 2026-02-18T00:31:45.168 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.24589/$cluster-$name.asok' 2026-02-18T00:31:45.168 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.24589/$cluster-$name.asok' 2026-02-18T00:31:45.168 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T00:31:45.168 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T00:31:45.168 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T00:31:45.168 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/network-ping/$name.log' 2026-02-18T00:31:45.169 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/network-ping/$name.pid' 2026-02-18T00:31:45.169 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T00:31:45.169 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T00:31:45.169 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T00:31:45.169 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T00:31:45.169 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T00:31:45.169 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-18T00:31:45.169 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/network-ping/1 2026-02-18T00:31:45.170 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T00:31:45.170 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=8a3a2277-7628-4276-a123-52d3cf119b11 2026-02-18T00:31:45.170 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 8a3a2277-7628-4276-a123-52d3cf119b11' 2026-02-18T00:31:45.171 INFO:tasks.workunit.client.0.trial069.stdout:add osd1 8a3a2277-7628-4276-a123-52d3cf119b11 2026-02-18T00:31:45.171 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T00:31:45.181 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQBxCJVp1siJChAA+DY6jxyD1G/+UsT0CbIgVA== 2026-02-18T00:31:45.181 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQBxCJVp1siJChAA+DY6jxyD1G/+UsT0CbIgVA=="}' 2026-02-18T00:31:45.181 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 8a3a2277-7628-4276-a123-52d3cf119b11 -i td/network-ping/1/new.json 2026-02-18T00:31:45.404 INFO:tasks.workunit.client.0.trial069.stdout:1 2026-02-18T00:31:45.413 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/network-ping/1/new.json 2026-02-18T00:31:45.414 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=5622f510-6141-4057-a1e1-f8d3df558f57 --auth-supported=none --mon-host=127.0.0.1:7146 --debug_disable_randomized_ping=true --debug_heartbeat_testing_span=5 --osd_heartbeat_interval=1 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/network-ping/1 --osd-journal=td/network-ping/1/journal --chdir= --run-dir=td/network-ping '--admin-socket=/tmp/ceph-asok.24589/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/network-ping/$name.log' '--pid-file=td/network-ping/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQBxCJVp1siJChAA+DY6jxyD1G/+UsT0CbIgVA== --osd-uuid 8a3a2277-7628-4276-a123-52d3cf119b11 2026-02-18T00:31:45.432 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:31:45.424+0000 7f67f06d5a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:31:45.433 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:31:45.424+0000 7f67f06d5a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:31:45.434 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:31:45.424+0000 7f67f06d5a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:31:45.435 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:31:45.428+0000 7f67f06d5a40 -1 bdev(0x557ef93b8c00 td/network-ping/1/block) open stat got: (1) Operation not permitted 2026-02-18T00:31:45.435 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:31:45.428+0000 7f67f06d5a40 -1 bluestore(td/network-ping/1) _read_fsid unparsable uuid 2026-02-18T00:31:46.073 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/network-ping/1/keyring 2026-02-18T00:31:46.073 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T00:31:46.074 INFO:tasks.workunit.client.0.trial069.stdout:adding osd1 key to auth repository 2026-02-18T00:31:46.074 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2026-02-18T00:31:46.074 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/network-ping/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T00:31:46.366 INFO:tasks.workunit.client.0.trial069.stdout:start osd.1 2026-02-18T00:31:46.366 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2026-02-18T00:31:46.366 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=5622f510-6141-4057-a1e1-f8d3df558f57 --auth-supported=none --mon-host=127.0.0.1:7146 --debug_disable_randomized_ping=true --debug_heartbeat_testing_span=5 --osd_heartbeat_interval=1 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/network-ping/1 --osd-journal=td/network-ping/1/journal --chdir= --run-dir=td/network-ping '--admin-socket=/tmp/ceph-asok.24589/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/network-ping/$name.log' '--pid-file=td/network-ping/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T00:31:46.366 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T00:31:46.366 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T00:31:46.367 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T00:31:46.392 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:31:46.384+0000 7f603371fa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:31:46.393 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:31:46.384+0000 7f603371fa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:31:46.394 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:31:46.384+0000 7f603371fa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:31:46.574 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2026-02-18T00:31:46.574 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:31:46.574 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-18T00:31:46.574 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:31:46.574 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:31:46.575 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:31:46.575 INFO:tasks.workunit.client.0.trial069.stdout:0 2026-02-18T00:31:46.575 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:31:46.576 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:31:46.576 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-18T00:31:46.772 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:31:46.763+0000 7f603371fa40 -1 Falling back to public interface 2026-02-18T00:31:46.787 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:31:47.410 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:31:47.399+0000 7f603371fa40 -1 osd.1 0 log_to_monitors true 2026-02-18T00:31:47.789 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:31:47.790 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:31:47.790 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T00:31:47.790 INFO:tasks.workunit.client.0.trial069.stdout:1 2026-02-18T00:31:47.791 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:31:47.791 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-18T00:31:48.016 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:31:49.017 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:31:49.018 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:31:49.019 INFO:tasks.workunit.client.0.trial069.stdout:2 2026-02-18T00:31:49.019 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-18T00:31:49.019 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:31:49.019 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-18T00:31:49.230 INFO:tasks.workunit.client.0.trial069.stdout:osd.1 up in weight 1 up_from 9 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/4167968534,v1:127.0.0.1:6811/4167968534] [v2:127.0.0.1:6812/4167968534,v1:127.0.0.1:6813/4167968534] exists,up 8a3a2277-7628-4276-a123-52d3cf119b11 2026-02-18T00:31:49.233 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:31:49.233 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:31:49.233 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:31:49.233 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:31: TEST_network_ping_test1: run_osd td/network-ping 2 2026-02-18T00:31:49.234 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/network-ping 2026-02-18T00:31:49.234 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T00:31:49.234 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2026-02-18T00:31:49.234 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T00:31:49.234 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/network-ping/2 2026-02-18T00:31:49.234 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=5622f510-6141-4057-a1e1-f8d3df558f57 --auth-supported=none --mon-host=127.0.0.1:7146 --debug_disable_randomized_ping=true --debug_heartbeat_testing_span=5 --osd_heartbeat_interval=1 ' 2026-02-18T00:31:49.234 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T00:31:49.234 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T00:31:49.234 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T00:31:49.234 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/network-ping/2' 2026-02-18T00:31:49.234 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/network-ping/2/journal' 2026-02-18T00:31:49.234 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T00:31:49.235 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-18T00:31:49.235 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/network-ping' 2026-02-18T00:31:49.235 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T00:31:49.235 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:31:49.235 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:31:49.235 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:31:49.235 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:31:49.235 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.24589 2026-02-18T00:31:49.235 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.24589/$cluster-$name.asok' 2026-02-18T00:31:49.235 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.24589/$cluster-$name.asok' 2026-02-18T00:31:49.235 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T00:31:49.235 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T00:31:49.236 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T00:31:49.236 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/network-ping/$name.log' 2026-02-18T00:31:49.236 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/network-ping/$name.pid' 2026-02-18T00:31:49.236 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T00:31:49.236 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T00:31:49.236 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T00:31:49.236 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T00:31:49.236 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T00:31:49.236 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-18T00:31:49.236 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/network-ping/2 2026-02-18T00:31:49.237 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T00:31:49.237 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=b6a98ed5-7eb4-4435-b069-1288cc7ab892 2026-02-18T00:31:49.237 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 b6a98ed5-7eb4-4435-b069-1288cc7ab892' 2026-02-18T00:31:49.237 INFO:tasks.workunit.client.0.trial069.stdout:add osd2 b6a98ed5-7eb4-4435-b069-1288cc7ab892 2026-02-18T00:31:49.238 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T00:31:49.249 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQB1CJVpbuOTDhAA79Z1XhUg5YVjwsO/HMQnxQ== 2026-02-18T00:31:49.249 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQB1CJVpbuOTDhAA79Z1XhUg5YVjwsO/HMQnxQ=="}' 2026-02-18T00:31:49.249 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new b6a98ed5-7eb4-4435-b069-1288cc7ab892 -i td/network-ping/2/new.json 2026-02-18T00:31:49.471 INFO:tasks.workunit.client.0.trial069.stdout:2 2026-02-18T00:31:49.479 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/network-ping/2/new.json 2026-02-18T00:31:49.480 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --fsid=5622f510-6141-4057-a1e1-f8d3df558f57 --auth-supported=none --mon-host=127.0.0.1:7146 --debug_disable_randomized_ping=true --debug_heartbeat_testing_span=5 --osd_heartbeat_interval=1 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/network-ping/2 --osd-journal=td/network-ping/2/journal --chdir= --run-dir=td/network-ping '--admin-socket=/tmp/ceph-asok.24589/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/network-ping/$name.log' '--pid-file=td/network-ping/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQB1CJVpbuOTDhAA79Z1XhUg5YVjwsO/HMQnxQ== --osd-uuid b6a98ed5-7eb4-4435-b069-1288cc7ab892 2026-02-18T00:31:49.496 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:31:49.491+0000 7fa793137a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:31:49.498 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:31:49.491+0000 7fa793137a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:31:49.499 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:31:49.491+0000 7fa793137a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:31:49.500 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:31:49.491+0000 7fa793137a40 -1 bdev(0x55ad58296c00 td/network-ping/2/block) open stat got: (1) Operation not permitted 2026-02-18T00:31:49.500 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:31:49.491+0000 7fa793137a40 -1 bluestore(td/network-ping/2) _read_fsid unparsable uuid 2026-02-18T00:31:50.133 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/network-ping/2/keyring 2026-02-18T00:31:50.134 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T00:31:50.134 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2026-02-18T00:31:50.135 INFO:tasks.workunit.client.0.trial069.stdout:adding osd2 key to auth repository 2026-02-18T00:31:50.135 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/network-ping/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T00:31:50.427 INFO:tasks.workunit.client.0.trial069.stdout:start osd.2 2026-02-18T00:31:50.428 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2026-02-18T00:31:50.428 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --fsid=5622f510-6141-4057-a1e1-f8d3df558f57 --auth-supported=none --mon-host=127.0.0.1:7146 --debug_disable_randomized_ping=true --debug_heartbeat_testing_span=5 --osd_heartbeat_interval=1 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/network-ping/2 --osd-journal=td/network-ping/2/journal --chdir= --run-dir=td/network-ping '--admin-socket=/tmp/ceph-asok.24589/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/network-ping/$name.log' '--pid-file=td/network-ping/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T00:31:50.428 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T00:31:50.428 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T00:31:50.428 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T00:31:50.444 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:31:50.439+0000 7f6b8ef97a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:31:50.445 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:31:50.439+0000 7f6b8ef97a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:31:50.446 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:31:50.439+0000 7f6b8ef97a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:31:50.633 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2026-02-18T00:31:50.633 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:31:50.634 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-18T00:31:50.634 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:31:50.634 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:31:50.634 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:31:50.634 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:31:50.634 INFO:tasks.workunit.client.0.trial069.stdout:0 2026-02-18T00:31:50.634 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:31:50.634 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-18T00:31:50.845 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:31:50.839+0000 7f6b8ef97a40 -1 Falling back to public interface 2026-02-18T00:31:50.845 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:31:51.474 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:31:51.467+0000 7f6b8ef97a40 -1 osd.2 0 log_to_monitors true 2026-02-18T00:31:51.846 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:31:51.847 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:31:51.847 INFO:tasks.workunit.client.0.trial069.stdout:1 2026-02-18T00:31:51.848 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T00:31:51.848 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:31:51.848 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-18T00:31:52.070 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:31:53.072 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:31:53.072 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:31:53.072 INFO:tasks.workunit.client.0.trial069.stdout:2 2026-02-18T00:31:53.073 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-18T00:31:53.073 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:31:53.073 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-18T00:31:53.285 INFO:tasks.workunit.client.0.trial069.stdout:osd.2 up in weight 1 up_from 13 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/787428536,v1:127.0.0.1:6819/787428536] [v2:127.0.0.1:6820/787428536,v1:127.0.0.1:6821/787428536] exists,up b6a98ed5-7eb4-4435-b069-1288cc7ab892 2026-02-18T00:31:53.286 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:31:53.286 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:31:53.286 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:31:53.286 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:33: TEST_network_ping_test1: sleep 5 2026-02-18T00:31:58.286 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:35: TEST_network_ping_test1: create_pool foo 16 2026-02-18T00:31:58.287 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create foo 16 2026-02-18T00:31:58.546 INFO:tasks.workunit.client.0.trial069.stderr:pool 'foo' already exists 2026-02-18T00:31:58.555 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-18T00:31:59.557 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:38: TEST_network_ping_test1: timeout 20 rados bench -p foo 10 write -b 4096 --no-cleanup 2026-02-18T00:31:59.577 INFO:tasks.workunit.client.0.trial069.stdout:hints = 1 2026-02-18T00:31:59.577 INFO:tasks.workunit.client.0.trial069.stdout:Maintaining 16 concurrent writes of 4096 bytes to objects of size 4096 for up to 10 seconds or 0 objects 2026-02-18T00:31:59.577 INFO:tasks.workunit.client.0.trial069.stdout:Object prefix: benchmark_data_trial069_29099 2026-02-18T00:31:59.577 INFO:tasks.workunit.client.0.trial069.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-18T00:31:59.577 INFO:tasks.workunit.client.0.trial069.stdout: 0 0 0 0 0 0 - 0 2026-02-18T00:32:00.578 INFO:tasks.workunit.client.0.trial069.stdout: 1 16 10123 10107 39.4776 39.4805 0.00140338 0.00158091 2026-02-18T00:32:01.578 INFO:tasks.workunit.client.0.trial069.stdout: 2 16 20782 20766 40.5555 41.6367 0.00213465 0.00153923 2026-02-18T00:32:02.578 INFO:tasks.workunit.client.0.trial069.stdout: 3 16 31674 31658 41.2183 42.5469 0.000526643 0.00151359 2026-02-18T00:32:03.578 INFO:tasks.workunit.client.0.trial069.stdout: 4 16 42649 42633 41.6307 42.8711 0.000784859 0.0014996 2026-02-18T00:32:04.578 INFO:tasks.workunit.client.0.trial069.stdout: 5 16 53785 53769 42.0039 43.5 0.00116713 0.00148646 2026-02-18T00:32:05.578 INFO:tasks.workunit.client.0.trial069.stdout: 6 16 64728 64712 42.127 42.7461 0.00182937 0.00148165 2026-02-18T00:32:06.578 INFO:tasks.workunit.client.0.trial069.stdout: 7 16 75844 75828 42.3116 43.4219 0.00154954 0.00147561 2026-02-18T00:32:07.578 INFO:tasks.workunit.client.0.trial069.stdout: 8 16 86067 86051 42.0139 39.9336 0.00137133 0.00148609 2026-02-18T00:32:08.578 INFO:tasks.workunit.client.0.trial069.stdout: 9 16 95469 95453 41.4261 36.7266 0.00181485 0.00150721 2026-02-18T00:32:09.579 INFO:tasks.workunit.client.0.trial069.stdout: 10 16 104601 104585 40.8504 35.6719 0.00165922 0.00152795 2026-02-18T00:32:10.579 INFO:tasks.workunit.client.0.trial069.stdout:Total time run: 10.0027 2026-02-18T00:32:10.579 INFO:tasks.workunit.client.0.trial069.stdout:Total writes made: 104601 2026-02-18T00:32:10.579 INFO:tasks.workunit.client.0.trial069.stdout:Write size: 4096 2026-02-18T00:32:10.579 INFO:tasks.workunit.client.0.trial069.stdout:Object size: 4096 2026-02-18T00:32:10.579 INFO:tasks.workunit.client.0.trial069.stdout:Bandwidth (MB/sec): 40.8486 2026-02-18T00:32:10.579 INFO:tasks.workunit.client.0.trial069.stdout:Stddev Bandwidth: 2.81556 2026-02-18T00:32:10.579 INFO:tasks.workunit.client.0.trial069.stdout:Max bandwidth (MB/sec): 43.5 2026-02-18T00:32:10.579 INFO:tasks.workunit.client.0.trial069.stdout:Min bandwidth (MB/sec): 35.6719 2026-02-18T00:32:10.580 INFO:tasks.workunit.client.0.trial069.stdout:Average IOPS: 10457 2026-02-18T00:32:10.580 INFO:tasks.workunit.client.0.trial069.stdout:Stddev IOPS: 720.783 2026-02-18T00:32:10.580 INFO:tasks.workunit.client.0.trial069.stdout:Max IOPS: 11136 2026-02-18T00:32:10.580 INFO:tasks.workunit.client.0.trial069.stdout:Min IOPS: 9132 2026-02-18T00:32:10.580 INFO:tasks.workunit.client.0.trial069.stdout:Average Latency(s): 0.00152859 2026-02-18T00:32:10.580 INFO:tasks.workunit.client.0.trial069.stdout:Stddev Latency(s): 0.000714707 2026-02-18T00:32:10.580 INFO:tasks.workunit.client.0.trial069.stdout:Max latency(s): 0.00988529 2026-02-18T00:32:10.580 INFO:tasks.workunit.client.0.trial069.stdout:Min latency(s): 0.000524068 2026-02-18T00:32:10.585 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:41: TEST_network_ping_test1: sleep 10 2026-02-18T00:32:20.587 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:42: TEST_network_ping_test1: flush_pg_stats 2026-02-18T00:32:20.587 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-18T00:32:20.587 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-18T00:32:21.287 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-18T00:32:21.288 INFO:tasks.workunit.client.0.trial069.stderr:1 2026-02-18T00:32:21.288 INFO:tasks.workunit.client.0.trial069.stderr:2' 2026-02-18T00:32:21.288 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-18T00:32:21.288 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:32:21.288 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-18T00:32:21.365 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836490 2026-02-18T00:32:21.366 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836490 2026-02-18T00:32:21.366 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836490' 2026-02-18T00:32:21.366 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:32:21.366 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-18T00:32:21.502 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705673 2026-02-18T00:32:21.502 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705673 2026-02-18T00:32:21.502 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836490 1-38654705673' 2026-02-18T00:32:21.503 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:32:21.503 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-18T00:32:21.648 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574856 2026-02-18T00:32:21.648 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574856 2026-02-18T00:32:21.649 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836490 1-38654705673 2-55834574856' 2026-02-18T00:32:21.649 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:32:21.649 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836490 2026-02-18T00:32:21.649 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:32:21.650 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-18T00:32:21.651 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-21474836490 2026-02-18T00:32:21.651 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:32:21.652 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=21474836490 2026-02-18T00:32:21.652 INFO:tasks.workunit.client.0.trial069.stdout:waiting osd.0 seq 21474836490 2026-02-18T00:32:21.652 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 21474836490' 2026-02-18T00:32:21.652 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T00:32:22.620 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 21474836490 -lt 21474836490 2026-02-18T00:32:22.620 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:32:22.621 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705673 2026-02-18T00:32:22.621 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:32:22.622 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=1 2026-02-18T00:32:22.622 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 1-38654705673 2026-02-18T00:32:22.623 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:32:22.624 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=38654705673 2026-02-18T00:32:22.625 INFO:tasks.workunit.client.0.trial069.stdout:waiting osd.1 seq 38654705673 2026-02-18T00:32:22.625 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.1 seq 38654705673' 2026-02-18T00:32:22.626 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-18T00:32:22.841 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 38654705673 -lt 38654705673 2026-02-18T00:32:22.842 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:32:22.842 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574856 2026-02-18T00:32:22.842 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:32:22.843 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=2 2026-02-18T00:32:22.844 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 2-55834574856 2026-02-18T00:32:22.845 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:32:22.846 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=55834574856 2026-02-18T00:32:22.846 INFO:tasks.workunit.client.0.trial069.stdout:waiting osd.2 seq 55834574856 2026-02-18T00:32:22.846 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.2 seq 55834574856' 2026-02-18T00:32:22.847 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-18T00:32:23.056 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 55834574856 -lt 55834574856 2026-02-18T00:32:23.056 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:44: TEST_network_ping_test1: tee td/network-ping/json 2026-02-18T00:32:23.057 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:44: TEST_network_ping_test1: get_asok_path osd.0 2026-02-18T00:32:23.058 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-18T00:32:23.058 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-18T00:32:23.058 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:32:23.058 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:32:23.058 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.24589 2026-02-18T00:32:23.058 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.24589/ceph-osd.0.asok 2026-02-18T00:32:23.058 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:44: TEST_network_ping_test1: CEPH_ARGS= 2026-02-18T00:32:23.059 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:44: TEST_network_ping_test1: ceph daemon /tmp/ceph-asok.24589/ceph-osd.0.asok dump_osd_network 2026-02-18T00:32:23.112 INFO:tasks.workunit.client.0.trial069.stdout:{ 2026-02-18T00:32:23.113 INFO:tasks.workunit.client.0.trial069.stdout: "threshold": 1000, 2026-02-18T00:32:23.113 INFO:tasks.workunit.client.0.trial069.stdout: "entries": [] 2026-02-18T00:32:23.113 INFO:tasks.workunit.client.0.trial069.stdout:} 2026-02-18T00:32:23.120 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:45: TEST_network_ping_test1: cat td/network-ping/json 2026-02-18T00:32:23.120 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:45: TEST_network_ping_test1: jq '.entries | length' 2026-02-18T00:32:23.128 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:45: TEST_network_ping_test1: test 0 = 0 2026-02-18T00:32:23.129 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:46: TEST_network_ping_test1: cat td/network-ping/json 2026-02-18T00:32:23.130 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:46: TEST_network_ping_test1: jq .threshold 2026-02-18T00:32:23.139 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:46: TEST_network_ping_test1: test 1000 = 1000 2026-02-18T00:32:23.139 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:48: TEST_network_ping_test1: tee td/network-ping/json 2026-02-18T00:32:23.141 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:48: TEST_network_ping_test1: get_asok_path mgr.x 2026-02-18T00:32:23.141 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mgr.x 2026-02-18T00:32:23.141 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mgr.x ']' 2026-02-18T00:32:23.141 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:32:23.141 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:32:23.141 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.24589 2026-02-18T00:32:23.141 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.24589/ceph-mgr.x.asok 2026-02-18T00:32:23.142 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:48: TEST_network_ping_test1: CEPH_ARGS= 2026-02-18T00:32:23.142 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:48: TEST_network_ping_test1: ceph daemon /tmp/ceph-asok.24589/ceph-mgr.x.asok dump_osd_network 2026-02-18T00:32:23.190 INFO:tasks.workunit.client.0.trial069.stdout:{ 2026-02-18T00:32:23.190 INFO:tasks.workunit.client.0.trial069.stdout: "threshold": 1000, 2026-02-18T00:32:23.190 INFO:tasks.workunit.client.0.trial069.stdout: "entries": [] 2026-02-18T00:32:23.190 INFO:tasks.workunit.client.0.trial069.stdout:} 2026-02-18T00:32:23.197 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:49: TEST_network_ping_test1: cat td/network-ping/json 2026-02-18T00:32:23.197 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:49: TEST_network_ping_test1: jq '.entries | length' 2026-02-18T00:32:23.207 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:49: TEST_network_ping_test1: test 0 = 0 2026-02-18T00:32:23.208 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:50: TEST_network_ping_test1: cat td/network-ping/json 2026-02-18T00:32:23.208 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:50: TEST_network_ping_test1: jq .threshold 2026-02-18T00:32:23.218 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:50: TEST_network_ping_test1: test 1000 = 1000 2026-02-18T00:32:23.218 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:52: TEST_network_ping_test1: tee td/network-ping/json 2026-02-18T00:32:23.220 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:52: TEST_network_ping_test1: get_asok_path osd.0 2026-02-18T00:32:23.220 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-18T00:32:23.220 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-18T00:32:23.220 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:32:23.220 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:32:23.220 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.24589 2026-02-18T00:32:23.220 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.24589/ceph-osd.0.asok 2026-02-18T00:32:23.221 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:52: TEST_network_ping_test1: CEPH_ARGS= 2026-02-18T00:32:23.221 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:52: TEST_network_ping_test1: ceph daemon /tmp/ceph-asok.24589/ceph-osd.0.asok dump_osd_network 0 2026-02-18T00:32:23.272 INFO:tasks.workunit.client.0.trial069.stdout:{ 2026-02-18T00:32:23.272 INFO:tasks.workunit.client.0.trial069.stdout: "threshold": 0, 2026-02-18T00:32:23.272 INFO:tasks.workunit.client.0.trial069.stdout: "entries": [ 2026-02-18T00:32:23.272 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:32:23.272 INFO:tasks.workunit.client.0.trial069.stdout: "last update": "Wed Feb 18 00:32:19 2026", 2026-02-18T00:32:23.272 INFO:tasks.workunit.client.0.trial069.stdout: "stale": false, 2026-02-18T00:32:23.272 INFO:tasks.workunit.client.0.trial069.stdout: "from osd": 0, 2026-02-18T00:32:23.272 INFO:tasks.workunit.client.0.trial069.stdout: "to osd": 1, 2026-02-18T00:32:23.273 INFO:tasks.workunit.client.0.trial069.stdout: "interface": "front", 2026-02-18T00:32:23.273 INFO:tasks.workunit.client.0.trial069.stdout: "average": { 2026-02-18T00:32:23.273 INFO:tasks.workunit.client.0.trial069.stdout: "1min": 0.171, 2026-02-18T00:32:23.273 INFO:tasks.workunit.client.0.trial069.stdout: "5min": 0.202, 2026-02-18T00:32:23.273 INFO:tasks.workunit.client.0.trial069.stdout: "15min": 0.368 2026-02-18T00:32:23.273 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:32:23.273 INFO:tasks.workunit.client.0.trial069.stdout: "min": { 2026-02-18T00:32:23.273 INFO:tasks.workunit.client.0.trial069.stdout: "1min": 0.182, 2026-02-18T00:32:23.273 INFO:tasks.workunit.client.0.trial069.stdout: "5min": 0.775, 2026-02-18T00:32:23.273 INFO:tasks.workunit.client.0.trial069.stdout: "15min": 1.582 2026-02-18T00:32:23.273 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:32:23.273 INFO:tasks.workunit.client.0.trial069.stdout: "max": { 2026-02-18T00:32:23.273 INFO:tasks.workunit.client.0.trial069.stdout: "1min": 0.182, 2026-02-18T00:32:23.273 INFO:tasks.workunit.client.0.trial069.stdout: "5min": 0.775, 2026-02-18T00:32:23.273 INFO:tasks.workunit.client.0.trial069.stdout: "15min": 1.582 2026-02-18T00:32:23.273 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:32:23.273 INFO:tasks.workunit.client.0.trial069.stdout: "last": 0.174 2026-02-18T00:32:23.273 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:32:23.273 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:32:23.273 INFO:tasks.workunit.client.0.trial069.stdout: "last update": "Wed Feb 18 00:32:22 2026", 2026-02-18T00:32:23.273 INFO:tasks.workunit.client.0.trial069.stdout: "stale": false, 2026-02-18T00:32:23.273 INFO:tasks.workunit.client.0.trial069.stdout: "from osd": 0, 2026-02-18T00:32:23.273 INFO:tasks.workunit.client.0.trial069.stdout: "to osd": 2, 2026-02-18T00:32:23.273 INFO:tasks.workunit.client.0.trial069.stdout: "interface": "back", 2026-02-18T00:32:23.273 INFO:tasks.workunit.client.0.trial069.stdout: "average": { 2026-02-18T00:32:23.273 INFO:tasks.workunit.client.0.trial069.stdout: "1min": 0.195, 2026-02-18T00:32:23.273 INFO:tasks.workunit.client.0.trial069.stdout: "5min": 0.194, 2026-02-18T00:32:23.273 INFO:tasks.workunit.client.0.trial069.stdout: "15min": 0.170 2026-02-18T00:32:23.273 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:32:23.273 INFO:tasks.workunit.client.0.trial069.stdout: "min": { 2026-02-18T00:32:23.273 INFO:tasks.workunit.client.0.trial069.stdout: "1min": 0.252, 2026-02-18T00:32:23.273 INFO:tasks.workunit.client.0.trial069.stdout: "5min": 0.404, 2026-02-18T00:32:23.273 INFO:tasks.workunit.client.0.trial069.stdout: "15min": 0.404 2026-02-18T00:32:23.273 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:32:23.273 INFO:tasks.workunit.client.0.trial069.stdout: "max": { 2026-02-18T00:32:23.273 INFO:tasks.workunit.client.0.trial069.stdout: "1min": 0.252, 2026-02-18T00:32:23.273 INFO:tasks.workunit.client.0.trial069.stdout: "5min": 0.404, 2026-02-18T00:32:23.273 INFO:tasks.workunit.client.0.trial069.stdout: "15min": 0.404 2026-02-18T00:32:23.273 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:32:23.274 INFO:tasks.workunit.client.0.trial069.stdout: "last": 0.185 2026-02-18T00:32:23.274 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:32:23.274 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:32:23.274 INFO:tasks.workunit.client.0.trial069.stdout: "last update": "Wed Feb 18 00:32:22 2026", 2026-02-18T00:32:23.274 INFO:tasks.workunit.client.0.trial069.stdout: "stale": false, 2026-02-18T00:32:23.274 INFO:tasks.workunit.client.0.trial069.stdout: "from osd": 0, 2026-02-18T00:32:23.274 INFO:tasks.workunit.client.0.trial069.stdout: "to osd": 2, 2026-02-18T00:32:23.274 INFO:tasks.workunit.client.0.trial069.stdout: "interface": "front", 2026-02-18T00:32:23.274 INFO:tasks.workunit.client.0.trial069.stdout: "average": { 2026-02-18T00:32:23.274 INFO:tasks.workunit.client.0.trial069.stdout: "1min": 0.194, 2026-02-18T00:32:23.274 INFO:tasks.workunit.client.0.trial069.stdout: "5min": 0.185, 2026-02-18T00:32:23.274 INFO:tasks.workunit.client.0.trial069.stdout: "15min": 0.192 2026-02-18T00:32:23.274 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:32:23.274 INFO:tasks.workunit.client.0.trial069.stdout: "min": { 2026-02-18T00:32:23.274 INFO:tasks.workunit.client.0.trial069.stdout: "1min": 0.255, 2026-02-18T00:32:23.274 INFO:tasks.workunit.client.0.trial069.stdout: "5min": 0.304, 2026-02-18T00:32:23.274 INFO:tasks.workunit.client.0.trial069.stdout: "15min": 0.325 2026-02-18T00:32:23.274 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:32:23.274 INFO:tasks.workunit.client.0.trial069.stdout: "max": { 2026-02-18T00:32:23.274 INFO:tasks.workunit.client.0.trial069.stdout: "1min": 0.255, 2026-02-18T00:32:23.274 INFO:tasks.workunit.client.0.trial069.stdout: "5min": 0.304, 2026-02-18T00:32:23.274 INFO:tasks.workunit.client.0.trial069.stdout: "15min": 0.325 2026-02-18T00:32:23.274 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:32:23.275 INFO:tasks.workunit.client.0.trial069.stdout: "last": 0.195 2026-02-18T00:32:23.275 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:32:23.275 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:32:23.275 INFO:tasks.workunit.client.0.trial069.stdout: "last update": "Wed Feb 18 00:32:19 2026", 2026-02-18T00:32:23.275 INFO:tasks.workunit.client.0.trial069.stdout: "stale": false, 2026-02-18T00:32:23.275 INFO:tasks.workunit.client.0.trial069.stdout: "from osd": 0, 2026-02-18T00:32:23.275 INFO:tasks.workunit.client.0.trial069.stdout: "to osd": 1, 2026-02-18T00:32:23.275 INFO:tasks.workunit.client.0.trial069.stdout: "interface": "back", 2026-02-18T00:32:23.275 INFO:tasks.workunit.client.0.trial069.stdout: "average": { 2026-02-18T00:32:23.275 INFO:tasks.workunit.client.0.trial069.stdout: "1min": 0.148, 2026-02-18T00:32:23.275 INFO:tasks.workunit.client.0.trial069.stdout: "5min": 0.186, 2026-02-18T00:32:23.275 INFO:tasks.workunit.client.0.trial069.stdout: "15min": 0.194 2026-02-18T00:32:23.275 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:32:23.275 INFO:tasks.workunit.client.0.trial069.stdout: "min": { 2026-02-18T00:32:23.275 INFO:tasks.workunit.client.0.trial069.stdout: "1min": 0.173, 2026-02-18T00:32:23.275 INFO:tasks.workunit.client.0.trial069.stdout: "5min": 0.511, 2026-02-18T00:32:23.275 INFO:tasks.workunit.client.0.trial069.stdout: "15min": 0.511 2026-02-18T00:32:23.276 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:32:23.276 INFO:tasks.workunit.client.0.trial069.stdout: "max": { 2026-02-18T00:32:23.276 INFO:tasks.workunit.client.0.trial069.stdout: "1min": 0.173, 2026-02-18T00:32:23.276 INFO:tasks.workunit.client.0.trial069.stdout: "5min": 0.511, 2026-02-18T00:32:23.276 INFO:tasks.workunit.client.0.trial069.stdout: "15min": 0.511 2026-02-18T00:32:23.276 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:32:23.276 INFO:tasks.workunit.client.0.trial069.stdout: "last": 0.161 2026-02-18T00:32:23.276 INFO:tasks.workunit.client.0.trial069.stdout: } 2026-02-18T00:32:23.276 INFO:tasks.workunit.client.0.trial069.stdout: ] 2026-02-18T00:32:23.276 INFO:tasks.workunit.client.0.trial069.stdout:} 2026-02-18T00:32:23.279 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:53: TEST_network_ping_test1: cat td/network-ping/json 2026-02-18T00:32:23.279 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:53: TEST_network_ping_test1: jq '.entries | length' 2026-02-18T00:32:23.290 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:53: TEST_network_ping_test1: test 4 = 4 2026-02-18T00:32:23.291 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:54: TEST_network_ping_test1: cat td/network-ping/json 2026-02-18T00:32:23.291 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:54: TEST_network_ping_test1: jq .threshold 2026-02-18T00:32:23.299 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:54: TEST_network_ping_test1: test 0 = 0 2026-02-18T00:32:23.300 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:56: TEST_network_ping_test1: tee td/network-ping/json 2026-02-18T00:32:23.301 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:56: TEST_network_ping_test1: get_asok_path mgr.x 2026-02-18T00:32:23.301 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mgr.x 2026-02-18T00:32:23.301 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mgr.x ']' 2026-02-18T00:32:23.302 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:32:23.302 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:32:23.302 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.24589 2026-02-18T00:32:23.302 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.24589/ceph-mgr.x.asok 2026-02-18T00:32:23.302 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:56: TEST_network_ping_test1: CEPH_ARGS= 2026-02-18T00:32:23.302 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:56: TEST_network_ping_test1: ceph daemon /tmp/ceph-asok.24589/ceph-mgr.x.asok dump_osd_network 0 2026-02-18T00:32:23.349 INFO:tasks.workunit.client.0.trial069.stdout:{ 2026-02-18T00:32:23.349 INFO:tasks.workunit.client.0.trial069.stdout: "threshold": 0, 2026-02-18T00:32:23.349 INFO:tasks.workunit.client.0.trial069.stdout: "entries": [ 2026-02-18T00:32:23.349 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:32:23.350 INFO:tasks.workunit.client.0.trial069.stdout: "last update": "Wed Feb 18 00:32:19 2026", 2026-02-18T00:32:23.350 INFO:tasks.workunit.client.0.trial069.stdout: "stale": false, 2026-02-18T00:32:23.350 INFO:tasks.workunit.client.0.trial069.stdout: "from osd": 0, 2026-02-18T00:32:23.350 INFO:tasks.workunit.client.0.trial069.stdout: "to osd": 1, 2026-02-18T00:32:23.350 INFO:tasks.workunit.client.0.trial069.stdout: "interface": "front", 2026-02-18T00:32:23.350 INFO:tasks.workunit.client.0.trial069.stdout: "average": { 2026-02-18T00:32:23.350 INFO:tasks.workunit.client.0.trial069.stdout: "1min": 0.171, 2026-02-18T00:32:23.350 INFO:tasks.workunit.client.0.trial069.stdout: "5min": 0.202, 2026-02-18T00:32:23.350 INFO:tasks.workunit.client.0.trial069.stdout: "15min": 0.368 2026-02-18T00:32:23.350 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:32:23.350 INFO:tasks.workunit.client.0.trial069.stdout: "min": { 2026-02-18T00:32:23.350 INFO:tasks.workunit.client.0.trial069.stdout: "1min": 0.160, 2026-02-18T00:32:23.351 INFO:tasks.workunit.client.0.trial069.stdout: "5min": 0.114, 2026-02-18T00:32:23.351 INFO:tasks.workunit.client.0.trial069.stdout: "15min": 0.114 2026-02-18T00:32:23.351 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:32:23.351 INFO:tasks.workunit.client.0.trial069.stdout: "max": { 2026-02-18T00:32:23.351 INFO:tasks.workunit.client.0.trial069.stdout: "1min": 0.182, 2026-02-18T00:32:23.351 INFO:tasks.workunit.client.0.trial069.stdout: "5min": 0.775, 2026-02-18T00:32:23.351 INFO:tasks.workunit.client.0.trial069.stdout: "15min": 1.582 2026-02-18T00:32:23.351 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:32:23.351 INFO:tasks.workunit.client.0.trial069.stdout: "last": 0.238 2026-02-18T00:32:23.351 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:32:23.351 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:32:23.351 INFO:tasks.workunit.client.0.trial069.stdout: "last update": "Wed Feb 18 00:32:17 2026", 2026-02-18T00:32:23.351 INFO:tasks.workunit.client.0.trial069.stdout: "stale": false, 2026-02-18T00:32:23.352 INFO:tasks.workunit.client.0.trial069.stdout: "from osd": 2, 2026-02-18T00:32:23.352 INFO:tasks.workunit.client.0.trial069.stdout: "to osd": 1, 2026-02-18T00:32:23.352 INFO:tasks.workunit.client.0.trial069.stdout: "interface": "front", 2026-02-18T00:32:23.352 INFO:tasks.workunit.client.0.trial069.stdout: "average": { 2026-02-18T00:32:23.352 INFO:tasks.workunit.client.0.trial069.stdout: "1min": 0.144, 2026-02-18T00:32:23.352 INFO:tasks.workunit.client.0.trial069.stdout: "5min": 0.231, 2026-02-18T00:32:23.352 INFO:tasks.workunit.client.0.trial069.stdout: "15min": 0.205 2026-02-18T00:32:23.352 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:32:23.352 INFO:tasks.workunit.client.0.trial069.stdout: "min": { 2026-02-18T00:32:23.352 INFO:tasks.workunit.client.0.trial069.stdout: "1min": 0.106, 2026-02-18T00:32:23.352 INFO:tasks.workunit.client.0.trial069.stdout: "5min": 0.106, 2026-02-18T00:32:23.352 INFO:tasks.workunit.client.0.trial069.stdout: "15min": 0.106 2026-02-18T00:32:23.352 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:32:23.353 INFO:tasks.workunit.client.0.trial069.stdout: "max": { 2026-02-18T00:32:23.353 INFO:tasks.workunit.client.0.trial069.stdout: "1min": 0.164, 2026-02-18T00:32:23.353 INFO:tasks.workunit.client.0.trial069.stdout: "5min": 0.554, 2026-02-18T00:32:23.353 INFO:tasks.workunit.client.0.trial069.stdout: "15min": 0.554 2026-02-18T00:32:23.353 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:32:23.353 INFO:tasks.workunit.client.0.trial069.stdout: "last": 0.135 2026-02-18T00:32:23.353 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:32:23.353 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:32:23.353 INFO:tasks.workunit.client.0.trial069.stdout: "last update": "Wed Feb 18 00:32:18 2026", 2026-02-18T00:32:23.353 INFO:tasks.workunit.client.0.trial069.stdout: "stale": false, 2026-02-18T00:32:23.353 INFO:tasks.workunit.client.0.trial069.stdout: "from osd": 1, 2026-02-18T00:32:23.353 INFO:tasks.workunit.client.0.trial069.stdout: "to osd": 2, 2026-02-18T00:32:23.354 INFO:tasks.workunit.client.0.trial069.stdout: "interface": "back", 2026-02-18T00:32:23.354 INFO:tasks.workunit.client.0.trial069.stdout: "average": { 2026-02-18T00:32:23.354 INFO:tasks.workunit.client.0.trial069.stdout: "1min": 0.159, 2026-02-18T00:32:23.354 INFO:tasks.workunit.client.0.trial069.stdout: "5min": 0.209, 2026-02-18T00:32:23.354 INFO:tasks.workunit.client.0.trial069.stdout: "15min": 0.185 2026-02-18T00:32:23.354 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:32:23.354 INFO:tasks.workunit.client.0.trial069.stdout: "min": { 2026-02-18T00:32:23.354 INFO:tasks.workunit.client.0.trial069.stdout: "1min": 0.139, 2026-02-18T00:32:23.354 INFO:tasks.workunit.client.0.trial069.stdout: "5min": 0.139, 2026-02-18T00:32:23.354 INFO:tasks.workunit.client.0.trial069.stdout: "15min": 0.139 2026-02-18T00:32:23.354 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:32:23.354 INFO:tasks.workunit.client.0.trial069.stdout: "max": { 2026-02-18T00:32:23.354 INFO:tasks.workunit.client.0.trial069.stdout: "1min": 0.176, 2026-02-18T00:32:23.355 INFO:tasks.workunit.client.0.trial069.stdout: "5min": 0.381, 2026-02-18T00:32:23.355 INFO:tasks.workunit.client.0.trial069.stdout: "15min": 0.381 2026-02-18T00:32:23.355 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:32:23.355 INFO:tasks.workunit.client.0.trial069.stdout: "last": 0.173 2026-02-18T00:32:23.355 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:32:23.355 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:32:23.355 INFO:tasks.workunit.client.0.trial069.stdout: "last update": "Wed Feb 18 00:32:18 2026", 2026-02-18T00:32:23.355 INFO:tasks.workunit.client.0.trial069.stdout: "stale": false, 2026-02-18T00:32:23.355 INFO:tasks.workunit.client.0.trial069.stdout: "from osd": 1, 2026-02-18T00:32:23.355 INFO:tasks.workunit.client.0.trial069.stdout: "to osd": 0, 2026-02-18T00:32:23.355 INFO:tasks.workunit.client.0.trial069.stdout: "interface": "front", 2026-02-18T00:32:23.355 INFO:tasks.workunit.client.0.trial069.stdout: "average": { 2026-02-18T00:32:23.355 INFO:tasks.workunit.client.0.trial069.stdout: "1min": 0.140, 2026-02-18T00:32:23.356 INFO:tasks.workunit.client.0.trial069.stdout: "5min": 0.179, 2026-02-18T00:32:23.356 INFO:tasks.workunit.client.0.trial069.stdout: "15min": 0.205 2026-02-18T00:32:23.356 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:32:23.356 INFO:tasks.workunit.client.0.trial069.stdout: "min": { 2026-02-18T00:32:23.356 INFO:tasks.workunit.client.0.trial069.stdout: "1min": 0.122, 2026-02-18T00:32:23.356 INFO:tasks.workunit.client.0.trial069.stdout: "5min": 0.103, 2026-02-18T00:32:23.356 INFO:tasks.workunit.client.0.trial069.stdout: "15min": 0.103 2026-02-18T00:32:23.356 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:32:23.356 INFO:tasks.workunit.client.0.trial069.stdout: "max": { 2026-02-18T00:32:23.356 INFO:tasks.workunit.client.0.trial069.stdout: "1min": 0.160, 2026-02-18T00:32:23.356 INFO:tasks.workunit.client.0.trial069.stdout: "5min": 0.420, 2026-02-18T00:32:23.356 INFO:tasks.workunit.client.0.trial069.stdout: "15min": 0.420 2026-02-18T00:32:23.356 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:32:23.357 INFO:tasks.workunit.client.0.trial069.stdout: "last": 0.192 2026-02-18T00:32:23.357 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:32:23.357 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:32:23.357 INFO:tasks.workunit.client.0.trial069.stdout: "last update": "Wed Feb 18 00:32:19 2026", 2026-02-18T00:32:23.357 INFO:tasks.workunit.client.0.trial069.stdout: "stale": false, 2026-02-18T00:32:23.357 INFO:tasks.workunit.client.0.trial069.stdout: "from osd": 0, 2026-02-18T00:32:23.357 INFO:tasks.workunit.client.0.trial069.stdout: "to osd": 1, 2026-02-18T00:32:23.357 INFO:tasks.workunit.client.0.trial069.stdout: "interface": "back", 2026-02-18T00:32:23.357 INFO:tasks.workunit.client.0.trial069.stdout: "average": { 2026-02-18T00:32:23.357 INFO:tasks.workunit.client.0.trial069.stdout: "1min": 0.148, 2026-02-18T00:32:23.357 INFO:tasks.workunit.client.0.trial069.stdout: "5min": 0.186, 2026-02-18T00:32:23.357 INFO:tasks.workunit.client.0.trial069.stdout: "15min": 0.194 2026-02-18T00:32:23.357 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:32:23.358 INFO:tasks.workunit.client.0.trial069.stdout: "min": { 2026-02-18T00:32:23.358 INFO:tasks.workunit.client.0.trial069.stdout: "1min": 0.131, 2026-02-18T00:32:23.358 INFO:tasks.workunit.client.0.trial069.stdout: "5min": 0.093, 2026-02-18T00:32:23.358 INFO:tasks.workunit.client.0.trial069.stdout: "15min": 0.093 2026-02-18T00:32:23.358 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:32:23.358 INFO:tasks.workunit.client.0.trial069.stdout: "max": { 2026-02-18T00:32:23.358 INFO:tasks.workunit.client.0.trial069.stdout: "1min": 0.173, 2026-02-18T00:32:23.358 INFO:tasks.workunit.client.0.trial069.stdout: "5min": 0.511, 2026-02-18T00:32:23.358 INFO:tasks.workunit.client.0.trial069.stdout: "15min": 0.511 2026-02-18T00:32:23.358 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:32:23.358 INFO:tasks.workunit.client.0.trial069.stdout: "last": 0.210 2026-02-18T00:32:23.358 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:32:23.358 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:32:23.359 INFO:tasks.workunit.client.0.trial069.stdout: "last update": "Wed Feb 18 00:32:17 2026", 2026-02-18T00:32:23.359 INFO:tasks.workunit.client.0.trial069.stdout: "stale": false, 2026-02-18T00:32:23.359 INFO:tasks.workunit.client.0.trial069.stdout: "from osd": 0, 2026-02-18T00:32:23.359 INFO:tasks.workunit.client.0.trial069.stdout: "to osd": 2, 2026-02-18T00:32:23.359 INFO:tasks.workunit.client.0.trial069.stdout: "interface": "front", 2026-02-18T00:32:23.359 INFO:tasks.workunit.client.0.trial069.stdout: "average": { 2026-02-18T00:32:23.359 INFO:tasks.workunit.client.0.trial069.stdout: "1min": 0.160, 2026-02-18T00:32:23.359 INFO:tasks.workunit.client.0.trial069.stdout: "5min": 0.186, 2026-02-18T00:32:23.359 INFO:tasks.workunit.client.0.trial069.stdout: "15min": 0.192 2026-02-18T00:32:23.359 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:32:23.359 INFO:tasks.workunit.client.0.trial069.stdout: "min": { 2026-02-18T00:32:23.359 INFO:tasks.workunit.client.0.trial069.stdout: "1min": 0.143, 2026-02-18T00:32:23.359 INFO:tasks.workunit.client.0.trial069.stdout: "5min": 0.108, 2026-02-18T00:32:23.359 INFO:tasks.workunit.client.0.trial069.stdout: "15min": 0.108 2026-02-18T00:32:23.360 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:32:23.360 INFO:tasks.workunit.client.0.trial069.stdout: "max": { 2026-02-18T00:32:23.360 INFO:tasks.workunit.client.0.trial069.stdout: "1min": 0.176, 2026-02-18T00:32:23.360 INFO:tasks.workunit.client.0.trial069.stdout: "5min": 0.325, 2026-02-18T00:32:23.360 INFO:tasks.workunit.client.0.trial069.stdout: "15min": 0.325 2026-02-18T00:32:23.360 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:32:23.360 INFO:tasks.workunit.client.0.trial069.stdout: "last": 0.255 2026-02-18T00:32:23.360 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:32:23.360 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:32:23.360 INFO:tasks.workunit.client.0.trial069.stdout: "last update": "Wed Feb 18 00:32:18 2026", 2026-02-18T00:32:23.360 INFO:tasks.workunit.client.0.trial069.stdout: "stale": false, 2026-02-18T00:32:23.360 INFO:tasks.workunit.client.0.trial069.stdout: "from osd": 1, 2026-02-18T00:32:23.360 INFO:tasks.workunit.client.0.trial069.stdout: "to osd": 2, 2026-02-18T00:32:23.361 INFO:tasks.workunit.client.0.trial069.stdout: "interface": "front", 2026-02-18T00:32:23.361 INFO:tasks.workunit.client.0.trial069.stdout: "average": { 2026-02-18T00:32:23.361 INFO:tasks.workunit.client.0.trial069.stdout: "1min": 0.180, 2026-02-18T00:32:23.361 INFO:tasks.workunit.client.0.trial069.stdout: "5min": 0.188, 2026-02-18T00:32:23.361 INFO:tasks.workunit.client.0.trial069.stdout: "15min": 0.178 2026-02-18T00:32:23.361 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:32:23.361 INFO:tasks.workunit.client.0.trial069.stdout: "min": { 2026-02-18T00:32:23.361 INFO:tasks.workunit.client.0.trial069.stdout: "1min": 0.156, 2026-02-18T00:32:23.361 INFO:tasks.workunit.client.0.trial069.stdout: "5min": 0.128, 2026-02-18T00:32:23.361 INFO:tasks.workunit.client.0.trial069.stdout: "15min": 0.128 2026-02-18T00:32:23.361 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:32:23.361 INFO:tasks.workunit.client.0.trial069.stdout: "max": { 2026-02-18T00:32:23.361 INFO:tasks.workunit.client.0.trial069.stdout: "1min": 0.192, 2026-02-18T00:32:23.362 INFO:tasks.workunit.client.0.trial069.stdout: "5min": 0.475, 2026-02-18T00:32:23.362 INFO:tasks.workunit.client.0.trial069.stdout: "15min": 0.475 2026-02-18T00:32:23.362 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:32:23.362 INFO:tasks.workunit.client.0.trial069.stdout: "last": 0.167 2026-02-18T00:32:23.362 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:32:23.362 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:32:23.362 INFO:tasks.workunit.client.0.trial069.stdout: "last update": "Wed Feb 18 00:32:17 2026", 2026-02-18T00:32:23.362 INFO:tasks.workunit.client.0.trial069.stdout: "stale": false, 2026-02-18T00:32:23.362 INFO:tasks.workunit.client.0.trial069.stdout: "from osd": 0, 2026-02-18T00:32:23.362 INFO:tasks.workunit.client.0.trial069.stdout: "to osd": 2, 2026-02-18T00:32:23.362 INFO:tasks.workunit.client.0.trial069.stdout: "interface": "back", 2026-02-18T00:32:23.362 INFO:tasks.workunit.client.0.trial069.stdout: "average": { 2026-02-18T00:32:23.362 INFO:tasks.workunit.client.0.trial069.stdout: "1min": 0.143, 2026-02-18T00:32:23.362 INFO:tasks.workunit.client.0.trial069.stdout: "5min": 0.187, 2026-02-18T00:32:23.363 INFO:tasks.workunit.client.0.trial069.stdout: "15min": 0.167 2026-02-18T00:32:23.363 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:32:23.363 INFO:tasks.workunit.client.0.trial069.stdout: "min": { 2026-02-18T00:32:23.363 INFO:tasks.workunit.client.0.trial069.stdout: "1min": 0.129, 2026-02-18T00:32:23.363 INFO:tasks.workunit.client.0.trial069.stdout: "5min": 0.112, 2026-02-18T00:32:23.363 INFO:tasks.workunit.client.0.trial069.stdout: "15min": 0.112 2026-02-18T00:32:23.363 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:32:23.363 INFO:tasks.workunit.client.0.trial069.stdout: "max": { 2026-02-18T00:32:23.363 INFO:tasks.workunit.client.0.trial069.stdout: "1min": 0.157, 2026-02-18T00:32:23.363 INFO:tasks.workunit.client.0.trial069.stdout: "5min": 0.404, 2026-02-18T00:32:23.363 INFO:tasks.workunit.client.0.trial069.stdout: "15min": 0.404 2026-02-18T00:32:23.363 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:32:23.363 INFO:tasks.workunit.client.0.trial069.stdout: "last": 0.224 2026-02-18T00:32:23.364 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:32:23.364 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:32:23.364 INFO:tasks.workunit.client.0.trial069.stdout: "last update": "Wed Feb 18 00:32:17 2026", 2026-02-18T00:32:23.364 INFO:tasks.workunit.client.0.trial069.stdout: "stale": false, 2026-02-18T00:32:23.364 INFO:tasks.workunit.client.0.trial069.stdout: "from osd": 2, 2026-02-18T00:32:23.364 INFO:tasks.workunit.client.0.trial069.stdout: "to osd": 1, 2026-02-18T00:32:23.364 INFO:tasks.workunit.client.0.trial069.stdout: "interface": "back", 2026-02-18T00:32:23.364 INFO:tasks.workunit.client.0.trial069.stdout: "average": { 2026-02-18T00:32:23.364 INFO:tasks.workunit.client.0.trial069.stdout: "1min": 0.150, 2026-02-18T00:32:23.364 INFO:tasks.workunit.client.0.trial069.stdout: "5min": 0.175, 2026-02-18T00:32:23.364 INFO:tasks.workunit.client.0.trial069.stdout: "15min": 0.170 2026-02-18T00:32:23.364 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:32:23.364 INFO:tasks.workunit.client.0.trial069.stdout: "min": { 2026-02-18T00:32:23.365 INFO:tasks.workunit.client.0.trial069.stdout: "1min": 0.120, 2026-02-18T00:32:23.365 INFO:tasks.workunit.client.0.trial069.stdout: "5min": 0.120, 2026-02-18T00:32:23.365 INFO:tasks.workunit.client.0.trial069.stdout: "15min": 0.120 2026-02-18T00:32:23.365 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:32:23.365 INFO:tasks.workunit.client.0.trial069.stdout: "max": { 2026-02-18T00:32:23.365 INFO:tasks.workunit.client.0.trial069.stdout: "1min": 0.176, 2026-02-18T00:32:23.365 INFO:tasks.workunit.client.0.trial069.stdout: "5min": 0.250, 2026-02-18T00:32:23.365 INFO:tasks.workunit.client.0.trial069.stdout: "15min": 0.250 2026-02-18T00:32:23.365 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:32:23.365 INFO:tasks.workunit.client.0.trial069.stdout: "last": 0.116 2026-02-18T00:32:23.365 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:32:23.365 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:32:23.365 INFO:tasks.workunit.client.0.trial069.stdout: "last update": "Wed Feb 18 00:32:18 2026", 2026-02-18T00:32:23.365 INFO:tasks.workunit.client.0.trial069.stdout: "stale": false, 2026-02-18T00:32:23.366 INFO:tasks.workunit.client.0.trial069.stdout: "from osd": 1, 2026-02-18T00:32:23.366 INFO:tasks.workunit.client.0.trial069.stdout: "to osd": 0, 2026-02-18T00:32:23.366 INFO:tasks.workunit.client.0.trial069.stdout: "interface": "back", 2026-02-18T00:32:23.366 INFO:tasks.workunit.client.0.trial069.stdout: "average": { 2026-02-18T00:32:23.366 INFO:tasks.workunit.client.0.trial069.stdout: "1min": 0.121, 2026-02-18T00:32:23.366 INFO:tasks.workunit.client.0.trial069.stdout: "5min": 0.154, 2026-02-18T00:32:23.366 INFO:tasks.workunit.client.0.trial069.stdout: "15min": 0.174 2026-02-18T00:32:23.366 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:32:23.366 INFO:tasks.workunit.client.0.trial069.stdout: "min": { 2026-02-18T00:32:23.366 INFO:tasks.workunit.client.0.trial069.stdout: "1min": 0.104, 2026-02-18T00:32:23.366 INFO:tasks.workunit.client.0.trial069.stdout: "5min": 0.096, 2026-02-18T00:32:23.366 INFO:tasks.workunit.client.0.trial069.stdout: "15min": 0.096 2026-02-18T00:32:23.366 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:32:23.366 INFO:tasks.workunit.client.0.trial069.stdout: "max": { 2026-02-18T00:32:23.367 INFO:tasks.workunit.client.0.trial069.stdout: "1min": 0.134, 2026-02-18T00:32:23.367 INFO:tasks.workunit.client.0.trial069.stdout: "5min": 0.335, 2026-02-18T00:32:23.367 INFO:tasks.workunit.client.0.trial069.stdout: "15min": 0.335 2026-02-18T00:32:23.367 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:32:23.367 INFO:tasks.workunit.client.0.trial069.stdout: "last": 0.149 2026-02-18T00:32:23.367 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:32:23.367 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:32:23.367 INFO:tasks.workunit.client.0.trial069.stdout: "last update": "Wed Feb 18 00:32:17 2026", 2026-02-18T00:32:23.367 INFO:tasks.workunit.client.0.trial069.stdout: "stale": false, 2026-02-18T00:32:23.367 INFO:tasks.workunit.client.0.trial069.stdout: "from osd": 2, 2026-02-18T00:32:23.367 INFO:tasks.workunit.client.0.trial069.stdout: "to osd": 0, 2026-02-18T00:32:23.367 INFO:tasks.workunit.client.0.trial069.stdout: "interface": "back", 2026-02-18T00:32:23.367 INFO:tasks.workunit.client.0.trial069.stdout: "average": { 2026-02-18T00:32:23.368 INFO:tasks.workunit.client.0.trial069.stdout: "1min": 0.125, 2026-02-18T00:32:23.368 INFO:tasks.workunit.client.0.trial069.stdout: "5min": 0.153, 2026-02-18T00:32:23.368 INFO:tasks.workunit.client.0.trial069.stdout: "15min": 0.134 2026-02-18T00:32:23.368 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:32:23.368 INFO:tasks.workunit.client.0.trial069.stdout: "min": { 2026-02-18T00:32:23.368 INFO:tasks.workunit.client.0.trial069.stdout: "1min": 0.113, 2026-02-18T00:32:23.368 INFO:tasks.workunit.client.0.trial069.stdout: "5min": 0.108, 2026-02-18T00:32:23.368 INFO:tasks.workunit.client.0.trial069.stdout: "15min": 0.108 2026-02-18T00:32:23.368 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:32:23.368 INFO:tasks.workunit.client.0.trial069.stdout: "max": { 2026-02-18T00:32:23.368 INFO:tasks.workunit.client.0.trial069.stdout: "1min": 0.149, 2026-02-18T00:32:23.368 INFO:tasks.workunit.client.0.trial069.stdout: "5min": 0.346, 2026-02-18T00:32:23.368 INFO:tasks.workunit.client.0.trial069.stdout: "15min": 0.346 2026-02-18T00:32:23.368 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:32:23.369 INFO:tasks.workunit.client.0.trial069.stdout: "last": 0.158 2026-02-18T00:32:23.369 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:32:23.369 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:32:23.369 INFO:tasks.workunit.client.0.trial069.stdout: "last update": "Wed Feb 18 00:32:17 2026", 2026-02-18T00:32:23.369 INFO:tasks.workunit.client.0.trial069.stdout: "stale": false, 2026-02-18T00:32:23.369 INFO:tasks.workunit.client.0.trial069.stdout: "from osd": 2, 2026-02-18T00:32:23.369 INFO:tasks.workunit.client.0.trial069.stdout: "to osd": 0, 2026-02-18T00:32:23.369 INFO:tasks.workunit.client.0.trial069.stdout: "interface": "front", 2026-02-18T00:32:23.369 INFO:tasks.workunit.client.0.trial069.stdout: "average": { 2026-02-18T00:32:23.369 INFO:tasks.workunit.client.0.trial069.stdout: "1min": 0.128, 2026-02-18T00:32:23.369 INFO:tasks.workunit.client.0.trial069.stdout: "5min": 0.149, 2026-02-18T00:32:23.369 INFO:tasks.workunit.client.0.trial069.stdout: "15min": 0.145 2026-02-18T00:32:23.369 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:32:23.369 INFO:tasks.workunit.client.0.trial069.stdout: "min": { 2026-02-18T00:32:23.370 INFO:tasks.workunit.client.0.trial069.stdout: "1min": 0.104, 2026-02-18T00:32:23.370 INFO:tasks.workunit.client.0.trial069.stdout: "5min": 0.104, 2026-02-18T00:32:23.370 INFO:tasks.workunit.client.0.trial069.stdout: "15min": 0.104 2026-02-18T00:32:23.370 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:32:23.370 INFO:tasks.workunit.client.0.trial069.stdout: "max": { 2026-02-18T00:32:23.370 INFO:tasks.workunit.client.0.trial069.stdout: "1min": 0.147, 2026-02-18T00:32:23.370 INFO:tasks.workunit.client.0.trial069.stdout: "5min": 0.208, 2026-02-18T00:32:23.370 INFO:tasks.workunit.client.0.trial069.stdout: "15min": 0.208 2026-02-18T00:32:23.370 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:32:23.370 INFO:tasks.workunit.client.0.trial069.stdout: "last": 0.124 2026-02-18T00:32:23.370 INFO:tasks.workunit.client.0.trial069.stdout: } 2026-02-18T00:32:23.370 INFO:tasks.workunit.client.0.trial069.stdout: ] 2026-02-18T00:32:23.370 INFO:tasks.workunit.client.0.trial069.stdout:} 2026-02-18T00:32:23.371 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:57: TEST_network_ping_test1: cat td/network-ping/json 2026-02-18T00:32:23.372 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:57: TEST_network_ping_test1: jq '.entries | length' 2026-02-18T00:32:23.372 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:57: TEST_network_ping_test1: test 12 = 12 2026-02-18T00:32:23.372 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:58: TEST_network_ping_test1: cat td/network-ping/json 2026-02-18T00:32:23.372 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:58: TEST_network_ping_test1: jq .threshold 2026-02-18T00:32:23.379 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:58: TEST_network_ping_test1: test 0 = 0 2026-02-18T00:32:23.379 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:61: TEST_network_ping_test1: sleep 20 2026-02-18T00:32:43.382 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:62: TEST_network_ping_test1: flush_pg_stats 2026-02-18T00:32:43.383 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-18T00:32:43.384 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-18T00:32:43.593 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-18T00:32:43.593 INFO:tasks.workunit.client.0.trial069.stderr:1 2026-02-18T00:32:43.593 INFO:tasks.workunit.client.0.trial069.stderr:2' 2026-02-18T00:32:43.594 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-18T00:32:43.594 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:32:43.594 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-18T00:32:43.670 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836496 2026-02-18T00:32:43.670 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836496 2026-02-18T00:32:43.670 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836496' 2026-02-18T00:32:43.671 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:32:43.671 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-18T00:32:43.749 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705680 2026-02-18T00:32:43.749 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705680 2026-02-18T00:32:43.749 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836496 1-38654705680' 2026-02-18T00:32:43.749 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:32:43.749 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-18T00:32:43.826 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574863 2026-02-18T00:32:43.826 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574863 2026-02-18T00:32:43.826 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836496 1-38654705680 2-55834574863' 2026-02-18T00:32:43.826 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:32:43.826 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836496 2026-02-18T00:32:43.827 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:32:43.827 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-18T00:32:43.828 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-21474836496 2026-02-18T00:32:43.828 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:32:43.829 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=21474836496 2026-02-18T00:32:43.830 INFO:tasks.workunit.client.0.trial069.stdout:waiting osd.0 seq 21474836496 2026-02-18T00:32:43.830 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 21474836496' 2026-02-18T00:32:43.830 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T00:32:44.040 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 21474836496 -lt 21474836496 2026-02-18T00:32:44.040 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:32:44.041 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705680 2026-02-18T00:32:44.041 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:32:44.042 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=1 2026-02-18T00:32:44.043 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 1-38654705680 2026-02-18T00:32:44.043 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:32:44.044 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=38654705680 2026-02-18T00:32:44.045 INFO:tasks.workunit.client.0.trial069.stdout:waiting osd.1 seq 38654705680 2026-02-18T00:32:44.045 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.1 seq 38654705680' 2026-02-18T00:32:44.045 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-18T00:32:44.257 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 38654705680 -lt 38654705680 2026-02-18T00:32:44.257 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:32:44.257 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574863 2026-02-18T00:32:44.258 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:32:44.259 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=2 2026-02-18T00:32:44.260 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 2-55834574863 2026-02-18T00:32:44.260 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:32:44.261 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=55834574863 2026-02-18T00:32:44.261 INFO:tasks.workunit.client.0.trial069.stdout:waiting osd.2 seq 55834574863 2026-02-18T00:32:44.262 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.2 seq 55834574863' 2026-02-18T00:32:44.262 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-18T00:32:44.469 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 55834574861 -lt 55834574863 2026-02-18T00:32:44.469 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-18T00:32:45.470 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-18T00:32:45.471 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-18T00:32:45.687 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 55834574861 -lt 55834574863 2026-02-18T00:32:45.688 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-18T00:32:46.689 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-18T00:32:46.689 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-18T00:32:46.903 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 55834574863 -lt 55834574863 2026-02-18T00:32:46.904 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:63: TEST_network_ping_test1: tee td/network-ping/json 2026-02-18T00:32:46.904 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:63: TEST_network_ping_test1: get_asok_path osd.0 2026-02-18T00:32:46.904 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-18T00:32:46.904 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-18T00:32:46.904 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:32:46.904 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:32:46.904 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.24589 2026-02-18T00:32:46.905 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.24589/ceph-osd.0.asok 2026-02-18T00:32:46.905 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:63: TEST_network_ping_test1: CEPH_ARGS= 2026-02-18T00:32:46.905 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:63: TEST_network_ping_test1: ceph daemon /tmp/ceph-asok.24589/ceph-osd.0.asok dump_osd_network 2026-02-18T00:32:46.961 INFO:tasks.workunit.client.0.trial069.stdout:{ 2026-02-18T00:32:46.961 INFO:tasks.workunit.client.0.trial069.stdout: "threshold": 1000, 2026-02-18T00:32:46.961 INFO:tasks.workunit.client.0.trial069.stdout: "entries": [] 2026-02-18T00:32:46.961 INFO:tasks.workunit.client.0.trial069.stdout:} 2026-02-18T00:32:46.967 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:64: TEST_network_ping_test1: cat td/network-ping/json 2026-02-18T00:32:46.968 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:64: TEST_network_ping_test1: jq '.entries | length' 2026-02-18T00:32:46.979 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:64: TEST_network_ping_test1: test 0 = 0 2026-02-18T00:32:46.980 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:65: TEST_network_ping_test1: cat td/network-ping/json 2026-02-18T00:32:46.980 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:65: TEST_network_ping_test1: jq .threshold 2026-02-18T00:32:46.989 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:65: TEST_network_ping_test1: test 1000 = 1000 2026-02-18T00:32:46.989 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:67: TEST_network_ping_test1: tee td/network-ping/json 2026-02-18T00:32:46.991 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:67: TEST_network_ping_test1: get_asok_path mgr.x 2026-02-18T00:32:46.991 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mgr.x 2026-02-18T00:32:46.991 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mgr.x ']' 2026-02-18T00:32:46.991 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:32:46.991 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:32:46.991 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.24589 2026-02-18T00:32:46.992 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.24589/ceph-mgr.x.asok 2026-02-18T00:32:46.992 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:67: TEST_network_ping_test1: CEPH_ARGS= 2026-02-18T00:32:46.992 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:67: TEST_network_ping_test1: ceph daemon /tmp/ceph-asok.24589/ceph-mgr.x.asok dump_osd_network 2026-02-18T00:32:47.039 INFO:tasks.workunit.client.0.trial069.stdout:{ 2026-02-18T00:32:47.039 INFO:tasks.workunit.client.0.trial069.stdout: "threshold": 1000, 2026-02-18T00:32:47.039 INFO:tasks.workunit.client.0.trial069.stdout: "entries": [] 2026-02-18T00:32:47.039 INFO:tasks.workunit.client.0.trial069.stdout:} 2026-02-18T00:32:47.046 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:68: TEST_network_ping_test1: cat td/network-ping/json 2026-02-18T00:32:47.046 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:68: TEST_network_ping_test1: jq '.entries | length' 2026-02-18T00:32:47.056 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:68: TEST_network_ping_test1: test 0 = 0 2026-02-18T00:32:47.057 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:69: TEST_network_ping_test1: cat td/network-ping/json 2026-02-18T00:32:47.057 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:69: TEST_network_ping_test1: jq .threshold 2026-02-18T00:32:47.067 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:69: TEST_network_ping_test1: test 1000 = 1000 2026-02-18T00:32:47.067 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:71: TEST_network_ping_test1: tee td/network-ping/json 2026-02-18T00:32:47.068 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:71: TEST_network_ping_test1: get_asok_path osd.0 2026-02-18T00:32:47.068 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-18T00:32:47.068 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-18T00:32:47.069 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:32:47.069 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:32:47.069 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.24589 2026-02-18T00:32:47.069 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.24589/ceph-osd.0.asok 2026-02-18T00:32:47.069 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:71: TEST_network_ping_test1: CEPH_ARGS= 2026-02-18T00:32:47.070 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:71: TEST_network_ping_test1: ceph daemon /tmp/ceph-asok.24589/ceph-osd.0.asok dump_osd_network 0 2026-02-18T00:32:47.122 INFO:tasks.workunit.client.0.trial069.stdout:{ 2026-02-18T00:32:47.122 INFO:tasks.workunit.client.0.trial069.stdout: "threshold": 0, 2026-02-18T00:32:47.122 INFO:tasks.workunit.client.0.trial069.stdout: "entries": [ 2026-02-18T00:32:47.122 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:32:47.122 INFO:tasks.workunit.client.0.trial069.stdout: "last update": "Wed Feb 18 00:32:44 2026", 2026-02-18T00:32:47.122 INFO:tasks.workunit.client.0.trial069.stdout: "stale": false, 2026-02-18T00:32:47.122 INFO:tasks.workunit.client.0.trial069.stdout: "from osd": 0, 2026-02-18T00:32:47.122 INFO:tasks.workunit.client.0.trial069.stdout: "to osd": 1, 2026-02-18T00:32:47.123 INFO:tasks.workunit.client.0.trial069.stdout: "interface": "front", 2026-02-18T00:32:47.123 INFO:tasks.workunit.client.0.trial069.stdout: "average": { 2026-02-18T00:32:47.123 INFO:tasks.workunit.client.0.trial069.stdout: "1min": 0.173, 2026-02-18T00:32:47.123 INFO:tasks.workunit.client.0.trial069.stdout: "5min": 0.166, 2026-02-18T00:32:47.123 INFO:tasks.workunit.client.0.trial069.stdout: "15min": 0.273 2026-02-18T00:32:47.123 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:32:47.123 INFO:tasks.workunit.client.0.trial069.stdout: "min": { 2026-02-18T00:32:47.123 INFO:tasks.workunit.client.0.trial069.stdout: "1min": 0.206, 2026-02-18T00:32:47.123 INFO:tasks.workunit.client.0.trial069.stdout: "5min": 0.238, 2026-02-18T00:32:47.123 INFO:tasks.workunit.client.0.trial069.stdout: "15min": 1.582 2026-02-18T00:32:47.123 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:32:47.124 INFO:tasks.workunit.client.0.trial069.stdout: "max": { 2026-02-18T00:32:47.124 INFO:tasks.workunit.client.0.trial069.stdout: "1min": 0.206, 2026-02-18T00:32:47.124 INFO:tasks.workunit.client.0.trial069.stdout: "5min": 0.238, 2026-02-18T00:32:47.124 INFO:tasks.workunit.client.0.trial069.stdout: "15min": 1.582 2026-02-18T00:32:47.124 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:32:47.124 INFO:tasks.workunit.client.0.trial069.stdout: "last": 0.209 2026-02-18T00:32:47.124 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:32:47.124 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:32:47.124 INFO:tasks.workunit.client.0.trial069.stdout: "last update": "Wed Feb 18 00:32:42 2026", 2026-02-18T00:32:47.124 INFO:tasks.workunit.client.0.trial069.stdout: "stale": false, 2026-02-18T00:32:47.124 INFO:tasks.workunit.client.0.trial069.stdout: "from osd": 0, 2026-02-18T00:32:47.124 INFO:tasks.workunit.client.0.trial069.stdout: "to osd": 2, 2026-02-18T00:32:47.125 INFO:tasks.workunit.client.0.trial069.stdout: "interface": "front", 2026-02-18T00:32:47.125 INFO:tasks.workunit.client.0.trial069.stdout: "average": { 2026-02-18T00:32:47.125 INFO:tasks.workunit.client.0.trial069.stdout: "1min": 0.154, 2026-02-18T00:32:47.125 INFO:tasks.workunit.client.0.trial069.stdout: "5min": 0.172, 2026-02-18T00:32:47.125 INFO:tasks.workunit.client.0.trial069.stdout: "15min": 0.184 2026-02-18T00:32:47.125 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:32:47.125 INFO:tasks.workunit.client.0.trial069.stdout: "min": { 2026-02-18T00:32:47.125 INFO:tasks.workunit.client.0.trial069.stdout: "1min": 0.172, 2026-02-18T00:32:47.125 INFO:tasks.workunit.client.0.trial069.stdout: "5min": 0.255, 2026-02-18T00:32:47.125 INFO:tasks.workunit.client.0.trial069.stdout: "15min": 0.325 2026-02-18T00:32:47.125 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:32:47.125 INFO:tasks.workunit.client.0.trial069.stdout: "max": { 2026-02-18T00:32:47.126 INFO:tasks.workunit.client.0.trial069.stdout: "1min": 0.172, 2026-02-18T00:32:47.126 INFO:tasks.workunit.client.0.trial069.stdout: "5min": 0.255, 2026-02-18T00:32:47.126 INFO:tasks.workunit.client.0.trial069.stdout: "15min": 0.325 2026-02-18T00:32:47.126 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:32:47.126 INFO:tasks.workunit.client.0.trial069.stdout: "last": 0.197 2026-02-18T00:32:47.126 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:32:47.126 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:32:47.126 INFO:tasks.workunit.client.0.trial069.stdout: "last update": "Wed Feb 18 00:32:44 2026", 2026-02-18T00:32:47.127 INFO:tasks.workunit.client.0.trial069.stdout: "stale": false, 2026-02-18T00:32:47.127 INFO:tasks.workunit.client.0.trial069.stdout: "from osd": 0, 2026-02-18T00:32:47.127 INFO:tasks.workunit.client.0.trial069.stdout: "to osd": 1, 2026-02-18T00:32:47.127 INFO:tasks.workunit.client.0.trial069.stdout: "interface": "back", 2026-02-18T00:32:47.127 INFO:tasks.workunit.client.0.trial069.stdout: "average": { 2026-02-18T00:32:47.127 INFO:tasks.workunit.client.0.trial069.stdout: "1min": 0.152, 2026-02-18T00:32:47.127 INFO:tasks.workunit.client.0.trial069.stdout: "5min": 0.150, 2026-02-18T00:32:47.127 INFO:tasks.workunit.client.0.trial069.stdout: "15min": 0.178 2026-02-18T00:32:47.127 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:32:47.128 INFO:tasks.workunit.client.0.trial069.stdout: "min": { 2026-02-18T00:32:47.128 INFO:tasks.workunit.client.0.trial069.stdout: "1min": 0.193, 2026-02-18T00:32:47.128 INFO:tasks.workunit.client.0.trial069.stdout: "5min": 0.215, 2026-02-18T00:32:47.128 INFO:tasks.workunit.client.0.trial069.stdout: "15min": 0.511 2026-02-18T00:32:47.128 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:32:47.128 INFO:tasks.workunit.client.0.trial069.stdout: "max": { 2026-02-18T00:32:47.128 INFO:tasks.workunit.client.0.trial069.stdout: "1min": 0.193, 2026-02-18T00:32:47.128 INFO:tasks.workunit.client.0.trial069.stdout: "5min": 0.215, 2026-02-18T00:32:47.128 INFO:tasks.workunit.client.0.trial069.stdout: "15min": 0.511 2026-02-18T00:32:47.128 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:32:47.128 INFO:tasks.workunit.client.0.trial069.stdout: "last": 0.171 2026-02-18T00:32:47.128 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:32:47.129 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:32:47.129 INFO:tasks.workunit.client.0.trial069.stdout: "last update": "Wed Feb 18 00:32:42 2026", 2026-02-18T00:32:47.129 INFO:tasks.workunit.client.0.trial069.stdout: "stale": false, 2026-02-18T00:32:47.129 INFO:tasks.workunit.client.0.trial069.stdout: "from osd": 0, 2026-02-18T00:32:47.129 INFO:tasks.workunit.client.0.trial069.stdout: "to osd": 2, 2026-02-18T00:32:47.129 INFO:tasks.workunit.client.0.trial069.stdout: "interface": "back", 2026-02-18T00:32:47.129 INFO:tasks.workunit.client.0.trial069.stdout: "average": { 2026-02-18T00:32:47.129 INFO:tasks.workunit.client.0.trial069.stdout: "1min": 0.140, 2026-02-18T00:32:47.129 INFO:tasks.workunit.client.0.trial069.stdout: "5min": 0.158, 2026-02-18T00:32:47.129 INFO:tasks.workunit.client.0.trial069.stdout: "15min": 0.167 2026-02-18T00:32:47.129 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:32:47.129 INFO:tasks.workunit.client.0.trial069.stdout: "min": { 2026-02-18T00:32:47.129 INFO:tasks.workunit.client.0.trial069.stdout: "1min": 0.156, 2026-02-18T00:32:47.130 INFO:tasks.workunit.client.0.trial069.stdout: "5min": 0.252, 2026-02-18T00:32:47.130 INFO:tasks.workunit.client.0.trial069.stdout: "15min": 0.404 2026-02-18T00:32:47.130 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:32:47.130 INFO:tasks.workunit.client.0.trial069.stdout: "max": { 2026-02-18T00:32:47.130 INFO:tasks.workunit.client.0.trial069.stdout: "1min": 0.156, 2026-02-18T00:32:47.130 INFO:tasks.workunit.client.0.trial069.stdout: "5min": 0.252, 2026-02-18T00:32:47.130 INFO:tasks.workunit.client.0.trial069.stdout: "15min": 0.404 2026-02-18T00:32:47.130 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:32:47.130 INFO:tasks.workunit.client.0.trial069.stdout: "last": 0.186 2026-02-18T00:32:47.130 INFO:tasks.workunit.client.0.trial069.stdout: } 2026-02-18T00:32:47.130 INFO:tasks.workunit.client.0.trial069.stdout: ] 2026-02-18T00:32:47.130 INFO:tasks.workunit.client.0.trial069.stdout:} 2026-02-18T00:32:47.131 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:72: TEST_network_ping_test1: cat td/network-ping/json 2026-02-18T00:32:47.131 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:72: TEST_network_ping_test1: jq '.entries | length' 2026-02-18T00:32:47.139 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:72: TEST_network_ping_test1: test 4 = 4 2026-02-18T00:32:47.140 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:73: TEST_network_ping_test1: cat td/network-ping/json 2026-02-18T00:32:47.140 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:73: TEST_network_ping_test1: jq .threshold 2026-02-18T00:32:47.151 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:73: TEST_network_ping_test1: test 0 = 0 2026-02-18T00:32:47.152 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:75: TEST_network_ping_test1: tee td/network-ping/json 2026-02-18T00:32:47.153 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:75: TEST_network_ping_test1: get_asok_path mgr.x 2026-02-18T00:32:47.153 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mgr.x 2026-02-18T00:32:47.153 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mgr.x ']' 2026-02-18T00:32:47.154 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:32:47.154 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:32:47.154 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.24589 2026-02-18T00:32:47.154 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.24589/ceph-mgr.x.asok 2026-02-18T00:32:47.154 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:75: TEST_network_ping_test1: CEPH_ARGS= 2026-02-18T00:32:47.154 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:75: TEST_network_ping_test1: ceph daemon /tmp/ceph-asok.24589/ceph-mgr.x.asok dump_osd_network 0 2026-02-18T00:32:47.201 INFO:tasks.workunit.client.0.trial069.stdout:{ 2026-02-18T00:32:47.201 INFO:tasks.workunit.client.0.trial069.stdout: "threshold": 0, 2026-02-18T00:32:47.201 INFO:tasks.workunit.client.0.trial069.stdout: "entries": [ 2026-02-18T00:32:47.201 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:32:47.201 INFO:tasks.workunit.client.0.trial069.stdout: "last update": "Wed Feb 18 00:32:44 2026", 2026-02-18T00:32:47.201 INFO:tasks.workunit.client.0.trial069.stdout: "stale": false, 2026-02-18T00:32:47.201 INFO:tasks.workunit.client.0.trial069.stdout: "from osd": 0, 2026-02-18T00:32:47.201 INFO:tasks.workunit.client.0.trial069.stdout: "to osd": 1, 2026-02-18T00:32:47.201 INFO:tasks.workunit.client.0.trial069.stdout: "interface": "front", 2026-02-18T00:32:47.201 INFO:tasks.workunit.client.0.trial069.stdout: "average": { 2026-02-18T00:32:47.201 INFO:tasks.workunit.client.0.trial069.stdout: "1min": 0.173, 2026-02-18T00:32:47.201 INFO:tasks.workunit.client.0.trial069.stdout: "5min": 0.166, 2026-02-18T00:32:47.201 INFO:tasks.workunit.client.0.trial069.stdout: "15min": 0.273 2026-02-18T00:32:47.201 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:32:47.201 INFO:tasks.workunit.client.0.trial069.stdout: "min": { 2026-02-18T00:32:47.201 INFO:tasks.workunit.client.0.trial069.stdout: "1min": 0.149, 2026-02-18T00:32:47.201 INFO:tasks.workunit.client.0.trial069.stdout: "5min": 0.119, 2026-02-18T00:32:47.201 INFO:tasks.workunit.client.0.trial069.stdout: "15min": 0.114 2026-02-18T00:32:47.201 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:32:47.201 INFO:tasks.workunit.client.0.trial069.stdout: "max": { 2026-02-18T00:32:47.201 INFO:tasks.workunit.client.0.trial069.stdout: "1min": 0.206, 2026-02-18T00:32:47.201 INFO:tasks.workunit.client.0.trial069.stdout: "5min": 0.238, 2026-02-18T00:32:47.201 INFO:tasks.workunit.client.0.trial069.stdout: "15min": 1.582 2026-02-18T00:32:47.201 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:32:47.201 INFO:tasks.workunit.client.0.trial069.stdout: "last": 0.206 2026-02-18T00:32:47.201 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:32:47.201 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:32:47.201 INFO:tasks.workunit.client.0.trial069.stdout: "last update": "Wed Feb 18 00:32:42 2026", 2026-02-18T00:32:47.201 INFO:tasks.workunit.client.0.trial069.stdout: "stale": false, 2026-02-18T00:32:47.201 INFO:tasks.workunit.client.0.trial069.stdout: "from osd": 2, 2026-02-18T00:32:47.201 INFO:tasks.workunit.client.0.trial069.stdout: "to osd": 1, 2026-02-18T00:32:47.201 INFO:tasks.workunit.client.0.trial069.stdout: "interface": "front", 2026-02-18T00:32:47.201 INFO:tasks.workunit.client.0.trial069.stdout: "average": { 2026-02-18T00:32:47.201 INFO:tasks.workunit.client.0.trial069.stdout: "1min": 0.138, 2026-02-18T00:32:47.202 INFO:tasks.workunit.client.0.trial069.stdout: "5min": 0.146, 2026-02-18T00:32:47.202 INFO:tasks.workunit.client.0.trial069.stdout: "15min": 0.190 2026-02-18T00:32:47.202 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:32:47.202 INFO:tasks.workunit.client.0.trial069.stdout: "min": { 2026-02-18T00:32:47.202 INFO:tasks.workunit.client.0.trial069.stdout: "1min": 0.117, 2026-02-18T00:32:47.202 INFO:tasks.workunit.client.0.trial069.stdout: "5min": 0.117, 2026-02-18T00:32:47.202 INFO:tasks.workunit.client.0.trial069.stdout: "15min": 0.106 2026-02-18T00:32:47.202 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:32:47.202 INFO:tasks.workunit.client.0.trial069.stdout: "max": { 2026-02-18T00:32:47.202 INFO:tasks.workunit.client.0.trial069.stdout: "1min": 0.159, 2026-02-18T00:32:47.202 INFO:tasks.workunit.client.0.trial069.stdout: "5min": 0.189, 2026-02-18T00:32:47.202 INFO:tasks.workunit.client.0.trial069.stdout: "15min": 0.554 2026-02-18T00:32:47.202 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:32:47.202 INFO:tasks.workunit.client.0.trial069.stdout: "last": 0.162 2026-02-18T00:32:47.202 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:32:47.202 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:32:47.202 INFO:tasks.workunit.client.0.trial069.stdout: "last update": "Wed Feb 18 00:32:42 2026", 2026-02-18T00:32:47.202 INFO:tasks.workunit.client.0.trial069.stdout: "stale": false, 2026-02-18T00:32:47.202 INFO:tasks.workunit.client.0.trial069.stdout: "from osd": 0, 2026-02-18T00:32:47.202 INFO:tasks.workunit.client.0.trial069.stdout: "to osd": 2, 2026-02-18T00:32:47.202 INFO:tasks.workunit.client.0.trial069.stdout: "interface": "front", 2026-02-18T00:32:47.202 INFO:tasks.workunit.client.0.trial069.stdout: "average": { 2026-02-18T00:32:47.202 INFO:tasks.workunit.client.0.trial069.stdout: "1min": 0.154, 2026-02-18T00:32:47.202 INFO:tasks.workunit.client.0.trial069.stdout: "5min": 0.172, 2026-02-18T00:32:47.202 INFO:tasks.workunit.client.0.trial069.stdout: "15min": 0.184 2026-02-18T00:32:47.202 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:32:47.202 INFO:tasks.workunit.client.0.trial069.stdout: "min": { 2026-02-18T00:32:47.202 INFO:tasks.workunit.client.0.trial069.stdout: "1min": 0.132, 2026-02-18T00:32:47.202 INFO:tasks.workunit.client.0.trial069.stdout: "5min": 0.127, 2026-02-18T00:32:47.202 INFO:tasks.workunit.client.0.trial069.stdout: "15min": 0.108 2026-02-18T00:32:47.202 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:32:47.202 INFO:tasks.workunit.client.0.trial069.stdout: "max": { 2026-02-18T00:32:47.202 INFO:tasks.workunit.client.0.trial069.stdout: "1min": 0.172, 2026-02-18T00:32:47.202 INFO:tasks.workunit.client.0.trial069.stdout: "5min": 0.255, 2026-02-18T00:32:47.202 INFO:tasks.workunit.client.0.trial069.stdout: "15min": 0.325 2026-02-18T00:32:47.202 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:32:47.202 INFO:tasks.workunit.client.0.trial069.stdout: "last": 0.226 2026-02-18T00:32:47.202 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:32:47.202 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:32:47.202 INFO:tasks.workunit.client.0.trial069.stdout: "last update": "Wed Feb 18 00:32:43 2026", 2026-02-18T00:32:47.202 INFO:tasks.workunit.client.0.trial069.stdout: "stale": false, 2026-02-18T00:32:47.202 INFO:tasks.workunit.client.0.trial069.stdout: "from osd": 1, 2026-02-18T00:32:47.202 INFO:tasks.workunit.client.0.trial069.stdout: "to osd": 0, 2026-02-18T00:32:47.203 INFO:tasks.workunit.client.0.trial069.stdout: "interface": "front", 2026-02-18T00:32:47.203 INFO:tasks.workunit.client.0.trial069.stdout: "average": { 2026-02-18T00:32:47.203 INFO:tasks.workunit.client.0.trial069.stdout: "1min": 0.122, 2026-02-18T00:32:47.203 INFO:tasks.workunit.client.0.trial069.stdout: "5min": 0.149, 2026-02-18T00:32:47.203 INFO:tasks.workunit.client.0.trial069.stdout: "15min": 0.182 2026-02-18T00:32:47.203 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:32:47.203 INFO:tasks.workunit.client.0.trial069.stdout: "min": { 2026-02-18T00:32:47.203 INFO:tasks.workunit.client.0.trial069.stdout: "1min": 0.104, 2026-02-18T00:32:47.203 INFO:tasks.workunit.client.0.trial069.stdout: "5min": 0.104, 2026-02-18T00:32:47.203 INFO:tasks.workunit.client.0.trial069.stdout: "15min": 0.103 2026-02-18T00:32:47.203 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:32:47.203 INFO:tasks.workunit.client.0.trial069.stdout: "max": { 2026-02-18T00:32:47.203 INFO:tasks.workunit.client.0.trial069.stdout: "1min": 0.151, 2026-02-18T00:32:47.203 INFO:tasks.workunit.client.0.trial069.stdout: "5min": 0.206, 2026-02-18T00:32:47.203 INFO:tasks.workunit.client.0.trial069.stdout: "15min": 0.420 2026-02-18T00:32:47.203 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:32:47.203 INFO:tasks.workunit.client.0.trial069.stdout: "last": 0.111 2026-02-18T00:32:47.203 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:32:47.203 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:32:47.203 INFO:tasks.workunit.client.0.trial069.stdout: "last update": "Wed Feb 18 00:32:43 2026", 2026-02-18T00:32:47.203 INFO:tasks.workunit.client.0.trial069.stdout: "stale": false, 2026-02-18T00:32:47.203 INFO:tasks.workunit.client.0.trial069.stdout: "from osd": 1, 2026-02-18T00:32:47.203 INFO:tasks.workunit.client.0.trial069.stdout: "to osd": 2, 2026-02-18T00:32:47.203 INFO:tasks.workunit.client.0.trial069.stdout: "interface": "back", 2026-02-18T00:32:47.203 INFO:tasks.workunit.client.0.trial069.stdout: "average": { 2026-02-18T00:32:47.203 INFO:tasks.workunit.client.0.trial069.stdout: "1min": 0.149, 2026-02-18T00:32:47.203 INFO:tasks.workunit.client.0.trial069.stdout: "5min": 0.160, 2026-02-18T00:32:47.203 INFO:tasks.workunit.client.0.trial069.stdout: "15min": 0.181 2026-02-18T00:32:47.203 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:32:47.203 INFO:tasks.workunit.client.0.trial069.stdout: "min": { 2026-02-18T00:32:47.203 INFO:tasks.workunit.client.0.trial069.stdout: "1min": 0.122, 2026-02-18T00:32:47.203 INFO:tasks.workunit.client.0.trial069.stdout: "5min": 0.122, 2026-02-18T00:32:47.203 INFO:tasks.workunit.client.0.trial069.stdout: "15min": 0.122 2026-02-18T00:32:47.203 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:32:47.203 INFO:tasks.workunit.client.0.trial069.stdout: "max": { 2026-02-18T00:32:47.203 INFO:tasks.workunit.client.0.trial069.stdout: "1min": 0.169, 2026-02-18T00:32:47.203 INFO:tasks.workunit.client.0.trial069.stdout: "5min": 0.227, 2026-02-18T00:32:47.203 INFO:tasks.workunit.client.0.trial069.stdout: "15min": 0.381 2026-02-18T00:32:47.203 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:32:47.203 INFO:tasks.workunit.client.0.trial069.stdout: "last": 0.164 2026-02-18T00:32:47.203 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:32:47.203 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:32:47.203 INFO:tasks.workunit.client.0.trial069.stdout: "last update": "Wed Feb 18 00:32:43 2026", 2026-02-18T00:32:47.203 INFO:tasks.workunit.client.0.trial069.stdout: "stale": false, 2026-02-18T00:32:47.204 INFO:tasks.workunit.client.0.trial069.stdout: "from osd": 1, 2026-02-18T00:32:47.204 INFO:tasks.workunit.client.0.trial069.stdout: "to osd": 2, 2026-02-18T00:32:47.204 INFO:tasks.workunit.client.0.trial069.stdout: "interface": "front", 2026-02-18T00:32:47.204 INFO:tasks.workunit.client.0.trial069.stdout: "average": { 2026-02-18T00:32:47.204 INFO:tasks.workunit.client.0.trial069.stdout: "1min": 0.163, 2026-02-18T00:32:47.204 INFO:tasks.workunit.client.0.trial069.stdout: "5min": 0.176, 2026-02-18T00:32:47.204 INFO:tasks.workunit.client.0.trial069.stdout: "15min": 0.179 2026-02-18T00:32:47.204 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:32:47.204 INFO:tasks.workunit.client.0.trial069.stdout: "min": { 2026-02-18T00:32:47.204 INFO:tasks.workunit.client.0.trial069.stdout: "1min": 0.122, 2026-02-18T00:32:47.204 INFO:tasks.workunit.client.0.trial069.stdout: "5min": 0.122, 2026-02-18T00:32:47.204 INFO:tasks.workunit.client.0.trial069.stdout: "15min": 0.122 2026-02-18T00:32:47.204 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:32:47.204 INFO:tasks.workunit.client.0.trial069.stdout: "max": { 2026-02-18T00:32:47.204 INFO:tasks.workunit.client.0.trial069.stdout: "1min": 0.185, 2026-02-18T00:32:47.204 INFO:tasks.workunit.client.0.trial069.stdout: "5min": 0.243, 2026-02-18T00:32:47.204 INFO:tasks.workunit.client.0.trial069.stdout: "15min": 0.475 2026-02-18T00:32:47.204 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:32:47.204 INFO:tasks.workunit.client.0.trial069.stdout: "last": 0.174 2026-02-18T00:32:47.204 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:32:47.204 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:32:47.204 INFO:tasks.workunit.client.0.trial069.stdout: "last update": "Wed Feb 18 00:32:44 2026", 2026-02-18T00:32:47.204 INFO:tasks.workunit.client.0.trial069.stdout: "stale": false, 2026-02-18T00:32:47.204 INFO:tasks.workunit.client.0.trial069.stdout: "from osd": 0, 2026-02-18T00:32:47.204 INFO:tasks.workunit.client.0.trial069.stdout: "to osd": 1, 2026-02-18T00:32:47.204 INFO:tasks.workunit.client.0.trial069.stdout: "interface": "back", 2026-02-18T00:32:47.204 INFO:tasks.workunit.client.0.trial069.stdout: "average": { 2026-02-18T00:32:47.204 INFO:tasks.workunit.client.0.trial069.stdout: "1min": 0.152, 2026-02-18T00:32:47.204 INFO:tasks.workunit.client.0.trial069.stdout: "5min": 0.150, 2026-02-18T00:32:47.204 INFO:tasks.workunit.client.0.trial069.stdout: "15min": 0.178 2026-02-18T00:32:47.204 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:32:47.204 INFO:tasks.workunit.client.0.trial069.stdout: "min": { 2026-02-18T00:32:47.204 INFO:tasks.workunit.client.0.trial069.stdout: "1min": 0.122, 2026-02-18T00:32:47.204 INFO:tasks.workunit.client.0.trial069.stdout: "5min": 0.122, 2026-02-18T00:32:47.204 INFO:tasks.workunit.client.0.trial069.stdout: "15min": 0.093 2026-02-18T00:32:47.204 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:32:47.204 INFO:tasks.workunit.client.0.trial069.stdout: "max": { 2026-02-18T00:32:47.204 INFO:tasks.workunit.client.0.trial069.stdout: "1min": 0.193, 2026-02-18T00:32:47.204 INFO:tasks.workunit.client.0.trial069.stdout: "5min": 0.215, 2026-02-18T00:32:47.204 INFO:tasks.workunit.client.0.trial069.stdout: "15min": 0.511 2026-02-18T00:32:47.204 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:32:47.204 INFO:tasks.workunit.client.0.trial069.stdout: "last": 0.172 2026-02-18T00:32:47.204 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:32:47.205 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:32:47.205 INFO:tasks.workunit.client.0.trial069.stdout: "last update": "Wed Feb 18 00:32:42 2026", 2026-02-18T00:32:47.205 INFO:tasks.workunit.client.0.trial069.stdout: "stale": false, 2026-02-18T00:32:47.205 INFO:tasks.workunit.client.0.trial069.stdout: "from osd": 0, 2026-02-18T00:32:47.205 INFO:tasks.workunit.client.0.trial069.stdout: "to osd": 2, 2026-02-18T00:32:47.205 INFO:tasks.workunit.client.0.trial069.stdout: "interface": "back", 2026-02-18T00:32:47.205 INFO:tasks.workunit.client.0.trial069.stdout: "average": { 2026-02-18T00:32:47.205 INFO:tasks.workunit.client.0.trial069.stdout: "1min": 0.140, 2026-02-18T00:32:47.205 INFO:tasks.workunit.client.0.trial069.stdout: "5min": 0.158, 2026-02-18T00:32:47.205 INFO:tasks.workunit.client.0.trial069.stdout: "15min": 0.167 2026-02-18T00:32:47.205 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:32:47.205 INFO:tasks.workunit.client.0.trial069.stdout: "min": { 2026-02-18T00:32:47.205 INFO:tasks.workunit.client.0.trial069.stdout: "1min": 0.126, 2026-02-18T00:32:47.205 INFO:tasks.workunit.client.0.trial069.stdout: "5min": 0.118, 2026-02-18T00:32:47.205 INFO:tasks.workunit.client.0.trial069.stdout: "15min": 0.112 2026-02-18T00:32:47.205 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:32:47.205 INFO:tasks.workunit.client.0.trial069.stdout: "max": { 2026-02-18T00:32:47.205 INFO:tasks.workunit.client.0.trial069.stdout: "1min": 0.156, 2026-02-18T00:32:47.205 INFO:tasks.workunit.client.0.trial069.stdout: "5min": 0.252, 2026-02-18T00:32:47.205 INFO:tasks.workunit.client.0.trial069.stdout: "15min": 0.404 2026-02-18T00:32:47.205 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:32:47.205 INFO:tasks.workunit.client.0.trial069.stdout: "last": 0.192 2026-02-18T00:32:47.205 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:32:47.205 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:32:47.205 INFO:tasks.workunit.client.0.trial069.stdout: "last update": "Wed Feb 18 00:32:43 2026", 2026-02-18T00:32:47.205 INFO:tasks.workunit.client.0.trial069.stdout: "stale": false, 2026-02-18T00:32:47.205 INFO:tasks.workunit.client.0.trial069.stdout: "from osd": 1, 2026-02-18T00:32:47.205 INFO:tasks.workunit.client.0.trial069.stdout: "to osd": 0, 2026-02-18T00:32:47.205 INFO:tasks.workunit.client.0.trial069.stdout: "interface": "back", 2026-02-18T00:32:47.205 INFO:tasks.workunit.client.0.trial069.stdout: "average": { 2026-02-18T00:32:47.205 INFO:tasks.workunit.client.0.trial069.stdout: "1min": 0.142, 2026-02-18T00:32:47.205 INFO:tasks.workunit.client.0.trial069.stdout: "5min": 0.138, 2026-02-18T00:32:47.205 INFO:tasks.workunit.client.0.trial069.stdout: "15min": 0.159 2026-02-18T00:32:47.205 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:32:47.205 INFO:tasks.workunit.client.0.trial069.stdout: "min": { 2026-02-18T00:32:47.205 INFO:tasks.workunit.client.0.trial069.stdout: "1min": 0.132, 2026-02-18T00:32:47.205 INFO:tasks.workunit.client.0.trial069.stdout: "5min": 0.112, 2026-02-18T00:32:47.205 INFO:tasks.workunit.client.0.trial069.stdout: "15min": 0.096 2026-02-18T00:32:47.205 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:32:47.205 INFO:tasks.workunit.client.0.trial069.stdout: "max": { 2026-02-18T00:32:47.205 INFO:tasks.workunit.client.0.trial069.stdout: "1min": 0.149, 2026-02-18T00:32:47.205 INFO:tasks.workunit.client.0.trial069.stdout: "5min": 0.239, 2026-02-18T00:32:47.205 INFO:tasks.workunit.client.0.trial069.stdout: "15min": 0.335 2026-02-18T00:32:47.205 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:32:47.205 INFO:tasks.workunit.client.0.trial069.stdout: "last": 0.145 2026-02-18T00:32:47.206 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:32:47.206 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:32:47.206 INFO:tasks.workunit.client.0.trial069.stdout: "last update": "Wed Feb 18 00:32:42 2026", 2026-02-18T00:32:47.206 INFO:tasks.workunit.client.0.trial069.stdout: "stale": false, 2026-02-18T00:32:47.206 INFO:tasks.workunit.client.0.trial069.stdout: "from osd": 2, 2026-02-18T00:32:47.206 INFO:tasks.workunit.client.0.trial069.stdout: "to osd": 1, 2026-02-18T00:32:47.206 INFO:tasks.workunit.client.0.trial069.stdout: "interface": "back", 2026-02-18T00:32:47.206 INFO:tasks.workunit.client.0.trial069.stdout: "average": { 2026-02-18T00:32:47.206 INFO:tasks.workunit.client.0.trial069.stdout: "1min": 0.129, 2026-02-18T00:32:47.206 INFO:tasks.workunit.client.0.trial069.stdout: "5min": 0.125, 2026-02-18T00:32:47.206 INFO:tasks.workunit.client.0.trial069.stdout: "15min": 0.156 2026-02-18T00:32:47.206 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:32:47.206 INFO:tasks.workunit.client.0.trial069.stdout: "min": { 2026-02-18T00:32:47.206 INFO:tasks.workunit.client.0.trial069.stdout: "1min": 0.106, 2026-02-18T00:32:47.206 INFO:tasks.workunit.client.0.trial069.stdout: "5min": 0.104, 2026-02-18T00:32:47.206 INFO:tasks.workunit.client.0.trial069.stdout: "15min": 0.104 2026-02-18T00:32:47.206 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:32:47.206 INFO:tasks.workunit.client.0.trial069.stdout: "max": { 2026-02-18T00:32:47.206 INFO:tasks.workunit.client.0.trial069.stdout: "1min": 0.152, 2026-02-18T00:32:47.206 INFO:tasks.workunit.client.0.trial069.stdout: "5min": 0.158, 2026-02-18T00:32:47.206 INFO:tasks.workunit.client.0.trial069.stdout: "15min": 0.250 2026-02-18T00:32:47.206 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:32:47.206 INFO:tasks.workunit.client.0.trial069.stdout: "last": 0.153 2026-02-18T00:32:47.206 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:32:47.206 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:32:47.206 INFO:tasks.workunit.client.0.trial069.stdout: "last update": "Wed Feb 18 00:32:42 2026", 2026-02-18T00:32:47.206 INFO:tasks.workunit.client.0.trial069.stdout: "stale": false, 2026-02-18T00:32:47.206 INFO:tasks.workunit.client.0.trial069.stdout: "from osd": 2, 2026-02-18T00:32:47.206 INFO:tasks.workunit.client.0.trial069.stdout: "to osd": 0, 2026-02-18T00:32:47.206 INFO:tasks.workunit.client.0.trial069.stdout: "interface": "front", 2026-02-18T00:32:47.206 INFO:tasks.workunit.client.0.trial069.stdout: "average": { 2026-02-18T00:32:47.206 INFO:tasks.workunit.client.0.trial069.stdout: "1min": 0.126, 2026-02-18T00:32:47.206 INFO:tasks.workunit.client.0.trial069.stdout: "5min": 0.123, 2026-02-18T00:32:47.206 INFO:tasks.workunit.client.0.trial069.stdout: "15min": 0.139 2026-02-18T00:32:47.206 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:32:47.206 INFO:tasks.workunit.client.0.trial069.stdout: "min": { 2026-02-18T00:32:47.206 INFO:tasks.workunit.client.0.trial069.stdout: "1min": 0.097, 2026-02-18T00:32:47.206 INFO:tasks.workunit.client.0.trial069.stdout: "5min": 0.097, 2026-02-18T00:32:47.206 INFO:tasks.workunit.client.0.trial069.stdout: "15min": 0.097 2026-02-18T00:32:47.206 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:32:47.206 INFO:tasks.workunit.client.0.trial069.stdout: "max": { 2026-02-18T00:32:47.206 INFO:tasks.workunit.client.0.trial069.stdout: "1min": 0.163, 2026-02-18T00:32:47.206 INFO:tasks.workunit.client.0.trial069.stdout: "5min": 0.163, 2026-02-18T00:32:47.206 INFO:tasks.workunit.client.0.trial069.stdout: "15min": 0.208 2026-02-18T00:32:47.206 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:32:47.206 INFO:tasks.workunit.client.0.trial069.stdout: "last": 0.139 2026-02-18T00:32:47.207 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:32:47.207 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:32:47.207 INFO:tasks.workunit.client.0.trial069.stdout: "last update": "Wed Feb 18 00:32:42 2026", 2026-02-18T00:32:47.207 INFO:tasks.workunit.client.0.trial069.stdout: "stale": false, 2026-02-18T00:32:47.207 INFO:tasks.workunit.client.0.trial069.stdout: "from osd": 2, 2026-02-18T00:32:47.207 INFO:tasks.workunit.client.0.trial069.stdout: "to osd": 0, 2026-02-18T00:32:47.207 INFO:tasks.workunit.client.0.trial069.stdout: "interface": "back", 2026-02-18T00:32:47.207 INFO:tasks.workunit.client.0.trial069.stdout: "average": { 2026-02-18T00:32:47.207 INFO:tasks.workunit.client.0.trial069.stdout: "1min": 0.122, 2026-02-18T00:32:47.207 INFO:tasks.workunit.client.0.trial069.stdout: "5min": 0.122, 2026-02-18T00:32:47.207 INFO:tasks.workunit.client.0.trial069.stdout: "15min": 0.133 2026-02-18T00:32:47.207 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:32:47.207 INFO:tasks.workunit.client.0.trial069.stdout: "min": { 2026-02-18T00:32:47.207 INFO:tasks.workunit.client.0.trial069.stdout: "1min": 0.099, 2026-02-18T00:32:47.207 INFO:tasks.workunit.client.0.trial069.stdout: "5min": 0.096, 2026-02-18T00:32:47.207 INFO:tasks.workunit.client.0.trial069.stdout: "15min": 0.096 2026-02-18T00:32:47.207 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:32:47.207 INFO:tasks.workunit.client.0.trial069.stdout: "max": { 2026-02-18T00:32:47.207 INFO:tasks.workunit.client.0.trial069.stdout: "1min": 0.136, 2026-02-18T00:32:47.207 INFO:tasks.workunit.client.0.trial069.stdout: "5min": 0.164, 2026-02-18T00:32:47.207 INFO:tasks.workunit.client.0.trial069.stdout: "15min": 0.346 2026-02-18T00:32:47.207 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:32:47.207 INFO:tasks.workunit.client.0.trial069.stdout: "last": 0.126 2026-02-18T00:32:47.207 INFO:tasks.workunit.client.0.trial069.stdout: } 2026-02-18T00:32:47.207 INFO:tasks.workunit.client.0.trial069.stdout: ] 2026-02-18T00:32:47.207 INFO:tasks.workunit.client.0.trial069.stdout:} 2026-02-18T00:32:47.207 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:76: TEST_network_ping_test1: cat td/network-ping/json 2026-02-18T00:32:47.207 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:76: TEST_network_ping_test1: jq '.entries | length' 2026-02-18T00:32:47.217 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:76: TEST_network_ping_test1: test 12 = 12 2026-02-18T00:32:47.218 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:77: TEST_network_ping_test1: cat td/network-ping/json 2026-02-18T00:32:47.218 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:77: TEST_network_ping_test1: jq .threshold 2026-02-18T00:32:47.228 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:77: TEST_network_ping_test1: test 0 = 0 2026-02-18T00:32:47.229 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:81: TEST_network_ping_test1: sleep 50 2026-02-18T00:33:37.227 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:82: TEST_network_ping_test1: flush_pg_stats 2026-02-18T00:33:37.227 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-18T00:33:37.228 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-18T00:33:37.438 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-18T00:33:37.439 INFO:tasks.workunit.client.0.trial069.stderr:1 2026-02-18T00:33:37.439 INFO:tasks.workunit.client.0.trial069.stderr:2' 2026-02-18T00:33:37.439 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-18T00:33:37.439 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:33:37.439 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-18T00:33:37.518 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836509 2026-02-18T00:33:37.518 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836509 2026-02-18T00:33:37.518 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836509' 2026-02-18T00:33:37.518 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:33:37.519 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-18T00:33:37.599 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705692 2026-02-18T00:33:37.599 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705692 2026-02-18T00:33:37.599 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836509 1-38654705692' 2026-02-18T00:33:37.599 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:33:37.600 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-18T00:33:37.676 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574876 2026-02-18T00:33:37.676 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574876 2026-02-18T00:33:37.677 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836509 1-38654705692 2-55834574876' 2026-02-18T00:33:37.677 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:33:37.677 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836509 2026-02-18T00:33:37.677 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:33:37.678 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-18T00:33:37.679 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-21474836509 2026-02-18T00:33:37.679 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:33:37.680 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=21474836509 2026-02-18T00:33:37.681 INFO:tasks.workunit.client.0.trial069.stdout:waiting osd.0 seq 21474836509 2026-02-18T00:33:37.681 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 21474836509' 2026-02-18T00:33:37.681 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T00:33:37.902 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 21474836509 -lt 21474836509 2026-02-18T00:33:37.902 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:33:37.903 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705692 2026-02-18T00:33:37.903 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:33:37.904 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=1 2026-02-18T00:33:37.904 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 1-38654705692 2026-02-18T00:33:37.905 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:33:37.906 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=38654705692 2026-02-18T00:33:37.906 INFO:tasks.workunit.client.0.trial069.stdout:waiting osd.1 seq 38654705692 2026-02-18T00:33:37.907 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.1 seq 38654705692' 2026-02-18T00:33:37.907 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-18T00:33:38.119 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 38654705692 -lt 38654705692 2026-02-18T00:33:38.120 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:33:38.120 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574876 2026-02-18T00:33:38.120 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:33:38.121 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=2 2026-02-18T00:33:38.122 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 2-55834574876 2026-02-18T00:33:38.122 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:33:38.123 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=55834574876 2026-02-18T00:33:38.124 INFO:tasks.workunit.client.0.trial069.stdout:waiting osd.2 seq 55834574876 2026-02-18T00:33:38.124 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.2 seq 55834574876' 2026-02-18T00:33:38.124 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-18T00:33:38.343 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 55834574876 -lt 55834574876 2026-02-18T00:33:38.344 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:83: TEST_network_ping_test1: tee td/network-ping/json 2026-02-18T00:33:38.346 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:83: TEST_network_ping_test1: get_asok_path osd.0 2026-02-18T00:33:38.346 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-18T00:33:38.346 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-18T00:33:38.346 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:33:38.346 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:33:38.346 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.24589 2026-02-18T00:33:38.346 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.24589/ceph-osd.0.asok 2026-02-18T00:33:38.346 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:83: TEST_network_ping_test1: CEPH_ARGS= 2026-02-18T00:33:38.346 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:83: TEST_network_ping_test1: ceph daemon /tmp/ceph-asok.24589/ceph-osd.0.asok dump_osd_network 2026-02-18T00:33:38.400 INFO:tasks.workunit.client.0.trial069.stdout:{ 2026-02-18T00:33:38.400 INFO:tasks.workunit.client.0.trial069.stdout: "threshold": 1000, 2026-02-18T00:33:38.400 INFO:tasks.workunit.client.0.trial069.stdout: "entries": [] 2026-02-18T00:33:38.401 INFO:tasks.workunit.client.0.trial069.stdout:} 2026-02-18T00:33:38.407 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:84: TEST_network_ping_test1: cat td/network-ping/json 2026-02-18T00:33:38.407 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:84: TEST_network_ping_test1: jq '.entries | length' 2026-02-18T00:33:38.417 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:84: TEST_network_ping_test1: test 0 = 0 2026-02-18T00:33:38.418 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:85: TEST_network_ping_test1: cat td/network-ping/json 2026-02-18T00:33:38.418 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:85: TEST_network_ping_test1: jq .threshold 2026-02-18T00:33:38.427 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:85: TEST_network_ping_test1: test 1000 = 1000 2026-02-18T00:33:38.427 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:87: TEST_network_ping_test1: tee td/network-ping/json 2026-02-18T00:33:38.428 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:87: TEST_network_ping_test1: get_asok_path mgr.x 2026-02-18T00:33:38.428 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mgr.x 2026-02-18T00:33:38.428 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mgr.x ']' 2026-02-18T00:33:38.429 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:33:38.429 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:33:38.429 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.24589 2026-02-18T00:33:38.430 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.24589/ceph-mgr.x.asok 2026-02-18T00:33:38.430 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:87: TEST_network_ping_test1: CEPH_ARGS= 2026-02-18T00:33:38.430 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:87: TEST_network_ping_test1: ceph daemon /tmp/ceph-asok.24589/ceph-mgr.x.asok dump_osd_network 2026-02-18T00:33:38.476 INFO:tasks.workunit.client.0.trial069.stdout:{ 2026-02-18T00:33:38.477 INFO:tasks.workunit.client.0.trial069.stdout: "threshold": 1000, 2026-02-18T00:33:38.477 INFO:tasks.workunit.client.0.trial069.stdout: "entries": [] 2026-02-18T00:33:38.477 INFO:tasks.workunit.client.0.trial069.stdout:} 2026-02-18T00:33:38.483 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:88: TEST_network_ping_test1: cat td/network-ping/json 2026-02-18T00:33:38.483 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:88: TEST_network_ping_test1: jq '.entries | length' 2026-02-18T00:33:38.493 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:88: TEST_network_ping_test1: test 0 = 0 2026-02-18T00:33:38.494 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:89: TEST_network_ping_test1: cat td/network-ping/json 2026-02-18T00:33:38.494 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:89: TEST_network_ping_test1: jq .threshold 2026-02-18T00:33:38.503 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:89: TEST_network_ping_test1: test 1000 = 1000 2026-02-18T00:33:38.503 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:91: TEST_network_ping_test1: tee td/network-ping/json 2026-02-18T00:33:38.504 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:91: TEST_network_ping_test1: get_asok_path osd.0 2026-02-18T00:33:38.504 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-18T00:33:38.504 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-18T00:33:38.505 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:33:38.505 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:33:38.505 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.24589 2026-02-18T00:33:38.505 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.24589/ceph-osd.0.asok 2026-02-18T00:33:38.505 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:91: TEST_network_ping_test1: CEPH_ARGS= 2026-02-18T00:33:38.505 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:91: TEST_network_ping_test1: ceph daemon /tmp/ceph-asok.24589/ceph-osd.0.asok dump_osd_network 0 2026-02-18T00:33:38.558 INFO:tasks.workunit.client.0.trial069.stdout:{ 2026-02-18T00:33:38.558 INFO:tasks.workunit.client.0.trial069.stdout: "threshold": 0, 2026-02-18T00:33:38.558 INFO:tasks.workunit.client.0.trial069.stdout: "entries": [ 2026-02-18T00:33:38.558 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:33:38.558 INFO:tasks.workunit.client.0.trial069.stdout: "last update": "Wed Feb 18 00:33:37 2026", 2026-02-18T00:33:38.559 INFO:tasks.workunit.client.0.trial069.stdout: "stale": false, 2026-02-18T00:33:38.559 INFO:tasks.workunit.client.0.trial069.stdout: "from osd": 0, 2026-02-18T00:33:38.559 INFO:tasks.workunit.client.0.trial069.stdout: "to osd": 2, 2026-02-18T00:33:38.559 INFO:tasks.workunit.client.0.trial069.stdout: "interface": "front", 2026-02-18T00:33:38.559 INFO:tasks.workunit.client.0.trial069.stdout: "average": { 2026-02-18T00:33:38.559 INFO:tasks.workunit.client.0.trial069.stdout: "1min": 0.171, 2026-02-18T00:33:38.559 INFO:tasks.workunit.client.0.trial069.stdout: "5min": 0.171, 2026-02-18T00:33:38.559 INFO:tasks.workunit.client.0.trial069.stdout: "15min": 0.169 2026-02-18T00:33:38.559 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:33:38.559 INFO:tasks.workunit.client.0.trial069.stdout: "min": { 2026-02-18T00:33:38.559 INFO:tasks.workunit.client.0.trial069.stdout: "1min": 0.212, 2026-02-18T00:33:38.559 INFO:tasks.workunit.client.0.trial069.stdout: "5min": 0.212, 2026-02-18T00:33:38.560 INFO:tasks.workunit.client.0.trial069.stdout: "15min": 0.238 2026-02-18T00:33:38.560 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:33:38.560 INFO:tasks.workunit.client.0.trial069.stdout: "max": { 2026-02-18T00:33:38.560 INFO:tasks.workunit.client.0.trial069.stdout: "1min": 0.212, 2026-02-18T00:33:38.560 INFO:tasks.workunit.client.0.trial069.stdout: "5min": 0.212, 2026-02-18T00:33:38.560 INFO:tasks.workunit.client.0.trial069.stdout: "15min": 0.238 2026-02-18T00:33:38.560 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:33:38.560 INFO:tasks.workunit.client.0.trial069.stdout: "last": 0.212 2026-02-18T00:33:38.560 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:33:38.560 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:33:38.560 INFO:tasks.workunit.client.0.trial069.stdout: "last update": "Wed Feb 18 00:33:34 2026", 2026-02-18T00:33:38.560 INFO:tasks.workunit.client.0.trial069.stdout: "stale": false, 2026-02-18T00:33:38.560 INFO:tasks.workunit.client.0.trial069.stdout: "from osd": 0, 2026-02-18T00:33:38.561 INFO:tasks.workunit.client.0.trial069.stdout: "to osd": 1, 2026-02-18T00:33:38.561 INFO:tasks.workunit.client.0.trial069.stdout: "interface": "back", 2026-02-18T00:33:38.561 INFO:tasks.workunit.client.0.trial069.stdout: "average": { 2026-02-18T00:33:38.561 INFO:tasks.workunit.client.0.trial069.stdout: "1min": 0.164, 2026-02-18T00:33:38.561 INFO:tasks.workunit.client.0.trial069.stdout: "5min": 0.154, 2026-02-18T00:33:38.561 INFO:tasks.workunit.client.0.trial069.stdout: "15min": 0.152 2026-02-18T00:33:38.561 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:33:38.561 INFO:tasks.workunit.client.0.trial069.stdout: "min": { 2026-02-18T00:33:38.561 INFO:tasks.workunit.client.0.trial069.stdout: "1min": 0.189, 2026-02-18T00:33:38.561 INFO:tasks.workunit.client.0.trial069.stdout: "5min": 0.217, 2026-02-18T00:33:38.561 INFO:tasks.workunit.client.0.trial069.stdout: "15min": 0.217 2026-02-18T00:33:38.561 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:33:38.562 INFO:tasks.workunit.client.0.trial069.stdout: "max": { 2026-02-18T00:33:38.562 INFO:tasks.workunit.client.0.trial069.stdout: "1min": 0.189, 2026-02-18T00:33:38.562 INFO:tasks.workunit.client.0.trial069.stdout: "5min": 0.217, 2026-02-18T00:33:38.562 INFO:tasks.workunit.client.0.trial069.stdout: "15min": 0.217 2026-02-18T00:33:38.562 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:33:38.562 INFO:tasks.workunit.client.0.trial069.stdout: "last": 0.164 2026-02-18T00:33:38.562 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:33:38.562 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:33:38.562 INFO:tasks.workunit.client.0.trial069.stdout: "last update": "Wed Feb 18 00:33:37 2026", 2026-02-18T00:33:38.562 INFO:tasks.workunit.client.0.trial069.stdout: "stale": false, 2026-02-18T00:33:38.562 INFO:tasks.workunit.client.0.trial069.stdout: "from osd": 0, 2026-02-18T00:33:38.562 INFO:tasks.workunit.client.0.trial069.stdout: "to osd": 2, 2026-02-18T00:33:38.562 INFO:tasks.workunit.client.0.trial069.stdout: "interface": "back", 2026-02-18T00:33:38.563 INFO:tasks.workunit.client.0.trial069.stdout: "average": { 2026-02-18T00:33:38.563 INFO:tasks.workunit.client.0.trial069.stdout: "1min": 0.163, 2026-02-18T00:33:38.563 INFO:tasks.workunit.client.0.trial069.stdout: "5min": 0.162, 2026-02-18T00:33:38.563 INFO:tasks.workunit.client.0.trial069.stdout: "15min": 0.155 2026-02-18T00:33:38.563 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:33:38.563 INFO:tasks.workunit.client.0.trial069.stdout: "min": { 2026-02-18T00:33:38.563 INFO:tasks.workunit.client.0.trial069.stdout: "1min": 0.196, 2026-02-18T00:33:38.563 INFO:tasks.workunit.client.0.trial069.stdout: "5min": 0.196, 2026-02-18T00:33:38.563 INFO:tasks.workunit.client.0.trial069.stdout: "15min": 0.210 2026-02-18T00:33:38.563 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:33:38.563 INFO:tasks.workunit.client.0.trial069.stdout: "max": { 2026-02-18T00:33:38.563 INFO:tasks.workunit.client.0.trial069.stdout: "1min": 0.196, 2026-02-18T00:33:38.563 INFO:tasks.workunit.client.0.trial069.stdout: "5min": 0.196, 2026-02-18T00:33:38.564 INFO:tasks.workunit.client.0.trial069.stdout: "15min": 0.210 2026-02-18T00:33:38.564 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:33:38.564 INFO:tasks.workunit.client.0.trial069.stdout: "last": 0.179 2026-02-18T00:33:38.564 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:33:38.564 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:33:38.564 INFO:tasks.workunit.client.0.trial069.stdout: "last update": "Wed Feb 18 00:33:34 2026", 2026-02-18T00:33:38.564 INFO:tasks.workunit.client.0.trial069.stdout: "stale": false, 2026-02-18T00:33:38.564 INFO:tasks.workunit.client.0.trial069.stdout: "from osd": 0, 2026-02-18T00:33:38.564 INFO:tasks.workunit.client.0.trial069.stdout: "to osd": 1, 2026-02-18T00:33:38.564 INFO:tasks.workunit.client.0.trial069.stdout: "interface": "front", 2026-02-18T00:33:38.564 INFO:tasks.workunit.client.0.trial069.stdout: "average": { 2026-02-18T00:33:38.564 INFO:tasks.workunit.client.0.trial069.stdout: "1min": 0.162, 2026-02-18T00:33:38.564 INFO:tasks.workunit.client.0.trial069.stdout: "5min": 0.147, 2026-02-18T00:33:38.565 INFO:tasks.workunit.client.0.trial069.stdout: "15min": 0.158 2026-02-18T00:33:38.565 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:33:38.565 INFO:tasks.workunit.client.0.trial069.stdout: "min": { 2026-02-18T00:33:38.565 INFO:tasks.workunit.client.0.trial069.stdout: "1min": 0.193, 2026-02-18T00:33:38.565 INFO:tasks.workunit.client.0.trial069.stdout: "5min": 0.193, 2026-02-18T00:33:38.565 INFO:tasks.workunit.client.0.trial069.stdout: "15min": 0.250 2026-02-18T00:33:38.565 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:33:38.565 INFO:tasks.workunit.client.0.trial069.stdout: "max": { 2026-02-18T00:33:38.565 INFO:tasks.workunit.client.0.trial069.stdout: "1min": 0.193, 2026-02-18T00:33:38.565 INFO:tasks.workunit.client.0.trial069.stdout: "5min": 0.193, 2026-02-18T00:33:38.565 INFO:tasks.workunit.client.0.trial069.stdout: "15min": 0.250 2026-02-18T00:33:38.565 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:33:38.565 INFO:tasks.workunit.client.0.trial069.stdout: "last": 0.194 2026-02-18T00:33:38.566 INFO:tasks.workunit.client.0.trial069.stdout: } 2026-02-18T00:33:38.566 INFO:tasks.workunit.client.0.trial069.stdout: ] 2026-02-18T00:33:38.566 INFO:tasks.workunit.client.0.trial069.stdout:} 2026-02-18T00:33:38.566 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:92: TEST_network_ping_test1: cat td/network-ping/json 2026-02-18T00:33:38.566 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:92: TEST_network_ping_test1: jq '.entries | length' 2026-02-18T00:33:38.574 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:92: TEST_network_ping_test1: test 4 = 4 2026-02-18T00:33:38.575 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:93: TEST_network_ping_test1: cat td/network-ping/json 2026-02-18T00:33:38.575 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:93: TEST_network_ping_test1: jq .threshold 2026-02-18T00:33:38.583 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:93: TEST_network_ping_test1: test 0 = 0 2026-02-18T00:33:38.584 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:95: TEST_network_ping_test1: tee td/network-ping/json 2026-02-18T00:33:38.584 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:95: TEST_network_ping_test1: get_asok_path mgr.x 2026-02-18T00:33:38.585 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mgr.x 2026-02-18T00:33:38.585 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mgr.x ']' 2026-02-18T00:33:38.586 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:33:38.586 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:33:38.586 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.24589 2026-02-18T00:33:38.586 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.24589/ceph-mgr.x.asok 2026-02-18T00:33:38.586 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:95: TEST_network_ping_test1: CEPH_ARGS= 2026-02-18T00:33:38.586 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:95: TEST_network_ping_test1: ceph daemon /tmp/ceph-asok.24589/ceph-mgr.x.asok dump_osd_network 0 2026-02-18T00:33:38.633 INFO:tasks.workunit.client.0.trial069.stdout:{ 2026-02-18T00:33:38.633 INFO:tasks.workunit.client.0.trial069.stdout: "threshold": 0, 2026-02-18T00:33:38.633 INFO:tasks.workunit.client.0.trial069.stdout: "entries": [ 2026-02-18T00:33:38.633 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:33:38.633 INFO:tasks.workunit.client.0.trial069.stdout: "last update": "Wed Feb 18 00:33:32 2026", 2026-02-18T00:33:38.633 INFO:tasks.workunit.client.0.trial069.stdout: "stale": false, 2026-02-18T00:33:38.634 INFO:tasks.workunit.client.0.trial069.stdout: "from osd": 0, 2026-02-18T00:33:38.634 INFO:tasks.workunit.client.0.trial069.stdout: "to osd": 2, 2026-02-18T00:33:38.634 INFO:tasks.workunit.client.0.trial069.stdout: "interface": "front", 2026-02-18T00:33:38.634 INFO:tasks.workunit.client.0.trial069.stdout: "average": { 2026-02-18T00:33:38.634 INFO:tasks.workunit.client.0.trial069.stdout: "1min": 0.167, 2026-02-18T00:33:38.634 INFO:tasks.workunit.client.0.trial069.stdout: "5min": 0.171, 2026-02-18T00:33:38.634 INFO:tasks.workunit.client.0.trial069.stdout: "15min": 0.170 2026-02-18T00:33:38.634 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:33:38.634 INFO:tasks.workunit.client.0.trial069.stdout: "min": { 2026-02-18T00:33:38.634 INFO:tasks.workunit.client.0.trial069.stdout: "1min": 0.142, 2026-02-18T00:33:38.634 INFO:tasks.workunit.client.0.trial069.stdout: "5min": 0.142, 2026-02-18T00:33:38.635 INFO:tasks.workunit.client.0.trial069.stdout: "15min": 0.127 2026-02-18T00:33:38.635 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:33:38.635 INFO:tasks.workunit.client.0.trial069.stdout: "max": { 2026-02-18T00:33:38.635 INFO:tasks.workunit.client.0.trial069.stdout: "1min": 0.187, 2026-02-18T00:33:38.635 INFO:tasks.workunit.client.0.trial069.stdout: "5min": 0.202, 2026-02-18T00:33:38.635 INFO:tasks.workunit.client.0.trial069.stdout: "15min": 0.255 2026-02-18T00:33:38.635 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:33:38.635 INFO:tasks.workunit.client.0.trial069.stdout: "last": 0.165 2026-02-18T00:33:38.635 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:33:38.635 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:33:38.635 INFO:tasks.workunit.client.0.trial069.stdout: "last update": "Wed Feb 18 00:33:32 2026", 2026-02-18T00:33:38.635 INFO:tasks.workunit.client.0.trial069.stdout: "stale": false, 2026-02-18T00:33:38.636 INFO:tasks.workunit.client.0.trial069.stdout: "from osd": 0, 2026-02-18T00:33:38.636 INFO:tasks.workunit.client.0.trial069.stdout: "to osd": 2, 2026-02-18T00:33:38.636 INFO:tasks.workunit.client.0.trial069.stdout: "interface": "back", 2026-02-18T00:33:38.636 INFO:tasks.workunit.client.0.trial069.stdout: "average": { 2026-02-18T00:33:38.636 INFO:tasks.workunit.client.0.trial069.stdout: "1min": 0.169, 2026-02-18T00:33:38.636 INFO:tasks.workunit.client.0.trial069.stdout: "5min": 0.162, 2026-02-18T00:33:38.636 INFO:tasks.workunit.client.0.trial069.stdout: "15min": 0.157 2026-02-18T00:33:38.636 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:33:38.636 INFO:tasks.workunit.client.0.trial069.stdout: "min": { 2026-02-18T00:33:38.636 INFO:tasks.workunit.client.0.trial069.stdout: "1min": 0.155, 2026-02-18T00:33:38.636 INFO:tasks.workunit.client.0.trial069.stdout: "5min": 0.120, 2026-02-18T00:33:38.636 INFO:tasks.workunit.client.0.trial069.stdout: "15min": 0.109 2026-02-18T00:33:38.636 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:33:38.637 INFO:tasks.workunit.client.0.trial069.stdout: "max": { 2026-02-18T00:33:38.637 INFO:tasks.workunit.client.0.trial069.stdout: "1min": 0.178, 2026-02-18T00:33:38.637 INFO:tasks.workunit.client.0.trial069.stdout: "5min": 0.192, 2026-02-18T00:33:38.637 INFO:tasks.workunit.client.0.trial069.stdout: "15min": 0.252 2026-02-18T00:33:38.637 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:33:38.637 INFO:tasks.workunit.client.0.trial069.stdout: "last": 0.151 2026-02-18T00:33:38.637 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:33:38.637 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:33:38.637 INFO:tasks.workunit.client.0.trial069.stdout: "last update": "Wed Feb 18 00:33:33 2026", 2026-02-18T00:33:38.637 INFO:tasks.workunit.client.0.trial069.stdout: "stale": false, 2026-02-18T00:33:38.637 INFO:tasks.workunit.client.0.trial069.stdout: "from osd": 1, 2026-02-18T00:33:38.637 INFO:tasks.workunit.client.0.trial069.stdout: "to osd": 2, 2026-02-18T00:33:38.637 INFO:tasks.workunit.client.0.trial069.stdout: "interface": "front", 2026-02-18T00:33:38.638 INFO:tasks.workunit.client.0.trial069.stdout: "average": { 2026-02-18T00:33:38.638 INFO:tasks.workunit.client.0.trial069.stdout: "1min": 0.143, 2026-02-18T00:33:38.638 INFO:tasks.workunit.client.0.trial069.stdout: "5min": 0.152, 2026-02-18T00:33:38.638 INFO:tasks.workunit.client.0.trial069.stdout: "15min": 0.165 2026-02-18T00:33:38.638 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:33:38.638 INFO:tasks.workunit.client.0.trial069.stdout: "min": { 2026-02-18T00:33:38.638 INFO:tasks.workunit.client.0.trial069.stdout: "1min": 0.125, 2026-02-18T00:33:38.638 INFO:tasks.workunit.client.0.trial069.stdout: "5min": 0.106, 2026-02-18T00:33:38.638 INFO:tasks.workunit.client.0.trial069.stdout: "15min": 0.106 2026-02-18T00:33:38.638 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:33:38.638 INFO:tasks.workunit.client.0.trial069.stdout: "max": { 2026-02-18T00:33:38.638 INFO:tasks.workunit.client.0.trial069.stdout: "1min": 0.168, 2026-02-18T00:33:38.638 INFO:tasks.workunit.client.0.trial069.stdout: "5min": 0.372, 2026-02-18T00:33:38.638 INFO:tasks.workunit.client.0.trial069.stdout: "15min": 0.372 2026-02-18T00:33:38.638 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:33:38.638 INFO:tasks.workunit.client.0.trial069.stdout: "last": 0.149 2026-02-18T00:33:38.638 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:33:38.638 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:33:38.638 INFO:tasks.workunit.client.0.trial069.stdout: "last update": "Wed Feb 18 00:33:34 2026", 2026-02-18T00:33:38.638 INFO:tasks.workunit.client.0.trial069.stdout: "stale": false, 2026-02-18T00:33:38.638 INFO:tasks.workunit.client.0.trial069.stdout: "from osd": 0, 2026-02-18T00:33:38.638 INFO:tasks.workunit.client.0.trial069.stdout: "to osd": 1, 2026-02-18T00:33:38.638 INFO:tasks.workunit.client.0.trial069.stdout: "interface": "back", 2026-02-18T00:33:38.638 INFO:tasks.workunit.client.0.trial069.stdout: "average": { 2026-02-18T00:33:38.638 INFO:tasks.workunit.client.0.trial069.stdout: "1min": 0.164, 2026-02-18T00:33:38.638 INFO:tasks.workunit.client.0.trial069.stdout: "5min": 0.154, 2026-02-18T00:33:38.638 INFO:tasks.workunit.client.0.trial069.stdout: "15min": 0.152 2026-02-18T00:33:38.639 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:33:38.639 INFO:tasks.workunit.client.0.trial069.stdout: "min": { 2026-02-18T00:33:38.639 INFO:tasks.workunit.client.0.trial069.stdout: "1min": 0.132, 2026-02-18T00:33:38.639 INFO:tasks.workunit.client.0.trial069.stdout: "5min": 0.119, 2026-02-18T00:33:38.639 INFO:tasks.workunit.client.0.trial069.stdout: "15min": 0.118 2026-02-18T00:33:38.639 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:33:38.639 INFO:tasks.workunit.client.0.trial069.stdout: "max": { 2026-02-18T00:33:38.639 INFO:tasks.workunit.client.0.trial069.stdout: "1min": 0.189, 2026-02-18T00:33:38.639 INFO:tasks.workunit.client.0.trial069.stdout: "5min": 0.217, 2026-02-18T00:33:38.639 INFO:tasks.workunit.client.0.trial069.stdout: "15min": 0.217 2026-02-18T00:33:38.639 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:33:38.639 INFO:tasks.workunit.client.0.trial069.stdout: "last": 0.119 2026-02-18T00:33:38.639 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:33:38.639 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:33:38.639 INFO:tasks.workunit.client.0.trial069.stdout: "last update": "Wed Feb 18 00:33:34 2026", 2026-02-18T00:33:38.639 INFO:tasks.workunit.client.0.trial069.stdout: "stale": false, 2026-02-18T00:33:38.639 INFO:tasks.workunit.client.0.trial069.stdout: "from osd": 0, 2026-02-18T00:33:38.639 INFO:tasks.workunit.client.0.trial069.stdout: "to osd": 1, 2026-02-18T00:33:38.639 INFO:tasks.workunit.client.0.trial069.stdout: "interface": "front", 2026-02-18T00:33:38.639 INFO:tasks.workunit.client.0.trial069.stdout: "average": { 2026-02-18T00:33:38.639 INFO:tasks.workunit.client.0.trial069.stdout: "1min": 0.162, 2026-02-18T00:33:38.639 INFO:tasks.workunit.client.0.trial069.stdout: "5min": 0.147, 2026-02-18T00:33:38.639 INFO:tasks.workunit.client.0.trial069.stdout: "15min": 0.158 2026-02-18T00:33:38.639 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:33:38.639 INFO:tasks.workunit.client.0.trial069.stdout: "min": { 2026-02-18T00:33:38.639 INFO:tasks.workunit.client.0.trial069.stdout: "1min": 0.137, 2026-02-18T00:33:38.639 INFO:tasks.workunit.client.0.trial069.stdout: "5min": 0.115, 2026-02-18T00:33:38.639 INFO:tasks.workunit.client.0.trial069.stdout: "15min": 0.115 2026-02-18T00:33:38.639 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:33:38.639 INFO:tasks.workunit.client.0.trial069.stdout: "max": { 2026-02-18T00:33:38.639 INFO:tasks.workunit.client.0.trial069.stdout: "1min": 0.193, 2026-02-18T00:33:38.639 INFO:tasks.workunit.client.0.trial069.stdout: "5min": 0.193, 2026-02-18T00:33:38.639 INFO:tasks.workunit.client.0.trial069.stdout: "15min": 0.250 2026-02-18T00:33:38.639 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:33:38.639 INFO:tasks.workunit.client.0.trial069.stdout: "last": 0.136 2026-02-18T00:33:38.639 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:33:38.639 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:33:38.639 INFO:tasks.workunit.client.0.trial069.stdout: "last update": "Wed Feb 18 00:33:33 2026", 2026-02-18T00:33:38.639 INFO:tasks.workunit.client.0.trial069.stdout: "stale": false, 2026-02-18T00:33:38.639 INFO:tasks.workunit.client.0.trial069.stdout: "from osd": 1, 2026-02-18T00:33:38.639 INFO:tasks.workunit.client.0.trial069.stdout: "to osd": 2, 2026-02-18T00:33:38.639 INFO:tasks.workunit.client.0.trial069.stdout: "interface": "back", 2026-02-18T00:33:38.639 INFO:tasks.workunit.client.0.trial069.stdout: "average": { 2026-02-18T00:33:38.639 INFO:tasks.workunit.client.0.trial069.stdout: "1min": 0.120, 2026-02-18T00:33:38.640 INFO:tasks.workunit.client.0.trial069.stdout: "5min": 0.133, 2026-02-18T00:33:38.640 INFO:tasks.workunit.client.0.trial069.stdout: "15min": 0.149 2026-02-18T00:33:38.640 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:33:38.640 INFO:tasks.workunit.client.0.trial069.stdout: "min": { 2026-02-18T00:33:38.640 INFO:tasks.workunit.client.0.trial069.stdout: "1min": 0.103, 2026-02-18T00:33:38.640 INFO:tasks.workunit.client.0.trial069.stdout: "5min": 0.101, 2026-02-18T00:33:38.640 INFO:tasks.workunit.client.0.trial069.stdout: "15min": 0.101 2026-02-18T00:33:38.640 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:33:38.640 INFO:tasks.workunit.client.0.trial069.stdout: "max": { 2026-02-18T00:33:38.640 INFO:tasks.workunit.client.0.trial069.stdout: "1min": 0.142, 2026-02-18T00:33:38.640 INFO:tasks.workunit.client.0.trial069.stdout: "5min": 0.330, 2026-02-18T00:33:38.640 INFO:tasks.workunit.client.0.trial069.stdout: "15min": 0.330 2026-02-18T00:33:38.640 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:33:38.640 INFO:tasks.workunit.client.0.trial069.stdout: "last": 0.187 2026-02-18T00:33:38.640 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:33:38.640 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:33:38.640 INFO:tasks.workunit.client.0.trial069.stdout: "last update": "Wed Feb 18 00:33:37 2026", 2026-02-18T00:33:38.640 INFO:tasks.workunit.client.0.trial069.stdout: "stale": false, 2026-02-18T00:33:38.640 INFO:tasks.workunit.client.0.trial069.stdout: "from osd": 2, 2026-02-18T00:33:38.640 INFO:tasks.workunit.client.0.trial069.stdout: "to osd": 1, 2026-02-18T00:33:38.640 INFO:tasks.workunit.client.0.trial069.stdout: "interface": "front", 2026-02-18T00:33:38.640 INFO:tasks.workunit.client.0.trial069.stdout: "average": { 2026-02-18T00:33:38.640 INFO:tasks.workunit.client.0.trial069.stdout: "1min": 0.147, 2026-02-18T00:33:38.640 INFO:tasks.workunit.client.0.trial069.stdout: "5min": 0.128, 2026-02-18T00:33:38.640 INFO:tasks.workunit.client.0.trial069.stdout: "15min": 0.141 2026-02-18T00:33:38.640 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:33:38.640 INFO:tasks.workunit.client.0.trial069.stdout: "min": { 2026-02-18T00:33:38.640 INFO:tasks.workunit.client.0.trial069.stdout: "1min": 0.109, 2026-02-18T00:33:38.640 INFO:tasks.workunit.client.0.trial069.stdout: "5min": 0.101, 2026-02-18T00:33:38.640 INFO:tasks.workunit.client.0.trial069.stdout: "15min": 0.101 2026-02-18T00:33:38.640 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:33:38.640 INFO:tasks.workunit.client.0.trial069.stdout: "max": { 2026-02-18T00:33:38.640 INFO:tasks.workunit.client.0.trial069.stdout: "1min": 0.200, 2026-02-18T00:33:38.640 INFO:tasks.workunit.client.0.trial069.stdout: "5min": 0.200, 2026-02-18T00:33:38.640 INFO:tasks.workunit.client.0.trial069.stdout: "15min": 0.278 2026-02-18T00:33:38.640 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:33:38.640 INFO:tasks.workunit.client.0.trial069.stdout: "last": 0.200 2026-02-18T00:33:38.640 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:33:38.640 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:33:38.640 INFO:tasks.workunit.client.0.trial069.stdout: "last update": "Wed Feb 18 00:33:33 2026", 2026-02-18T00:33:38.640 INFO:tasks.workunit.client.0.trial069.stdout: "stale": false, 2026-02-18T00:33:38.640 INFO:tasks.workunit.client.0.trial069.stdout: "from osd": 1, 2026-02-18T00:33:38.640 INFO:tasks.workunit.client.0.trial069.stdout: "to osd": 0, 2026-02-18T00:33:38.640 INFO:tasks.workunit.client.0.trial069.stdout: "interface": "front", 2026-02-18T00:33:38.640 INFO:tasks.workunit.client.0.trial069.stdout: "average": { 2026-02-18T00:33:38.640 INFO:tasks.workunit.client.0.trial069.stdout: "1min": 0.123, 2026-02-18T00:33:38.641 INFO:tasks.workunit.client.0.trial069.stdout: "5min": 0.140, 2026-02-18T00:33:38.641 INFO:tasks.workunit.client.0.trial069.stdout: "15min": 0.145 2026-02-18T00:33:38.641 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:33:38.641 INFO:tasks.workunit.client.0.trial069.stdout: "min": { 2026-02-18T00:33:38.641 INFO:tasks.workunit.client.0.trial069.stdout: "1min": 0.109, 2026-02-18T00:33:38.641 INFO:tasks.workunit.client.0.trial069.stdout: "5min": 0.109, 2026-02-18T00:33:38.641 INFO:tasks.workunit.client.0.trial069.stdout: "15min": 0.104 2026-02-18T00:33:38.641 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:33:38.641 INFO:tasks.workunit.client.0.trial069.stdout: "max": { 2026-02-18T00:33:38.641 INFO:tasks.workunit.client.0.trial069.stdout: "1min": 0.143, 2026-02-18T00:33:38.641 INFO:tasks.workunit.client.0.trial069.stdout: "5min": 0.355, 2026-02-18T00:33:38.641 INFO:tasks.workunit.client.0.trial069.stdout: "15min": 0.355 2026-02-18T00:33:38.641 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:33:38.641 INFO:tasks.workunit.client.0.trial069.stdout: "last": 0.163 2026-02-18T00:33:38.641 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:33:38.641 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:33:38.641 INFO:tasks.workunit.client.0.trial069.stdout: "last update": "Wed Feb 18 00:33:33 2026", 2026-02-18T00:33:38.641 INFO:tasks.workunit.client.0.trial069.stdout: "stale": false, 2026-02-18T00:33:38.641 INFO:tasks.workunit.client.0.trial069.stdout: "from osd": 1, 2026-02-18T00:33:38.641 INFO:tasks.workunit.client.0.trial069.stdout: "to osd": 0, 2026-02-18T00:33:38.641 INFO:tasks.workunit.client.0.trial069.stdout: "interface": "back", 2026-02-18T00:33:38.641 INFO:tasks.workunit.client.0.trial069.stdout: "average": { 2026-02-18T00:33:38.641 INFO:tasks.workunit.client.0.trial069.stdout: "1min": 0.140, 2026-02-18T00:33:38.641 INFO:tasks.workunit.client.0.trial069.stdout: "5min": 0.144, 2026-02-18T00:33:38.641 INFO:tasks.workunit.client.0.trial069.stdout: "15min": 0.135 2026-02-18T00:33:38.641 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:33:38.641 INFO:tasks.workunit.client.0.trial069.stdout: "min": { 2026-02-18T00:33:38.641 INFO:tasks.workunit.client.0.trial069.stdout: "1min": 0.119, 2026-02-18T00:33:38.641 INFO:tasks.workunit.client.0.trial069.stdout: "5min": 0.112, 2026-02-18T00:33:38.641 INFO:tasks.workunit.client.0.trial069.stdout: "15min": 0.091 2026-02-18T00:33:38.641 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:33:38.641 INFO:tasks.workunit.client.0.trial069.stdout: "max": { 2026-02-18T00:33:38.641 INFO:tasks.workunit.client.0.trial069.stdout: "1min": 0.157, 2026-02-18T00:33:38.641 INFO:tasks.workunit.client.0.trial069.stdout: "5min": 0.302, 2026-02-18T00:33:38.641 INFO:tasks.workunit.client.0.trial069.stdout: "15min": 0.302 2026-02-18T00:33:38.641 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:33:38.641 INFO:tasks.workunit.client.0.trial069.stdout: "last": 0.175 2026-02-18T00:33:38.641 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:33:38.641 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:33:38.641 INFO:tasks.workunit.client.0.trial069.stdout: "last update": "Wed Feb 18 00:33:37 2026", 2026-02-18T00:33:38.641 INFO:tasks.workunit.client.0.trial069.stdout: "stale": false, 2026-02-18T00:33:38.641 INFO:tasks.workunit.client.0.trial069.stdout: "from osd": 2, 2026-02-18T00:33:38.641 INFO:tasks.workunit.client.0.trial069.stdout: "to osd": 0, 2026-02-18T00:33:38.641 INFO:tasks.workunit.client.0.trial069.stdout: "interface": "back", 2026-02-18T00:33:38.641 INFO:tasks.workunit.client.0.trial069.stdout: "average": { 2026-02-18T00:33:38.641 INFO:tasks.workunit.client.0.trial069.stdout: "1min": 0.142, 2026-02-18T00:33:38.641 INFO:tasks.workunit.client.0.trial069.stdout: "5min": 0.137, 2026-02-18T00:33:38.642 INFO:tasks.workunit.client.0.trial069.stdout: "15min": 0.127 2026-02-18T00:33:38.642 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:33:38.642 INFO:tasks.workunit.client.0.trial069.stdout: "min": { 2026-02-18T00:33:38.642 INFO:tasks.workunit.client.0.trial069.stdout: "1min": 0.121, 2026-02-18T00:33:38.642 INFO:tasks.workunit.client.0.trial069.stdout: "5min": 0.112, 2026-02-18T00:33:38.642 INFO:tasks.workunit.client.0.trial069.stdout: "15min": 0.094 2026-02-18T00:33:38.642 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:33:38.642 INFO:tasks.workunit.client.0.trial069.stdout: "max": { 2026-02-18T00:33:38.642 INFO:tasks.workunit.client.0.trial069.stdout: "1min": 0.165, 2026-02-18T00:33:38.642 INFO:tasks.workunit.client.0.trial069.stdout: "5min": 0.165, 2026-02-18T00:33:38.642 INFO:tasks.workunit.client.0.trial069.stdout: "15min": 0.205 2026-02-18T00:33:38.642 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:33:38.642 INFO:tasks.workunit.client.0.trial069.stdout: "last": 0.165 2026-02-18T00:33:38.642 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:33:38.642 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:33:38.642 INFO:tasks.workunit.client.0.trial069.stdout: "last update": "Wed Feb 18 00:33:37 2026", 2026-02-18T00:33:38.642 INFO:tasks.workunit.client.0.trial069.stdout: "stale": false, 2026-02-18T00:33:38.642 INFO:tasks.workunit.client.0.trial069.stdout: "from osd": 2, 2026-02-18T00:33:38.642 INFO:tasks.workunit.client.0.trial069.stdout: "to osd": 1, 2026-02-18T00:33:38.642 INFO:tasks.workunit.client.0.trial069.stdout: "interface": "back", 2026-02-18T00:33:38.642 INFO:tasks.workunit.client.0.trial069.stdout: "average": { 2026-02-18T00:33:38.642 INFO:tasks.workunit.client.0.trial069.stdout: "1min": 0.141, 2026-02-18T00:33:38.642 INFO:tasks.workunit.client.0.trial069.stdout: "5min": 0.128, 2026-02-18T00:33:38.642 INFO:tasks.workunit.client.0.trial069.stdout: "15min": 0.129 2026-02-18T00:33:38.642 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:33:38.642 INFO:tasks.workunit.client.0.trial069.stdout: "min": { 2026-02-18T00:33:38.642 INFO:tasks.workunit.client.0.trial069.stdout: "1min": 0.117, 2026-02-18T00:33:38.642 INFO:tasks.workunit.client.0.trial069.stdout: "5min": 0.112, 2026-02-18T00:33:38.642 INFO:tasks.workunit.client.0.trial069.stdout: "15min": 0.103 2026-02-18T00:33:38.642 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:33:38.642 INFO:tasks.workunit.client.0.trial069.stdout: "max": { 2026-02-18T00:33:38.642 INFO:tasks.workunit.client.0.trial069.stdout: "1min": 0.178, 2026-02-18T00:33:38.642 INFO:tasks.workunit.client.0.trial069.stdout: "5min": 0.178, 2026-02-18T00:33:38.642 INFO:tasks.workunit.client.0.trial069.stdout: "15min": 0.192 2026-02-18T00:33:38.642 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:33:38.642 INFO:tasks.workunit.client.0.trial069.stdout: "last": 0.178 2026-02-18T00:33:38.642 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:33:38.642 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:33:38.642 INFO:tasks.workunit.client.0.trial069.stdout: "last update": "Wed Feb 18 00:33:37 2026", 2026-02-18T00:33:38.642 INFO:tasks.workunit.client.0.trial069.stdout: "stale": false, 2026-02-18T00:33:38.642 INFO:tasks.workunit.client.0.trial069.stdout: "from osd": 2, 2026-02-18T00:33:38.642 INFO:tasks.workunit.client.0.trial069.stdout: "to osd": 0, 2026-02-18T00:33:38.642 INFO:tasks.workunit.client.0.trial069.stdout: "interface": "front", 2026-02-18T00:33:38.642 INFO:tasks.workunit.client.0.trial069.stdout: "average": { 2026-02-18T00:33:38.642 INFO:tasks.workunit.client.0.trial069.stdout: "1min": 0.131, 2026-02-18T00:33:38.642 INFO:tasks.workunit.client.0.trial069.stdout: "5min": 0.118, 2026-02-18T00:33:38.643 INFO:tasks.workunit.client.0.trial069.stdout: "15min": 0.126 2026-02-18T00:33:38.643 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:33:38.643 INFO:tasks.workunit.client.0.trial069.stdout: "min": { 2026-02-18T00:33:38.643 INFO:tasks.workunit.client.0.trial069.stdout: "1min": 0.098, 2026-02-18T00:33:38.643 INFO:tasks.workunit.client.0.trial069.stdout: "5min": 0.091, 2026-02-18T00:33:38.643 INFO:tasks.workunit.client.0.trial069.stdout: "15min": 0.091 2026-02-18T00:33:38.643 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:33:38.643 INFO:tasks.workunit.client.0.trial069.stdout: "max": { 2026-02-18T00:33:38.643 INFO:tasks.workunit.client.0.trial069.stdout: "1min": 0.186, 2026-02-18T00:33:38.643 INFO:tasks.workunit.client.0.trial069.stdout: "5min": 0.186, 2026-02-18T00:33:38.643 INFO:tasks.workunit.client.0.trial069.stdout: "15min": 0.215 2026-02-18T00:33:38.643 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:33:38.643 INFO:tasks.workunit.client.0.trial069.stdout: "last": 0.186 2026-02-18T00:33:38.643 INFO:tasks.workunit.client.0.trial069.stdout: } 2026-02-18T00:33:38.643 INFO:tasks.workunit.client.0.trial069.stdout: ] 2026-02-18T00:33:38.643 INFO:tasks.workunit.client.0.trial069.stdout:} 2026-02-18T00:33:38.643 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:96: TEST_network_ping_test1: cat td/network-ping/json 2026-02-18T00:33:38.643 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:96: TEST_network_ping_test1: jq '.entries | length' 2026-02-18T00:33:38.649 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:96: TEST_network_ping_test1: test 12 = 12 2026-02-18T00:33:38.650 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:97: TEST_network_ping_test1: cat td/network-ping/json 2026-02-18T00:33:38.650 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:97: TEST_network_ping_test1: jq .threshold 2026-02-18T00:33:38.658 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:97: TEST_network_ping_test1: test 0 = 0 2026-02-18T00:33:38.659 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:100: TEST_network_ping_test1: tee td/network-ping/json 2026-02-18T00:33:38.659 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:100: TEST_network_ping_test1: get_asok_path mgr.x 2026-02-18T00:33:38.659 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mgr.x 2026-02-18T00:33:38.659 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mgr.x ']' 2026-02-18T00:33:38.660 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:33:38.660 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:33:38.660 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.24589 2026-02-18T00:33:38.660 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.24589/ceph-mgr.x.asok 2026-02-18T00:33:38.660 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:100: TEST_network_ping_test1: CEPH_ARGS= 2026-02-18T00:33:38.660 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:100: TEST_network_ping_test1: ceph daemon /tmp/ceph-asok.24589/ceph-mgr.x.asok dump_osd_network 99 2026-02-18T00:33:38.708 INFO:tasks.workunit.client.0.trial069.stdout:{ 2026-02-18T00:33:38.709 INFO:tasks.workunit.client.0.trial069.stdout: "threshold": 99, 2026-02-18T00:33:38.709 INFO:tasks.workunit.client.0.trial069.stdout: "entries": [] 2026-02-18T00:33:38.709 INFO:tasks.workunit.client.0.trial069.stdout:} 2026-02-18T00:33:38.715 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:101: TEST_network_ping_test1: cat td/network-ping/json 2026-02-18T00:33:38.715 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:101: TEST_network_ping_test1: jq .threshold 2026-02-18T00:33:38.725 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:101: TEST_network_ping_test1: test 99 = 99 2026-02-18T00:33:38.725 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:102: TEST_network_ping_test1: tee td/network-ping/json 2026-02-18T00:33:38.726 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:102: TEST_network_ping_test1: get_asok_path osd.0 2026-02-18T00:33:38.726 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-18T00:33:38.726 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-18T00:33:38.727 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:33:38.727 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:33:38.727 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.24589 2026-02-18T00:33:38.727 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.24589/ceph-osd.0.asok 2026-02-18T00:33:38.728 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:102: TEST_network_ping_test1: CEPH_ARGS= 2026-02-18T00:33:38.728 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:102: TEST_network_ping_test1: ceph daemon /tmp/ceph-asok.24589/ceph-osd.0.asok dump_osd_network 98 2026-02-18T00:33:38.781 INFO:tasks.workunit.client.0.trial069.stdout:{ 2026-02-18T00:33:38.781 INFO:tasks.workunit.client.0.trial069.stdout: "threshold": 98, 2026-02-18T00:33:38.781 INFO:tasks.workunit.client.0.trial069.stdout: "entries": [] 2026-02-18T00:33:38.781 INFO:tasks.workunit.client.0.trial069.stdout:} 2026-02-18T00:33:38.787 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:103: TEST_network_ping_test1: cat td/network-ping/json 2026-02-18T00:33:38.787 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:103: TEST_network_ping_test1: jq .threshold 2026-02-18T00:33:38.797 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:103: TEST_network_ping_test1: test 98 = 98 2026-02-18T00:33:38.797 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:105: TEST_network_ping_test1: rm -f td/network-ping/json 2026-02-18T00:33:38.798 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:20: run: teardown td/network-ping 2026-02-18T00:33:38.798 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/network-ping 2026-02-18T00:33:38.798 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T00:33:38.798 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/network-ping KILL 2026-02-18T00:33:38.799 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:33:38.799 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:33:38.799 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:33:38.799 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:33:38.799 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:33:39.110 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:33:39.111 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T00:33:39.112 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T00:33:39.113 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T00:33:39.114 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T00:33:39.114 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T00:33:39.115 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T00:33:39.116 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:33:39.116 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T00:33:39.116 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T00:33:39.117 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:33:39.117 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T00:33:39.118 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T00:33:39.119 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/network-ping 2026-02-18T00:33:39.707 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T00:33:39.707 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:33:39.707 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.24589 2026-02-18T00:33:39.707 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.24589 2026-02-18T00:33:39.709 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T00:33:39.709 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T00:33:39.709 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:17: run: for func in $funcs 2026-02-18T00:33:39.709 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:18: run: setup td/network-ping 2026-02-18T00:33:39.709 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/network-ping 2026-02-18T00:33:39.710 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/network-ping 2026-02-18T00:33:39.710 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/network-ping 2026-02-18T00:33:39.710 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T00:33:39.710 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/network-ping KILL 2026-02-18T00:33:39.710 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:33:39.710 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:33:39.710 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:33:39.710 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:33:39.710 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:33:39.711 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:33:39.712 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T00:33:39.712 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T00:33:39.713 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T00:33:39.714 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T00:33:39.714 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T00:33:39.714 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T00:33:39.715 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:33:39.715 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T00:33:39.716 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T00:33:39.716 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:33:39.717 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T00:33:39.718 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T00:33:39.718 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/network-ping 2026-02-18T00:33:39.719 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T00:33:39.719 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:33:39.720 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.24589 2026-02-18T00:33:39.720 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.24589 2026-02-18T00:33:39.721 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T00:33:39.721 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T00:33:39.721 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/network-ping 2026-02-18T00:33:39.722 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-18T00:33:39.722 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:33:39.723 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.24589 2026-02-18T00:33:39.723 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.24589 2026-02-18T00:33:39.724 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-18T00:33:39.726 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-18T00:33:39.726 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-18T00:33:39.726 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/network-ping 1' TERM HUP INT 2026-02-18T00:33:39.726 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:19: run: TEST_network_ping_test2 td/network-ping 2026-02-18T00:33:39.726 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:111: TEST_network_ping_test2: local dir=td/network-ping 2026-02-18T00:33:39.726 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:113: TEST_network_ping_test2: export CEPH_ARGS 2026-02-18T00:33:39.726 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:114: TEST_network_ping_test2: export 'EXTRA_OPTS= --mon_warn_on_slow_ping_time=0.001' 2026-02-18T00:33:39.726 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:114: TEST_network_ping_test2: EXTRA_OPTS=' --mon_warn_on_slow_ping_time=0.001' 2026-02-18T00:33:39.726 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:115: TEST_network_ping_test2: run_mon td/network-ping a 2026-02-18T00:33:39.726 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/network-ping 2026-02-18T00:33:39.727 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-18T00:33:39.727 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-18T00:33:39.727 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-18T00:33:39.727 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/network-ping/a 2026-02-18T00:33:39.727 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/network-ping/a --run-dir=td/network-ping 2026-02-18T00:33:39.749 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-18T00:33:39.749 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:33:39.749 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:33:39.749 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:33:39.749 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:33:39.749 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.24589 2026-02-18T00:33:39.749 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.24589/$cluster-$name.asok' 2026-02-18T00:33:39.750 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --mon_warn_on_slow_ping_time=0.001 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/network-ping/a '--log-file=td/network-ping/$name.log' '--admin-socket=/tmp/ceph-asok.24589/$cluster-$name.asok' --mon-cluster-log-file=td/network-ping/log --run-dir=td/network-ping '--pid-file=td/network-ping/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-18T00:33:39.777 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-18T00:33:39.778 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-18T00:33:39.778 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T00:33:39.778 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-18T00:33:39.778 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-18T00:33:39.778 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-18T00:33:39.780 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-18T00:33:39.780 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:33:39.780 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:33:39.780 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:33:39.780 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:33:39.780 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.24589 2026-02-18T00:33:39.780 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.24589/ceph-mon.a.asok 2026-02-18T00:33:39.780 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T00:33:39.780 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.24589/ceph-mon.a.asok config get fsid 2026-02-18T00:33:39.835 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-18T00:33:39.836 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T00:33:39.836 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-18T00:33:39.836 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-18T00:33:39.836 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-18T00:33:39.836 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-18T00:33:39.836 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:33:39.836 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:33:39.837 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:33:39.837 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:33:39.837 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.24589 2026-02-18T00:33:39.837 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.24589/ceph-mon.a.asok 2026-02-18T00:33:39.837 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T00:33:39.837 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.24589/ceph-mon.a.asok config get mon_host 2026-02-18T00:33:39.892 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:116: TEST_network_ping_test2: run_mgr td/network-ping x 2026-02-18T00:33:39.892 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/network-ping 2026-02-18T00:33:39.892 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-18T00:33:39.892 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-18T00:33:39.892 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-18T00:33:39.892 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/network-ping/x 2026-02-18T00:33:39.892 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-18T00:33:40.002 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-18T00:33:40.002 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:33:40.002 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:33:40.002 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:33:40.002 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:33:40.003 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.24589 2026-02-18T00:33:40.003 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.24589/$cluster-$name.asok' 2026-02-18T00:33:40.003 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-18T00:33:40.004 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --mon_warn_on_slow_ping_time=0.001 --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/network-ping/x '--log-file=td/network-ping/$name.log' '--admin-socket=/tmp/ceph-asok.24589/$cluster-$name.asok' --run-dir=td/network-ping '--pid-file=td/network-ping/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-18T00:33:40.021 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:117: TEST_network_ping_test2: run_osd td/network-ping 0 2026-02-18T00:33:40.021 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/network-ping 2026-02-18T00:33:40.021 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T00:33:40.021 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-18T00:33:40.021 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T00:33:40.021 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/network-ping/0 2026-02-18T00:33:40.021 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=5622f510-6141-4057-a1e1-f8d3df558f57 --auth-supported=none --mon-host=127.0.0.1:7146 --debug_disable_randomized_ping=true --debug_heartbeat_testing_span=5 --osd_heartbeat_interval=1 ' 2026-02-18T00:33:40.021 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T00:33:40.021 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T00:33:40.021 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T00:33:40.021 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/network-ping/0' 2026-02-18T00:33:40.022 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/network-ping/0/journal' 2026-02-18T00:33:40.022 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T00:33:40.022 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+=' --mon_warn_on_slow_ping_time=0.001' 2026-02-18T00:33:40.022 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/network-ping' 2026-02-18T00:33:40.022 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T00:33:40.022 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:33:40.022 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:33:40.022 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:33:40.022 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:33:40.022 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.24589 2026-02-18T00:33:40.022 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.24589/$cluster-$name.asok' 2026-02-18T00:33:40.022 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.24589/$cluster-$name.asok' 2026-02-18T00:33:40.022 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T00:33:40.022 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T00:33:40.022 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T00:33:40.022 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/network-ping/$name.log' 2026-02-18T00:33:40.022 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/network-ping/$name.pid' 2026-02-18T00:33:40.022 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T00:33:40.022 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T00:33:40.022 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T00:33:40.023 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T00:33:40.023 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T00:33:40.023 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-18T00:33:40.023 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/network-ping/0 2026-02-18T00:33:40.024 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T00:33:40.025 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=05cf913b-1371-4a20-8ee2-de0e5ee513bb 2026-02-18T00:33:40.025 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 05cf913b-1371-4a20-8ee2-de0e5ee513bb' 2026-02-18T00:33:40.025 INFO:tasks.workunit.client.0.trial069.stdout:add osd0 05cf913b-1371-4a20-8ee2-de0e5ee513bb 2026-02-18T00:33:40.025 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T00:33:40.037 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDkCJVpcjoWAhAA8sKhQurTda8wnhhfYFbY7w== 2026-02-18T00:33:40.037 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDkCJVpcjoWAhAA8sKhQurTda8wnhhfYFbY7w=="}' 2026-02-18T00:33:40.037 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 05cf913b-1371-4a20-8ee2-de0e5ee513bb -i td/network-ping/0/new.json 2026-02-18T00:33:40.150 INFO:tasks.workunit.client.0.trial069.stdout:0 2026-02-18T00:33:40.157 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/network-ping/0/new.json 2026-02-18T00:33:40.159 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=5622f510-6141-4057-a1e1-f8d3df558f57 --auth-supported=none --mon-host=127.0.0.1:7146 --debug_disable_randomized_ping=true --debug_heartbeat_testing_span=5 --osd_heartbeat_interval=1 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/network-ping/0 --osd-journal=td/network-ping/0/journal --chdir= --mon_warn_on_slow_ping_time=0.001 --run-dir=td/network-ping '--admin-socket=/tmp/ceph-asok.24589/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/network-ping/$name.log' '--pid-file=td/network-ping/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDkCJVpcjoWAhAA8sKhQurTda8wnhhfYFbY7w== --osd-uuid 05cf913b-1371-4a20-8ee2-de0e5ee513bb 2026-02-18T00:33:40.175 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:33:40.169+0000 7f7d80447a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:33:40.176 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:33:40.169+0000 7f7d80447a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:33:40.177 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:33:40.173+0000 7f7d80447a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:33:40.178 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:33:40.173+0000 7f7d80447a40 -1 bdev(0x563039ebac00 td/network-ping/0/block) open stat got: (1) Operation not permitted 2026-02-18T00:33:40.178 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:33:40.173+0000 7f7d80447a40 -1 bluestore(td/network-ping/0) _read_fsid unparsable uuid 2026-02-18T00:33:40.924 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/network-ping/0/keyring 2026-02-18T00:33:40.924 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T00:33:40.925 INFO:tasks.workunit.client.0.trial069.stdout:adding osd0 key to auth repository 2026-02-18T00:33:40.926 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-18T00:33:40.926 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/network-ping/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T00:33:41.046 INFO:tasks.workunit.client.0.trial069.stdout:start osd.0 2026-02-18T00:33:41.046 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-18T00:33:41.046 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=5622f510-6141-4057-a1e1-f8d3df558f57 --auth-supported=none --mon-host=127.0.0.1:7146 --debug_disable_randomized_ping=true --debug_heartbeat_testing_span=5 --osd_heartbeat_interval=1 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/network-ping/0 --osd-journal=td/network-ping/0/journal --chdir= --mon_warn_on_slow_ping_time=0.001 --run-dir=td/network-ping '--admin-socket=/tmp/ceph-asok.24589/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/network-ping/$name.log' '--pid-file=td/network-ping/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T00:33:41.047 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T00:33:41.047 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T00:33:41.047 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T00:33:41.072 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:33:41.065+0000 7fc7c9a06a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:33:41.074 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:33:41.069+0000 7fc7c9a06a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:33:41.076 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:33:41.069+0000 7fc7c9a06a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:33:41.153 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-18T00:33:41.153 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:33:41.153 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-18T00:33:41.153 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:33:41.153 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:33:41.153 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:33:41.153 INFO:tasks.workunit.client.0.trial069.stdout:0 2026-02-18T00:33:41.153 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:33:41.153 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:33:41.153 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T00:33:41.259 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:33:41.602 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:33:41.597+0000 7fc7c9a06a40 -1 Falling back to public interface 2026-02-18T00:33:42.260 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:33:42.260 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:33:42.260 INFO:tasks.workunit.client.0.trial069.stdout:1 2026-02-18T00:33:42.261 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T00:33:42.261 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:33:42.261 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T00:33:42.367 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:33:42.555 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:33:42.549+0000 7fc7c9a06a40 -1 osd.0 0 log_to_monitors true 2026-02-18T00:33:43.368 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:33:43.368 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:33:43.369 INFO:tasks.workunit.client.0.trial069.stdout:2 2026-02-18T00:33:43.369 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-18T00:33:43.369 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:33:43.370 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T00:33:43.574 INFO:tasks.workunit.client.0.trial069.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/3493262477,v1:127.0.0.1:6801/3493262477] [v2:127.0.0.1:6802/3493262477,v1:127.0.0.1:6803/3493262477] exists,up 05cf913b-1371-4a20-8ee2-de0e5ee513bb 2026-02-18T00:33:43.577 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:33:43.578 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:33:43.578 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:33:43.578 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:118: TEST_network_ping_test2: run_osd td/network-ping 1 2026-02-18T00:33:43.578 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/network-ping 2026-02-18T00:33:43.578 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T00:33:43.578 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2026-02-18T00:33:43.578 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T00:33:43.578 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/network-ping/1 2026-02-18T00:33:43.578 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=5622f510-6141-4057-a1e1-f8d3df558f57 --auth-supported=none --mon-host=127.0.0.1:7146 --debug_disable_randomized_ping=true --debug_heartbeat_testing_span=5 --osd_heartbeat_interval=1 ' 2026-02-18T00:33:43.579 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T00:33:43.579 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T00:33:43.579 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T00:33:43.579 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/network-ping/1' 2026-02-18T00:33:43.579 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/network-ping/1/journal' 2026-02-18T00:33:43.579 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T00:33:43.579 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+=' --mon_warn_on_slow_ping_time=0.001' 2026-02-18T00:33:43.579 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/network-ping' 2026-02-18T00:33:43.579 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T00:33:43.579 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:33:43.579 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:33:43.579 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:33:43.579 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:33:43.579 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.24589 2026-02-18T00:33:43.579 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.24589/$cluster-$name.asok' 2026-02-18T00:33:43.579 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.24589/$cluster-$name.asok' 2026-02-18T00:33:43.579 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T00:33:43.579 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T00:33:43.579 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T00:33:43.579 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/network-ping/$name.log' 2026-02-18T00:33:43.579 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/network-ping/$name.pid' 2026-02-18T00:33:43.579 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T00:33:43.579 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T00:33:43.579 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T00:33:43.579 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T00:33:43.579 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T00:33:43.579 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-18T00:33:43.579 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/network-ping/1 2026-02-18T00:33:43.579 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T00:33:43.579 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=283d9d66-20a4-4462-8ff7-3f8acd3af9ca 2026-02-18T00:33:43.580 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 283d9d66-20a4-4462-8ff7-3f8acd3af9ca' 2026-02-18T00:33:43.580 INFO:tasks.workunit.client.0.trial069.stdout:add osd1 283d9d66-20a4-4462-8ff7-3f8acd3af9ca 2026-02-18T00:33:43.580 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T00:33:43.591 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDnCJVpuowhIxAAYjD9geYq0NO4AC8ljxetEA== 2026-02-18T00:33:43.591 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDnCJVpuowhIxAAYjD9geYq0NO4AC8ljxetEA=="}' 2026-02-18T00:33:43.591 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 283d9d66-20a4-4462-8ff7-3f8acd3af9ca -i td/network-ping/1/new.json 2026-02-18T00:33:43.807 INFO:tasks.workunit.client.0.trial069.stdout:1 2026-02-18T00:33:43.817 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/network-ping/1/new.json 2026-02-18T00:33:43.817 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=5622f510-6141-4057-a1e1-f8d3df558f57 --auth-supported=none --mon-host=127.0.0.1:7146 --debug_disable_randomized_ping=true --debug_heartbeat_testing_span=5 --osd_heartbeat_interval=1 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/network-ping/1 --osd-journal=td/network-ping/1/journal --chdir= --mon_warn_on_slow_ping_time=0.001 --run-dir=td/network-ping '--admin-socket=/tmp/ceph-asok.24589/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/network-ping/$name.log' '--pid-file=td/network-ping/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDnCJVpuowhIxAAYjD9geYq0NO4AC8ljxetEA== --osd-uuid 283d9d66-20a4-4462-8ff7-3f8acd3af9ca 2026-02-18T00:33:43.842 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:33:43.837+0000 7f5ebbc54a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:33:43.843 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:33:43.837+0000 7f5ebbc54a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:33:43.844 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:33:43.837+0000 7f5ebbc54a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:33:43.845 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:33:43.841+0000 7f5ebbc54a40 -1 bdev(0x561584e84c00 td/network-ping/1/block) open stat got: (1) Operation not permitted 2026-02-18T00:33:43.845 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:33:43.841+0000 7f5ebbc54a40 -1 bluestore(td/network-ping/1) _read_fsid unparsable uuid 2026-02-18T00:33:44.508 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/network-ping/1/keyring 2026-02-18T00:33:44.508 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T00:33:44.509 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2026-02-18T00:33:44.509 INFO:tasks.workunit.client.0.trial069.stdout:adding osd1 key to auth repository 2026-02-18T00:33:44.510 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/network-ping/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T00:33:44.796 INFO:tasks.workunit.client.0.trial069.stdout:start osd.1 2026-02-18T00:33:44.796 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2026-02-18T00:33:44.796 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=5622f510-6141-4057-a1e1-f8d3df558f57 --auth-supported=none --mon-host=127.0.0.1:7146 --debug_disable_randomized_ping=true --debug_heartbeat_testing_span=5 --osd_heartbeat_interval=1 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/network-ping/1 --osd-journal=td/network-ping/1/journal --chdir= --mon_warn_on_slow_ping_time=0.001 --run-dir=td/network-ping '--admin-socket=/tmp/ceph-asok.24589/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/network-ping/$name.log' '--pid-file=td/network-ping/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T00:33:44.797 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T00:33:44.797 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T00:33:44.797 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T00:33:44.813 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:33:44.809+0000 7f1d5141ba40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:33:44.814 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:33:44.809+0000 7f1d5141ba40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:33:44.815 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:33:44.809+0000 7f1d5141ba40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:33:45.013 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2026-02-18T00:33:45.013 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:33:45.013 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-18T00:33:45.013 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:33:45.013 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:33:45.013 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:33:45.014 INFO:tasks.workunit.client.0.trial069.stdout:0 2026-02-18T00:33:45.014 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:33:45.014 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:33:45.014 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-18T00:33:45.198 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:33:45.194+0000 7f1d5141ba40 -1 Falling back to public interface 2026-02-18T00:33:45.225 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:33:45.849 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:33:45.846+0000 7f1d5141ba40 -1 osd.1 0 log_to_monitors true 2026-02-18T00:33:46.227 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:33:46.227 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:33:46.228 INFO:tasks.workunit.client.0.trial069.stdout:1 2026-02-18T00:33:46.228 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T00:33:46.228 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:33:46.229 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-18T00:33:46.437 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:33:47.438 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:33:47.438 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:33:47.438 INFO:tasks.workunit.client.0.trial069.stdout:2 2026-02-18T00:33:47.439 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-18T00:33:47.439 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:33:47.439 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-18T00:33:47.652 INFO:tasks.workunit.client.0.trial069.stdout:osd.1 up in weight 1 up_from 9 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/1419837382,v1:127.0.0.1:6811/1419837382] [v2:127.0.0.1:6812/1419837382,v1:127.0.0.1:6813/1419837382] exists,up 283d9d66-20a4-4462-8ff7-3f8acd3af9ca 2026-02-18T00:33:47.655 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:33:47.656 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:33:47.656 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:33:47.656 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:119: TEST_network_ping_test2: run_osd td/network-ping 2 2026-02-18T00:33:47.656 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/network-ping 2026-02-18T00:33:47.656 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T00:33:47.656 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2026-02-18T00:33:47.656 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T00:33:47.656 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/network-ping/2 2026-02-18T00:33:47.656 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=5622f510-6141-4057-a1e1-f8d3df558f57 --auth-supported=none --mon-host=127.0.0.1:7146 --debug_disable_randomized_ping=true --debug_heartbeat_testing_span=5 --osd_heartbeat_interval=1 ' 2026-02-18T00:33:47.656 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T00:33:47.656 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T00:33:47.657 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T00:33:47.657 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/network-ping/2' 2026-02-18T00:33:47.657 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/network-ping/2/journal' 2026-02-18T00:33:47.657 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T00:33:47.657 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+=' --mon_warn_on_slow_ping_time=0.001' 2026-02-18T00:33:47.657 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/network-ping' 2026-02-18T00:33:47.657 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T00:33:47.657 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:33:47.657 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:33:47.657 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:33:47.657 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:33:47.657 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.24589 2026-02-18T00:33:47.657 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.24589/$cluster-$name.asok' 2026-02-18T00:33:47.658 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.24589/$cluster-$name.asok' 2026-02-18T00:33:47.658 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T00:33:47.658 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T00:33:47.658 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T00:33:47.658 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/network-ping/$name.log' 2026-02-18T00:33:47.658 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/network-ping/$name.pid' 2026-02-18T00:33:47.658 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T00:33:47.658 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T00:33:47.658 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T00:33:47.658 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T00:33:47.658 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T00:33:47.658 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-18T00:33:47.658 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/network-ping/2 2026-02-18T00:33:47.659 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T00:33:47.659 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=831f3d55-0fed-4e1f-9a8d-50eef9a27c25 2026-02-18T00:33:47.659 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 831f3d55-0fed-4e1f-9a8d-50eef9a27c25' 2026-02-18T00:33:47.660 INFO:tasks.workunit.client.0.trial069.stdout:add osd2 831f3d55-0fed-4e1f-9a8d-50eef9a27c25 2026-02-18T00:33:47.660 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T00:33:47.670 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDrCJVp37PXJxAA/ZgwbW4E36GdUAot7wGEWg== 2026-02-18T00:33:47.670 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDrCJVp37PXJxAA/ZgwbW4E36GdUAot7wGEWg=="}' 2026-02-18T00:33:47.670 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 831f3d55-0fed-4e1f-9a8d-50eef9a27c25 -i td/network-ping/2/new.json 2026-02-18T00:33:47.885 INFO:tasks.workunit.client.0.trial069.stdout:2 2026-02-18T00:33:47.894 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/network-ping/2/new.json 2026-02-18T00:33:47.895 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --fsid=5622f510-6141-4057-a1e1-f8d3df558f57 --auth-supported=none --mon-host=127.0.0.1:7146 --debug_disable_randomized_ping=true --debug_heartbeat_testing_span=5 --osd_heartbeat_interval=1 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/network-ping/2 --osd-journal=td/network-ping/2/journal --chdir= --mon_warn_on_slow_ping_time=0.001 --run-dir=td/network-ping '--admin-socket=/tmp/ceph-asok.24589/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/network-ping/$name.log' '--pid-file=td/network-ping/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDrCJVp37PXJxAA/ZgwbW4E36GdUAot7wGEWg== --osd-uuid 831f3d55-0fed-4e1f-9a8d-50eef9a27c25 2026-02-18T00:33:47.911 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:33:47.906+0000 7f48fdc75a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:33:47.913 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:33:47.910+0000 7f48fdc75a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:33:47.914 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:33:47.910+0000 7f48fdc75a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:33:47.914 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:33:47.910+0000 7f48fdc75a40 -1 bdev(0x55f378a04c00 td/network-ping/2/block) open stat got: (1) Operation not permitted 2026-02-18T00:33:47.915 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:33:47.910+0000 7f48fdc75a40 -1 bluestore(td/network-ping/2) _read_fsid unparsable uuid 2026-02-18T00:33:48.571 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/network-ping/2/keyring 2026-02-18T00:33:48.571 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T00:33:48.572 INFO:tasks.workunit.client.0.trial069.stdout:adding osd2 key to auth repository 2026-02-18T00:33:48.573 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2026-02-18T00:33:48.573 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/network-ping/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T00:33:48.859 INFO:tasks.workunit.client.0.trial069.stdout:start osd.2 2026-02-18T00:33:48.860 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2026-02-18T00:33:48.860 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --fsid=5622f510-6141-4057-a1e1-f8d3df558f57 --auth-supported=none --mon-host=127.0.0.1:7146 --debug_disable_randomized_ping=true --debug_heartbeat_testing_span=5 --osd_heartbeat_interval=1 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/network-ping/2 --osd-journal=td/network-ping/2/journal --chdir= --mon_warn_on_slow_ping_time=0.001 --run-dir=td/network-ping '--admin-socket=/tmp/ceph-asok.24589/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/network-ping/$name.log' '--pid-file=td/network-ping/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T00:33:48.860 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T00:33:48.860 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T00:33:48.860 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T00:33:48.884 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:33:48.878+0000 7fa50404aa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:33:48.886 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:33:48.882+0000 7fa50404aa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:33:48.887 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:33:48.882+0000 7fa50404aa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:33:49.077 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2026-02-18T00:33:49.078 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:33:49.078 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-18T00:33:49.078 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:33:49.078 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:33:49.078 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:33:49.078 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:33:49.079 INFO:tasks.workunit.client.0.trial069.stdout:0 2026-02-18T00:33:49.079 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:33:49.079 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-18T00:33:49.238 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:33:49.234+0000 7fa50404aa40 -1 Falling back to public interface 2026-02-18T00:33:49.293 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:33:49.894 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:33:49.890+0000 7fa50404aa40 -1 osd.2 0 log_to_monitors true 2026-02-18T00:33:50.295 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:33:50.295 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:33:50.295 INFO:tasks.workunit.client.0.trial069.stdout:1 2026-02-18T00:33:50.296 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T00:33:50.296 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:33:50.296 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-18T00:33:50.504 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:33:51.505 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:33:51.506 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:33:51.506 INFO:tasks.workunit.client.0.trial069.stdout:2 2026-02-18T00:33:51.507 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-18T00:33:51.507 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:33:51.507 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-18T00:33:51.712 INFO:tasks.workunit.client.0.trial069.stdout:osd.2 up in weight 1 up_from 14 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/2820114252,v1:127.0.0.1:6819/2820114252] [v2:127.0.0.1:6820/2820114252,v1:127.0.0.1:6821/2820114252] exists,up 831f3d55-0fed-4e1f-9a8d-50eef9a27c25 2026-02-18T00:33:51.712 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:33:51.712 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:33:51.713 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:33:51.713 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:121: TEST_network_ping_test2: sleep 5 2026-02-18T00:33:56.713 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:122: TEST_network_ping_test2: ceph osd crush add-bucket dc1 datacenter 2026-02-18T00:33:56.971 INFO:tasks.workunit.client.0.trial069.stderr:bucket 'dc1' already exists 2026-02-18T00:33:56.982 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:123: TEST_network_ping_test2: ceph osd crush add-bucket dc2 datacenter 2026-02-18T00:33:57.276 INFO:tasks.workunit.client.0.trial069.stderr:bucket 'dc2' already exists 2026-02-18T00:33:57.287 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:124: TEST_network_ping_test2: ceph osd crush add-bucket dc3 datacenter 2026-02-18T00:33:57.539 INFO:tasks.workunit.client.0.trial069.stderr:bucket 'dc3' already exists 2026-02-18T00:33:57.548 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:125: TEST_network_ping_test2: ceph osd crush add-bucket rack1 rack 2026-02-18T00:33:57.810 INFO:tasks.workunit.client.0.trial069.stderr:bucket 'rack1' already exists 2026-02-18T00:33:57.819 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:126: TEST_network_ping_test2: ceph osd crush add-bucket rack2 rack 2026-02-18T00:33:58.086 INFO:tasks.workunit.client.0.trial069.stderr:bucket 'rack2' already exists 2026-02-18T00:33:58.095 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:127: TEST_network_ping_test2: ceph osd crush add-bucket rack3 rack 2026-02-18T00:33:58.358 INFO:tasks.workunit.client.0.trial069.stderr:bucket 'rack3' already exists 2026-02-18T00:33:58.367 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:128: TEST_network_ping_test2: ceph osd crush add-bucket host1 host 2026-02-18T00:33:58.630 INFO:tasks.workunit.client.0.trial069.stderr:bucket 'host1' already exists 2026-02-18T00:33:58.640 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:129: TEST_network_ping_test2: ceph osd crush add-bucket host2 host 2026-02-18T00:33:58.904 INFO:tasks.workunit.client.0.trial069.stderr:bucket 'host2' already exists 2026-02-18T00:33:58.913 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:130: TEST_network_ping_test2: ceph osd crush add-bucket host3 host 2026-02-18T00:33:59.212 INFO:tasks.workunit.client.0.trial069.stderr:bucket 'host3' already exists 2026-02-18T00:33:59.221 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:131: TEST_network_ping_test2: ceph osd crush move dc1 root=default 2026-02-18T00:33:59.486 INFO:tasks.workunit.client.0.trial069.stderr:no need to move item id -5 name 'dc1' to location {root=default} in crush map 2026-02-18T00:33:59.495 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:132: TEST_network_ping_test2: ceph osd crush move dc2 root=default 2026-02-18T00:33:59.763 INFO:tasks.workunit.client.0.trial069.stderr:no need to move item id -6 name 'dc2' to location {root=default} in crush map 2026-02-18T00:33:59.772 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:133: TEST_network_ping_test2: ceph osd crush move dc3 root=default 2026-02-18T00:34:00.041 INFO:tasks.workunit.client.0.trial069.stderr:no need to move item id -7 name 'dc3' to location {root=default} in crush map 2026-02-18T00:34:00.052 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:134: TEST_network_ping_test2: ceph osd crush move rack1 datacenter=dc1 2026-02-18T00:34:00.310 INFO:tasks.workunit.client.0.trial069.stderr:no need to move item id -8 name 'rack1' to location {datacenter=dc1} in crush map 2026-02-18T00:34:00.319 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:135: TEST_network_ping_test2: ceph osd crush move rack2 datacenter=dc2 2026-02-18T00:34:00.576 INFO:tasks.workunit.client.0.trial069.stderr:no need to move item id -9 name 'rack2' to location {datacenter=dc2} in crush map 2026-02-18T00:34:00.587 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:136: TEST_network_ping_test2: ceph osd crush move rack3 datacenter=dc3 2026-02-18T00:34:00.847 INFO:tasks.workunit.client.0.trial069.stderr:no need to move item id -10 name 'rack3' to location {datacenter=dc3} in crush map 2026-02-18T00:34:00.856 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:137: TEST_network_ping_test2: ceph osd crush move host1 rack=rack1 2026-02-18T00:34:01.114 INFO:tasks.workunit.client.0.trial069.stderr:no need to move item id -11 name 'host1' to location {rack=rack1} in crush map 2026-02-18T00:34:01.125 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:138: TEST_network_ping_test2: ceph osd crush move host2 rack=rack2 2026-02-18T00:34:01.384 INFO:tasks.workunit.client.0.trial069.stderr:no need to move item id -12 name 'host2' to location {rack=rack2} in crush map 2026-02-18T00:34:01.393 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:139: TEST_network_ping_test2: ceph osd crush move host3 rack=rack3 2026-02-18T00:34:01.659 INFO:tasks.workunit.client.0.trial069.stderr:no need to move item id -13 name 'host3' to location {rack=rack3} in crush map 2026-02-18T00:34:01.668 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:140: TEST_network_ping_test2: ceph osd crush set osd.0 1.0 host=host1 2026-02-18T00:34:01.934 INFO:tasks.workunit.client.0.trial069.stderr:set item id 0 name 'osd.0' weight 1 at location {host=host1}: no change 2026-02-18T00:34:01.943 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:141: TEST_network_ping_test2: ceph osd crush set osd.1 1.0 host=host2 2026-02-18T00:34:02.214 INFO:tasks.workunit.client.0.trial069.stderr:set item id 1 name 'osd.1' weight 1 at location {host=host2}: no change 2026-02-18T00:34:02.223 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:142: TEST_network_ping_test2: ceph osd crush set osd.2 1.0 host=host3 2026-02-18T00:34:02.478 INFO:tasks.workunit.client.0.trial069.stderr:set item id 2 name 'osd.2' weight 1 at location {host=host3}: no change 2026-02-18T00:34:02.488 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:143: TEST_network_ping_test2: ceph osd crush rule create-simple myrule default host firstn 2026-02-18T00:34:02.741 INFO:tasks.workunit.client.0.trial069.stderr:rule myrule already exists 2026-02-18T00:34:02.750 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:145: TEST_network_ping_test2: create_pool foo 16 16 replicated myrule 2026-02-18T00:34:02.751 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create foo 16 16 replicated myrule 2026-02-18T00:34:03.027 INFO:tasks.workunit.client.0.trial069.stderr:pool 'foo' already exists 2026-02-18T00:34:03.036 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-18T00:34:04.038 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:148: TEST_network_ping_test2: timeout 20 rados bench -p foo 10 write -b 4096 --no-cleanup 2026-02-18T00:34:04.059 INFO:tasks.workunit.client.0.trial069.stdout:hints = 1 2026-02-18T00:34:04.059 INFO:tasks.workunit.client.0.trial069.stdout:Maintaining 16 concurrent writes of 4096 bytes to objects of size 4096 for up to 10 seconds or 0 objects 2026-02-18T00:34:04.059 INFO:tasks.workunit.client.0.trial069.stdout:Object prefix: benchmark_data_trial069_35641 2026-02-18T00:34:04.059 INFO:tasks.workunit.client.0.trial069.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-18T00:34:04.059 INFO:tasks.workunit.client.0.trial069.stdout: 0 0 0 0 0 0 - 0 2026-02-18T00:34:05.059 INFO:tasks.workunit.client.0.trial069.stdout: 1 16 10641 10625 41.5009 41.5039 0.00145603 0.00150319 2026-02-18T00:34:06.059 INFO:tasks.workunit.client.0.trial069.stdout: 2 16 21336 21320 41.6374 41.7773 0.00157572 0.00149905 2026-02-18T00:34:07.059 INFO:tasks.workunit.client.0.trial069.stdout: 3 15 32905 32890 42.8223 45.1953 0.000745282 0.00145768 2026-02-18T00:34:08.059 INFO:tasks.workunit.client.0.trial069.stdout: 4 16 44249 44233 43.193 44.3086 0.000663065 0.00144515 2026-02-18T00:34:09.059 INFO:tasks.workunit.client.0.trial069.stdout: 5 15 55561 55546 43.3921 44.1914 0.000820021 0.00143872 2026-02-18T00:34:10.059 INFO:tasks.workunit.client.0.trial069.stdout: 6 16 66975 66959 43.5898 44.582 0.00124232 0.00143218 2026-02-18T00:34:11.059 INFO:tasks.workunit.client.0.trial069.stdout: 7 16 78410 78394 43.7433 44.668 0.0014802 0.0014272 2026-02-18T00:34:12.059 INFO:tasks.workunit.client.0.trial069.stdout: 8 16 88495 88479 43.1994 39.3945 0.00178202 0.00144518 2026-02-18T00:34:13.059 INFO:tasks.workunit.client.0.trial069.stdout: 9 16 98166 98150 42.5966 37.7773 0.00144101 0.00146563 2026-02-18T00:34:14.059 INFO:tasks.workunit.client.0.trial069.stdout: 10 4 107607 107603 42.0293 36.9258 0.00144748 0.00148554 2026-02-18T00:34:15.059 INFO:tasks.workunit.client.0.trial069.stdout:Total time run: 10.0009 2026-02-18T00:34:15.059 INFO:tasks.workunit.client.0.trial069.stdout:Total writes made: 107607 2026-02-18T00:34:15.059 INFO:tasks.workunit.client.0.trial069.stdout:Write size: 4096 2026-02-18T00:34:15.060 INFO:tasks.workunit.client.0.trial069.stdout:Object size: 4096 2026-02-18T00:34:15.060 INFO:tasks.workunit.client.0.trial069.stdout:Bandwidth (MB/sec): 42.0301 2026-02-18T00:34:15.060 INFO:tasks.workunit.client.0.trial069.stdout:Stddev Bandwidth: 3.06918 2026-02-18T00:34:15.060 INFO:tasks.workunit.client.0.trial069.stdout:Max bandwidth (MB/sec): 45.1953 2026-02-18T00:34:15.060 INFO:tasks.workunit.client.0.trial069.stdout:Min bandwidth (MB/sec): 36.9258 2026-02-18T00:34:15.060 INFO:tasks.workunit.client.0.trial069.stdout:Average IOPS: 10759 2026-02-18T00:34:15.060 INFO:tasks.workunit.client.0.trial069.stdout:Stddev IOPS: 785.711 2026-02-18T00:34:15.060 INFO:tasks.workunit.client.0.trial069.stdout:Max IOPS: 11570 2026-02-18T00:34:15.060 INFO:tasks.workunit.client.0.trial069.stdout:Min IOPS: 9453 2026-02-18T00:34:15.060 INFO:tasks.workunit.client.0.trial069.stdout:Average Latency(s): 0.00148552 2026-02-18T00:34:15.060 INFO:tasks.workunit.client.0.trial069.stdout:Stddev Latency(s): 0.00070404 2026-02-18T00:34:15.060 INFO:tasks.workunit.client.0.trial069.stdout:Max latency(s): 0.0118382 2026-02-18T00:34:15.061 INFO:tasks.workunit.client.0.trial069.stdout:Min latency(s): 0.000487516 2026-02-18T00:34:15.066 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:151: TEST_network_ping_test2: sleep 10 2026-02-18T00:34:25.067 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:152: TEST_network_ping_test2: flush_pg_stats 2026-02-18T00:34:25.067 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-18T00:34:25.068 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-18T00:34:25.272 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-18T00:34:25.272 INFO:tasks.workunit.client.0.trial069.stderr:1 2026-02-18T00:34:25.272 INFO:tasks.workunit.client.0.trial069.stderr:2' 2026-02-18T00:34:25.273 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-18T00:34:25.273 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:34:25.273 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-18T00:34:25.354 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836491 2026-02-18T00:34:25.354 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836491 2026-02-18T00:34:25.354 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836491' 2026-02-18T00:34:25.354 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:34:25.355 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-18T00:34:25.432 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705674 2026-02-18T00:34:25.432 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705674 2026-02-18T00:34:25.432 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836491 1-38654705674' 2026-02-18T00:34:25.432 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:34:25.432 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-18T00:34:25.509 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542153 2026-02-18T00:34:25.509 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542153 2026-02-18T00:34:25.509 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836491 1-38654705674 2-60129542153' 2026-02-18T00:34:25.509 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:34:25.510 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836491 2026-02-18T00:34:25.510 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:34:25.511 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-18T00:34:25.511 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-21474836491 2026-02-18T00:34:25.511 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:34:25.512 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=21474836491 2026-02-18T00:34:25.513 INFO:tasks.workunit.client.0.trial069.stdout:waiting osd.0 seq 21474836491 2026-02-18T00:34:25.513 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 21474836491' 2026-02-18T00:34:25.513 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T00:34:25.733 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 21474836489 -lt 21474836491 2026-02-18T00:34:25.733 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-18T00:34:26.734 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-18T00:34:26.735 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T00:34:26.950 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 21474836491 -lt 21474836491 2026-02-18T00:34:26.950 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:34:26.951 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705674 2026-02-18T00:34:26.951 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:34:26.952 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=1 2026-02-18T00:34:26.952 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 1-38654705674 2026-02-18T00:34:26.952 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:34:26.954 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=38654705674 2026-02-18T00:34:26.954 INFO:tasks.workunit.client.0.trial069.stdout:waiting osd.1 seq 38654705674 2026-02-18T00:34:26.955 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.1 seq 38654705674' 2026-02-18T00:34:26.955 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-18T00:34:27.165 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 38654705674 -lt 38654705674 2026-02-18T00:34:27.165 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:34:27.166 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542153 2026-02-18T00:34:27.166 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:34:27.167 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=2 2026-02-18T00:34:27.168 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 2-60129542153 2026-02-18T00:34:27.168 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:34:27.169 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=60129542153 2026-02-18T00:34:27.169 INFO:tasks.workunit.client.0.trial069.stdout:waiting osd.2 seq 60129542153 2026-02-18T00:34:27.170 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.2 seq 60129542153' 2026-02-18T00:34:27.170 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-18T00:34:27.396 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 60129542154 -lt 60129542153 2026-02-18T00:34:27.397 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:154: TEST_network_ping_test2: ceph health 2026-02-18T00:34:27.397 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:154: TEST_network_ping_test2: tee td/network-ping/health 2026-02-18T00:34:27.634 INFO:tasks.workunit.client.0.trial069.stdout:HEALTH_WARN Slow OSD heartbeats on back (longest 0.360ms); Slow OSD heartbeats on front (longest 0.412ms) 2026-02-18T00:34:27.643 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:155: TEST_network_ping_test2: grep -q 'Slow OSD heartbeats' td/network-ping/health 2026-02-18T00:34:27.644 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:157: TEST_network_ping_test2: ceph health detail 2026-02-18T00:34:27.645 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:157: TEST_network_ping_test2: tee td/network-ping/health 2026-02-18T00:34:27.930 INFO:tasks.workunit.client.0.trial069.stdout:HEALTH_WARN Slow OSD heartbeats on back (longest 0.360ms); Slow OSD heartbeats on front (longest 0.412ms) 2026-02-18T00:34:27.930 INFO:tasks.workunit.client.0.trial069.stdout:[WRN] OSD_SLOW_PING_TIME_BACK: Slow OSD heartbeats on back (longest 0.360ms) 2026-02-18T00:34:27.930 INFO:tasks.workunit.client.0.trial069.stdout: Slow OSD heartbeats on back from osd.0 [dc1,rack1] to osd.1 [dc2,rack2] 0.360 msec 2026-02-18T00:34:27.930 INFO:tasks.workunit.client.0.trial069.stdout: Slow OSD heartbeats on back from osd.0 [dc1,rack1] to osd.2 [dc3,rack3] 0.296 msec 2026-02-18T00:34:27.931 INFO:tasks.workunit.client.0.trial069.stdout: Slow OSD heartbeats on back from osd.1 [dc2,rack2] to osd.2 [dc3,rack3] 0.250 msec 2026-02-18T00:34:27.931 INFO:tasks.workunit.client.0.trial069.stdout: Slow OSD heartbeats on back from osd.2 [dc3,rack3] to osd.1 [dc2,rack2] 0.189 msec 2026-02-18T00:34:27.931 INFO:tasks.workunit.client.0.trial069.stdout: Slow OSD heartbeats on back from osd.1 [dc2,rack2] to osd.0 [dc1,rack1] 0.187 msec possibly improving 2026-02-18T00:34:27.931 INFO:tasks.workunit.client.0.trial069.stdout: Slow OSD heartbeats on back from osd.2 [dc3,rack3] to osd.0 [dc1,rack1] 0.167 msec 2026-02-18T00:34:27.931 INFO:tasks.workunit.client.0.trial069.stdout:[WRN] OSD_SLOW_PING_TIME_FRONT: Slow OSD heartbeats on front (longest 0.412ms) 2026-02-18T00:34:27.931 INFO:tasks.workunit.client.0.trial069.stdout: Slow OSD heartbeats on front from osd.0 [dc1,rack1] to osd.1 [dc2,rack2] 0.412 msec 2026-02-18T00:34:27.931 INFO:tasks.workunit.client.0.trial069.stdout: Slow OSD heartbeats on front from osd.0 [dc1,rack1] to osd.2 [dc3,rack3] 0.274 msec 2026-02-18T00:34:27.931 INFO:tasks.workunit.client.0.trial069.stdout: Slow OSD heartbeats on front from osd.1 [dc2,rack2] to osd.2 [dc3,rack3] 0.212 msec possibly improving 2026-02-18T00:34:27.931 INFO:tasks.workunit.client.0.trial069.stdout: Slow OSD heartbeats on front from osd.1 [dc2,rack2] to osd.0 [dc1,rack1] 0.206 msec 2026-02-18T00:34:27.931 INFO:tasks.workunit.client.0.trial069.stdout: Slow OSD heartbeats on front from osd.2 [dc3,rack3] to osd.1 [dc2,rack2] 0.195 msec 2026-02-18T00:34:27.931 INFO:tasks.workunit.client.0.trial069.stdout: Slow OSD heartbeats on front from osd.2 [dc3,rack3] to osd.0 [dc1,rack1] 0.162 msec possibly improving 2026-02-18T00:34:27.941 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:158: TEST_network_ping_test2: grep -q OSD_SLOW_PING_TIME_BACK td/network-ping/health 2026-02-18T00:34:27.942 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:159: TEST_network_ping_test2: grep -q OSD_SLOW_PING_TIME_FRONT td/network-ping/health 2026-02-18T00:34:27.943 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:160: TEST_network_ping_test2: grep -q 'Slow OSD heartbeats on front from osd[.][0-2] [[]dc[1-3],rack[1-3][]] to osd[.][0-2] [[]dc[1-3],rack[1-3][]]' td/network-ping/health 2026-02-18T00:34:27.944 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:162: TEST_network_ping_test2: rm -f td/network-ping/health 2026-02-18T00:34:27.946 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:20: run: teardown td/network-ping 2026-02-18T00:34:27.946 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/network-ping 2026-02-18T00:34:27.946 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T00:34:27.946 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/network-ping KILL 2026-02-18T00:34:27.946 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:34:27.947 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:34:27.947 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:34:27.947 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:34:27.948 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:34:28.257 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:34:28.258 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T00:34:28.259 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T00:34:28.260 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T00:34:28.261 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T00:34:28.261 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T00:34:28.262 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T00:34:28.263 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:34:28.263 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T00:34:28.263 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T00:34:28.264 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:34:28.265 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T00:34:28.265 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T00:34:28.266 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/network-ping 2026-02-18T00:34:28.956 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T00:34:28.956 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:34:28.957 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.24589 2026-02-18T00:34:28.957 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.24589 2026-02-18T00:34:28.959 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T00:34:28.959 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T00:34:28.959 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2401: main: code=0 2026-02-18T00:34:28.959 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2405: main: teardown td/network-ping 0 2026-02-18T00:34:28.959 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/network-ping 2026-02-18T00:34:28.959 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs=0 2026-02-18T00:34:28.959 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/network-ping KILL 2026-02-18T00:34:28.959 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:34:28.960 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:34:28.960 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:34:28.960 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:34:28.960 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:34:28.961 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:34:28.962 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T00:34:28.962 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T00:34:28.963 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T00:34:28.964 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T00:34:28.964 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T00:34:28.964 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T00:34:28.965 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:34:28.965 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T00:34:28.966 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T00:34:28.966 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:34:28.967 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T00:34:28.968 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o 0 = 1 ']' 2026-02-18T00:34:28.968 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/network-ping 2026-02-18T00:34:28.969 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T00:34:28.969 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:34:28.969 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.24589 2026-02-18T00:34:28.970 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.24589 2026-02-18T00:34:28.971 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T00:34:28.971 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T00:34:28.971 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2406: main: return 0 2026-02-18T00:34:28.974 INFO:teuthology.orchestra.run:Running command with timeout 3600 2026-02-18T00:34:28.974 DEBUG:teuthology.orchestra.run.trial069:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2026-02-18T00:34:29.028 INFO:tasks.workunit:Running workunit misc/ok-to-stop.sh... 2026-02-18T00:34:29.029 DEBUG:teuthology.orchestra.run.trial069:workunit test misc/ok-to-stop.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=adc1923395f2bcd6ae89b5d331d278364d1848ed TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh 2026-02-18T00:34:29.080 INFO:tasks.workunit.client.0.trial069.stderr:stty: 'standard input': Inappropriate ioctl for device 2026-02-18T00:34:29.084 INFO:tasks.workunit.client.0.trial069.stderr:+ PS4='${BASH_SOURCE[0]}:$LINENO: ${FUNCNAME[0]}: ' 2026-02-18T00:34:29.084 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2394: main: export PATH=.:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2026-02-18T00:34:29.084 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2394: main: PATH=.:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2026-02-18T00:34:29.084 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2395: main: export PYTHONWARNINGS=ignore 2026-02-18T00:34:29.085 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2395: main: PYTHONWARNINGS=ignore 2026-02-18T00:34:29.085 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2396: main: export CEPH_CONF=/dev/null 2026-02-18T00:34:29.085 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2396: main: CEPH_CONF=/dev/null 2026-02-18T00:34:29.085 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2397: main: unset CEPH_ARGS 2026-02-18T00:34:29.085 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2399: main: local code 2026-02-18T00:34:29.085 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2400: main: run td/ok-to-stop 2026-02-18T00:34:29.085 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:6: run: local dir=td/ok-to-stop 2026-02-18T00:34:29.085 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:7: run: shift 2026-02-18T00:34:29.085 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:9: run: export CEPH_MON_A=127.0.0.1:7150 2026-02-18T00:34:29.085 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:9: run: CEPH_MON_A=127.0.0.1:7150 2026-02-18T00:34:29.085 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:10: run: export CEPH_MON_B=127.0.0.1:7151 2026-02-18T00:34:29.085 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:10: run: CEPH_MON_B=127.0.0.1:7151 2026-02-18T00:34:29.086 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:11: run: export CEPH_MON_C=127.0.0.1:7152 2026-02-18T00:34:29.086 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:11: run: CEPH_MON_C=127.0.0.1:7152 2026-02-18T00:34:29.086 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:12: run: export CEPH_MON_D=127.0.0.1:7153 2026-02-18T00:34:29.086 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:12: run: CEPH_MON_D=127.0.0.1:7153 2026-02-18T00:34:29.086 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:13: run: export CEPH_MON_E=127.0.0.1:7154 2026-02-18T00:34:29.086 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:13: run: CEPH_MON_E=127.0.0.1:7154 2026-02-18T00:34:29.086 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:14: run: export CEPH_ARGS 2026-02-18T00:34:29.086 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:15: run: uuidgen 2026-02-18T00:34:29.087 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:15: run: CEPH_ARGS+='--fsid=a9d6a614-446b-449b-9b9f-370c60593bc7 --auth-supported=none ' 2026-02-18T00:34:29.087 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:16: run: export 'ORIG_CEPH_ARGS=--fsid=a9d6a614-446b-449b-9b9f-370c60593bc7 --auth-supported=none ' 2026-02-18T00:34:29.087 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:16: run: ORIG_CEPH_ARGS='--fsid=a9d6a614-446b-449b-9b9f-370c60593bc7 --auth-supported=none ' 2026-02-18T00:34:29.087 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:18: run: set 2026-02-18T00:34:29.088 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:18: run: sed -n -e 's/^\(TEST_[0-9a-z_]*\) .*/\1/p' 2026-02-18T00:34:29.089 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:18: run: local 'funcs=TEST_0_mds 2026-02-18T00:34:29.089 INFO:tasks.workunit.client.0.trial069.stderr:TEST_0_osd 2026-02-18T00:34:29.089 INFO:tasks.workunit.client.0.trial069.stderr:TEST_1_mon_checks 2026-02-18T00:34:29.089 INFO:tasks.workunit.client.0.trial069.stderr:TEST_2_mons_checks 2026-02-18T00:34:29.090 INFO:tasks.workunit.client.0.trial069.stderr:TEST_3_mons_checks 2026-02-18T00:34:29.090 INFO:tasks.workunit.client.0.trial069.stderr:TEST_4_mons_checks 2026-02-18T00:34:29.090 INFO:tasks.workunit.client.0.trial069.stderr:TEST_5_mons_checks' 2026-02-18T00:34:29.090 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:19: run: for func in $funcs 2026-02-18T00:34:29.090 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:20: run: setup td/ok-to-stop 2026-02-18T00:34:29.090 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/ok-to-stop 2026-02-18T00:34:29.090 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/ok-to-stop 2026-02-18T00:34:29.090 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/ok-to-stop 2026-02-18T00:34:29.090 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T00:34:29.090 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/ok-to-stop KILL 2026-02-18T00:34:29.090 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:34:29.090 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:34:29.091 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:34:29.091 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:34:29.091 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:34:29.091 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:34:29.091 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T00:34:29.092 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T00:34:29.092 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T00:34:29.094 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T00:34:29.094 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T00:34:29.094 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T00:34:29.095 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:34:29.095 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T00:34:29.096 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T00:34:29.096 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:34:29.097 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T00:34:29.098 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T00:34:29.098 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/ok-to-stop 2026-02-18T00:34:29.100 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T00:34:29.100 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:34:29.100 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.35978 2026-02-18T00:34:29.100 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.35978 2026-02-18T00:34:29.101 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T00:34:29.101 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T00:34:29.101 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/ok-to-stop 2026-02-18T00:34:29.103 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-18T00:34:29.103 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:34:29.103 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.35978 2026-02-18T00:34:29.103 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.35978 2026-02-18T00:34:29.104 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-18T00:34:29.106 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 1024 -le 1024 ']' 2026-02-18T00:34:29.106 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:127: setup: ulimit -n 4096 2026-02-18T00:34:29.106 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-18T00:34:29.106 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/ok-to-stop 1' TERM HUP INT 2026-02-18T00:34:29.106 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:21: run: TEST_0_mds td/ok-to-stop 2026-02-18T00:34:29.106 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:208: TEST_0_mds: local dir=td/ok-to-stop 2026-02-18T00:34:29.106 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:210: TEST_0_mds: CEPH_ARGS='--fsid=a9d6a614-446b-449b-9b9f-370c60593bc7 --auth-supported=none --mon-host=127.0.0.1:7150 ' 2026-02-18T00:34:29.106 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:212: TEST_0_mds: run_mon td/ok-to-stop a --public-addr=127.0.0.1:7150 2026-02-18T00:34:29.107 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/ok-to-stop 2026-02-18T00:34:29.107 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-18T00:34:29.107 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-18T00:34:29.107 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-18T00:34:29.107 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/ok-to-stop/a 2026-02-18T00:34:29.107 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/ok-to-stop/a --run-dir=td/ok-to-stop --public-addr=127.0.0.1:7150 2026-02-18T00:34:29.129 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-18T00:34:29.129 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:34:29.129 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:34:29.130 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:34:29.130 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:34:29.130 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.35978 2026-02-18T00:34:29.130 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.35978/$cluster-$name.asok' 2026-02-18T00:34:29.130 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/ok-to-stop/a '--log-file=td/ok-to-stop/$name.log' '--admin-socket=/tmp/ceph-asok.35978/$cluster-$name.asok' --mon-cluster-log-file=td/ok-to-stop/log --run-dir=td/ok-to-stop '--pid-file=td/ok-to-stop/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --public-addr=127.0.0.1:7150 2026-02-18T00:34:29.159 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-18T00:34:29.160 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-18T00:34:29.160 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T00:34:29.160 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-18T00:34:29.160 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-18T00:34:29.161 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-18T00:34:29.161 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-18T00:34:29.161 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:34:29.161 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:34:29.162 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:34:29.162 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:34:29.162 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.35978 2026-02-18T00:34:29.162 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.35978/ceph-mon.a.asok 2026-02-18T00:34:29.162 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T00:34:29.162 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.35978/ceph-mon.a.asok config get fsid 2026-02-18T00:34:29.217 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-18T00:34:29.217 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T00:34:29.217 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-18T00:34:29.217 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-18T00:34:29.219 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-18T00:34:29.219 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-18T00:34:29.219 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:34:29.219 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:34:29.219 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:34:29.219 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:34:29.219 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.35978 2026-02-18T00:34:29.219 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.35978/ceph-mon.a.asok 2026-02-18T00:34:29.219 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T00:34:29.219 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.35978/ceph-mon.a.asok config get mon_host 2026-02-18T00:34:29.274 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:213: TEST_0_mds: run_mgr td/ok-to-stop x 2026-02-18T00:34:29.275 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/ok-to-stop 2026-02-18T00:34:29.275 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-18T00:34:29.275 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-18T00:34:29.275 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-18T00:34:29.275 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/ok-to-stop/x 2026-02-18T00:34:29.275 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-18T00:34:29.391 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-18T00:34:29.391 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:34:29.391 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:34:29.391 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:34:29.391 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:34:29.391 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.35978 2026-02-18T00:34:29.391 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.35978/$cluster-$name.asok' 2026-02-18T00:34:29.392 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-18T00:34:29.392 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/ok-to-stop/x '--log-file=td/ok-to-stop/$name.log' '--admin-socket=/tmp/ceph-asok.35978/$cluster-$name.asok' --run-dir=td/ok-to-stop '--pid-file=td/ok-to-stop/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-18T00:34:29.412 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:214: TEST_0_mds: run_osd td/ok-to-stop 0 2026-02-18T00:34:29.412 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/ok-to-stop 2026-02-18T00:34:29.413 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T00:34:29.413 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-18T00:34:29.413 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T00:34:29.413 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/ok-to-stop/0 2026-02-18T00:34:29.413 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=a9d6a614-446b-449b-9b9f-370c60593bc7 --auth-supported=none --mon-host=127.0.0.1:7150 ' 2026-02-18T00:34:29.413 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T00:34:29.413 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T00:34:29.413 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T00:34:29.413 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/ok-to-stop/0' 2026-02-18T00:34:29.413 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/ok-to-stop/0/journal' 2026-02-18T00:34:29.413 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T00:34:29.414 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-18T00:34:29.414 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/ok-to-stop' 2026-02-18T00:34:29.414 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T00:34:29.414 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:34:29.414 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:34:29.414 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:34:29.414 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:34:29.414 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.35978 2026-02-18T00:34:29.414 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.35978/$cluster-$name.asok' 2026-02-18T00:34:29.414 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.35978/$cluster-$name.asok' 2026-02-18T00:34:29.414 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T00:34:29.414 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T00:34:29.415 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T00:34:29.415 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/ok-to-stop/$name.log' 2026-02-18T00:34:29.415 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/ok-to-stop/$name.pid' 2026-02-18T00:34:29.415 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T00:34:29.415 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T00:34:29.415 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T00:34:29.415 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T00:34:29.415 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T00:34:29.415 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-18T00:34:29.415 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/ok-to-stop/0 2026-02-18T00:34:29.415 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T00:34:29.416 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=6ff5defe-b894-4a6e-8dde-8449b2518b46 2026-02-18T00:34:29.416 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 6ff5defe-b894-4a6e-8dde-8449b2518b46' 2026-02-18T00:34:29.416 INFO:tasks.workunit.client.0.trial069.stdout:add osd0 6ff5defe-b894-4a6e-8dde-8449b2518b46 2026-02-18T00:34:29.417 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T00:34:29.424 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQAVCZVp01c/GRAAsu0mlNJ13nyX4CkZ6DPy1Q== 2026-02-18T00:34:29.424 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQAVCZVp01c/GRAAsu0mlNJ13nyX4CkZ6DPy1Q=="}' 2026-02-18T00:34:29.424 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 6ff5defe-b894-4a6e-8dde-8449b2518b46 -i td/ok-to-stop/0/new.json 2026-02-18T00:34:29.535 INFO:tasks.workunit.client.0.trial069.stdout:0 2026-02-18T00:34:29.543 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/ok-to-stop/0/new.json 2026-02-18T00:34:29.544 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=a9d6a614-446b-449b-9b9f-370c60593bc7 --auth-supported=none --mon-host=127.0.0.1:7150 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ok-to-stop/0 --osd-journal=td/ok-to-stop/0/journal --chdir= --run-dir=td/ok-to-stop '--admin-socket=/tmp/ceph-asok.35978/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ok-to-stop/$name.log' '--pid-file=td/ok-to-stop/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAVCZVp01c/GRAAsu0mlNJ13nyX4CkZ6DPy1Q== --osd-uuid 6ff5defe-b894-4a6e-8dde-8449b2518b46 2026-02-18T00:34:29.559 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:34:29.555+0000 7f7114e7ba40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:34:29.561 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:34:29.559+0000 7f7114e7ba40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:34:29.561 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:34:29.559+0000 7f7114e7ba40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:34:29.562 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:34:29.559+0000 7f7114e7ba40 -1 bdev(0x558c92d38c00 td/ok-to-stop/0/block) open stat got: (1) Operation not permitted 2026-02-18T00:34:29.562 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:34:29.559+0000 7f7114e7ba40 -1 bluestore(td/ok-to-stop/0) _read_fsid unparsable uuid 2026-02-18T00:34:30.223 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/ok-to-stop/0/keyring 2026-02-18T00:34:30.223 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T00:34:30.224 INFO:tasks.workunit.client.0.trial069.stdout:adding osd0 key to auth repository 2026-02-18T00:34:30.225 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-18T00:34:30.225 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/ok-to-stop/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T00:34:30.336 INFO:tasks.workunit.client.0.trial069.stdout:start osd.0 2026-02-18T00:34:30.337 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-18T00:34:30.337 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=a9d6a614-446b-449b-9b9f-370c60593bc7 --auth-supported=none --mon-host=127.0.0.1:7150 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ok-to-stop/0 --osd-journal=td/ok-to-stop/0/journal --chdir= --run-dir=td/ok-to-stop '--admin-socket=/tmp/ceph-asok.35978/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ok-to-stop/$name.log' '--pid-file=td/ok-to-stop/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T00:34:30.337 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T00:34:30.337 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T00:34:30.337 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T00:34:30.351 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:34:30.347+0000 7fac889dea40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:34:30.353 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:34:30.351+0000 7fac889dea40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:34:30.354 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:34:30.351+0000 7fac889dea40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:34:30.449 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-18T00:34:30.449 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:34:30.449 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-18T00:34:30.450 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:34:30.450 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:34:30.450 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:34:30.450 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:34:30.450 INFO:tasks.workunit.client.0.trial069.stdout:0 2026-02-18T00:34:30.451 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:34:30.451 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T00:34:30.560 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:34:30.937 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:34:30.935+0000 7fac889dea40 -1 Falling back to public interface 2026-02-18T00:34:31.562 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:34:31.562 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:34:31.562 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T00:34:31.562 INFO:tasks.workunit.client.0.trial069.stdout:1 2026-02-18T00:34:31.564 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T00:34:31.567 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:34:31.687 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:34:31.889 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:34:31.887+0000 7fac889dea40 -1 osd.0 0 log_to_monitors true 2026-02-18T00:34:32.688 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:34:32.688 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:34:32.689 INFO:tasks.workunit.client.0.trial069.stdout:2 2026-02-18T00:34:32.689 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-18T00:34:32.689 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:34:32.690 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T00:34:32.903 INFO:tasks.workunit.client.0.trial069.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/3783264565,v1:127.0.0.1:6801/3783264565] [v2:127.0.0.1:6802/3783264565,v1:127.0.0.1:6803/3783264565] exists,up 6ff5defe-b894-4a6e-8dde-8449b2518b46 2026-02-18T00:34:32.905 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:34:32.905 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:34:32.905 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:34:32.905 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:215: TEST_0_mds: run_mds td/ok-to-stop a 2026-02-18T00:34:32.905 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:570: run_mds: local dir=td/ok-to-stop 2026-02-18T00:34:32.906 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:571: run_mds: shift 2026-02-18T00:34:32.906 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:572: run_mds: local id=a 2026-02-18T00:34:32.906 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:573: run_mds: shift 2026-02-18T00:34:32.906 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:574: run_mds: local data=td/ok-to-stop/a 2026-02-18T00:34:32.906 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:577: run_mds: get_asok_path 2026-02-18T00:34:32.906 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:34:32.906 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:34:32.906 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:34:32.906 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:34:32.906 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.35978 2026-02-18T00:34:32.906 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.35978/$cluster-$name.asok' 2026-02-18T00:34:32.906 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:577: run_mds: ceph-mds --id a --debug-mds 20 --debug-objecter 20 --debug-ms 20 --chdir= --mds-data=td/ok-to-stop/a '--log-file=td/ok-to-stop/$name.log' '--admin-socket=/tmp/ceph-asok.35978/$cluster-$name.asok' --run-dir=td/ok-to-stop '--pid-file=td/ok-to-stop/$name.pid' 2026-02-18T00:34:32.929 INFO:tasks.workunit.client.0.trial069.stdout:starting mds.a at 2026-02-18T00:34:32.932 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:217: TEST_0_mds: ceph osd pool create meta 1 2026-02-18T00:34:33.248 INFO:tasks.workunit.client.0.trial069.stderr:pool 'meta' already exists 2026-02-18T00:34:33.258 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:218: TEST_0_mds: ceph osd pool create data 1 2026-02-18T00:34:33.552 INFO:tasks.workunit.client.0.trial069.stderr:pool 'data' already exists 2026-02-18T00:34:33.561 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:219: TEST_0_mds: ceph fs new myfs meta data 2026-02-18T00:34:33.909 INFO:tasks.workunit.client.0.trial069.stderr:filesystem 'myfs' already exists 2026-02-18T00:34:33.921 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:220: TEST_0_mds: sleep 5 2026-02-18T00:34:38.922 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:222: TEST_0_mds: ceph mds ok-to-stop a 2026-02-18T00:34:39.116 INFO:tasks.workunit.client.0.trial069.stderr:Error EBUSY: insufficent standby MDS daemons to stop active gids 4123 and/or standby gids 2026-02-18T00:34:39.121 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:223: TEST_0_mds: ceph mds ok-to-stop a dne 2026-02-18T00:34:39.308 INFO:tasks.workunit.client.0.trial069.stderr:Error EBUSY: insufficent standby MDS daemons to stop active gids 4123 and/or standby gids 2026-02-18T00:34:39.313 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:224: TEST_0_mds: ceph mds ok-to-stop dne 2026-02-18T00:34:39.587 INFO:tasks.workunit.client.0.trial069.stderr:should be safe to stop [dne] 2026-02-18T00:34:39.597 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:226: TEST_0_mds: run_mds td/ok-to-stop b 2026-02-18T00:34:39.598 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:570: run_mds: local dir=td/ok-to-stop 2026-02-18T00:34:39.598 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:571: run_mds: shift 2026-02-18T00:34:39.598 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:572: run_mds: local id=b 2026-02-18T00:34:39.598 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:573: run_mds: shift 2026-02-18T00:34:39.598 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:574: run_mds: local data=td/ok-to-stop/b 2026-02-18T00:34:39.598 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:577: run_mds: get_asok_path 2026-02-18T00:34:39.598 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:34:39.598 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:34:39.598 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:34:39.599 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:34:39.599 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.35978 2026-02-18T00:34:39.599 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.35978/$cluster-$name.asok' 2026-02-18T00:34:39.599 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:577: run_mds: ceph-mds --id b --debug-mds 20 --debug-objecter 20 --debug-ms 20 --chdir= --mds-data=td/ok-to-stop/b '--log-file=td/ok-to-stop/$name.log' '--admin-socket=/tmp/ceph-asok.35978/$cluster-$name.asok' --run-dir=td/ok-to-stop '--pid-file=td/ok-to-stop/$name.pid' 2026-02-18T00:34:39.614 INFO:tasks.workunit.client.0.trial069.stdout:starting mds.b at 2026-02-18T00:34:39.618 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:227: TEST_0_mds: sleep 5 2026-02-18T00:34:44.619 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:229: TEST_0_mds: ceph mds ok-to-stop a 2026-02-18T00:34:44.889 INFO:tasks.workunit.client.0.trial069.stderr:should be safe to stop [a] 2026-02-18T00:34:44.899 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:230: TEST_0_mds: ceph mds ok-to-stop b 2026-02-18T00:34:45.167 INFO:tasks.workunit.client.0.trial069.stderr:should be safe to stop [b] 2026-02-18T00:34:45.177 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:231: TEST_0_mds: ceph mds ok-to-stop a b 2026-02-18T00:34:45.365 INFO:tasks.workunit.client.0.trial069.stderr:Error EBUSY: insufficent standby MDS daemons to stop active gids 4123 and/or standby gids 4137 2026-02-18T00:34:45.369 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:232: TEST_0_mds: ceph mds ok-to-stop a dne1 dne2 2026-02-18T00:34:45.635 INFO:tasks.workunit.client.0.trial069.stderr:should be safe to stop [a,dne1,dne2] 2026-02-18T00:34:45.645 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:233: TEST_0_mds: ceph mds ok-to-stop b dne 2026-02-18T00:34:45.919 INFO:tasks.workunit.client.0.trial069.stderr:should be safe to stop [b,dne] 2026-02-18T00:34:45.928 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:234: TEST_0_mds: ceph mds ok-to-stop a b dne 2026-02-18T00:34:46.129 INFO:tasks.workunit.client.0.trial069.stderr:Error EBUSY: insufficent standby MDS daemons to stop active gids 4123 and/or standby gids 4137 2026-02-18T00:34:46.134 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:235: TEST_0_mds: ceph mds ok-to-stop dne1 dne2 2026-02-18T00:34:46.404 INFO:tasks.workunit.client.0.trial069.stderr:should be safe to stop [dne1,dne2] 2026-02-18T00:34:46.414 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:237: TEST_0_mds: kill_daemons td/ok-to-stop KILL mds.a 2026-02-18T00:34:46.415 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:34:46.415 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:34:46.415 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:34:46.415 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:34:46.416 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:34:46.522 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:34:46.522 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:22: run: kill_daemons td/ok-to-stop KILL 2026-02-18T00:34:46.522 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:34:46.523 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:34:46.523 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:34:46.523 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:34:46.523 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:34:46.631 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:34:46.631 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:23: run: teardown td/ok-to-stop 2026-02-18T00:34:46.632 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/ok-to-stop 2026-02-18T00:34:46.632 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T00:34:46.632 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/ok-to-stop KILL 2026-02-18T00:34:46.632 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:34:46.632 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:34:46.632 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:34:46.632 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:34:46.632 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:34:46.637 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:34:46.637 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T00:34:46.638 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T00:34:46.638 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T00:34:46.639 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T00:34:46.639 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T00:34:46.639 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T00:34:46.640 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:34:46.641 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T00:34:46.641 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T00:34:46.641 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:34:46.642 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T00:34:46.643 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T00:34:46.643 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/ok-to-stop 2026-02-18T00:34:46.649 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T00:34:46.649 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:34:46.649 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.35978 2026-02-18T00:34:46.649 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.35978 2026-02-18T00:34:46.651 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T00:34:46.651 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T00:34:46.651 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:19: run: for func in $funcs 2026-02-18T00:34:46.651 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:20: run: setup td/ok-to-stop 2026-02-18T00:34:46.651 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/ok-to-stop 2026-02-18T00:34:46.651 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/ok-to-stop 2026-02-18T00:34:46.651 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/ok-to-stop 2026-02-18T00:34:46.651 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T00:34:46.651 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/ok-to-stop KILL 2026-02-18T00:34:46.651 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:34:46.651 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:34:46.652 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:34:46.652 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:34:46.652 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:34:46.654 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:34:46.654 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T00:34:46.655 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T00:34:46.655 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T00:34:46.656 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T00:34:46.656 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T00:34:46.657 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T00:34:46.658 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:34:46.658 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T00:34:46.658 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T00:34:46.658 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:34:46.659 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T00:34:46.661 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T00:34:46.661 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/ok-to-stop 2026-02-18T00:34:46.662 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T00:34:46.662 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:34:46.662 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.35978 2026-02-18T00:34:46.662 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.35978 2026-02-18T00:34:46.663 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T00:34:46.663 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T00:34:46.663 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/ok-to-stop 2026-02-18T00:34:46.665 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-18T00:34:46.665 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:34:46.665 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.35978 2026-02-18T00:34:46.665 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.35978 2026-02-18T00:34:46.667 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-18T00:34:46.668 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-18T00:34:46.668 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-18T00:34:46.668 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/ok-to-stop 1' TERM HUP INT 2026-02-18T00:34:46.668 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:21: run: TEST_0_osd td/ok-to-stop 2026-02-18T00:34:46.668 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:241: TEST_0_osd: local dir=td/ok-to-stop 2026-02-18T00:34:46.668 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:243: TEST_0_osd: CEPH_ARGS='--fsid=a9d6a614-446b-449b-9b9f-370c60593bc7 --auth-supported=none --mon-host=127.0.0.1:7150 ' 2026-02-18T00:34:46.668 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:245: TEST_0_osd: run_mon td/ok-to-stop a --public-addr=127.0.0.1:7150 2026-02-18T00:34:46.668 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/ok-to-stop 2026-02-18T00:34:46.668 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-18T00:34:46.668 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-18T00:34:46.668 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-18T00:34:46.668 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/ok-to-stop/a 2026-02-18T00:34:46.668 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/ok-to-stop/a --run-dir=td/ok-to-stop --public-addr=127.0.0.1:7150 2026-02-18T00:34:46.689 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-18T00:34:46.689 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:34:46.689 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:34:46.689 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:34:46.689 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:34:46.689 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.35978 2026-02-18T00:34:46.690 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.35978/$cluster-$name.asok' 2026-02-18T00:34:46.690 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/ok-to-stop/a '--log-file=td/ok-to-stop/$name.log' '--admin-socket=/tmp/ceph-asok.35978/$cluster-$name.asok' --mon-cluster-log-file=td/ok-to-stop/log --run-dir=td/ok-to-stop '--pid-file=td/ok-to-stop/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --public-addr=127.0.0.1:7150 2026-02-18T00:34:46.719 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-18T00:34:46.720 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-18T00:34:46.720 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T00:34:46.720 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-18T00:34:46.720 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-18T00:34:46.720 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-18T00:34:46.721 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-18T00:34:46.721 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:34:46.721 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:34:46.722 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:34:46.722 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:34:46.722 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.35978 2026-02-18T00:34:46.722 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.35978/ceph-mon.a.asok 2026-02-18T00:34:46.722 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T00:34:46.722 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.35978/ceph-mon.a.asok config get fsid 2026-02-18T00:34:46.775 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-18T00:34:46.775 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T00:34:46.775 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-18T00:34:46.775 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-18T00:34:46.776 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-18T00:34:46.776 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-18T00:34:46.776 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:34:46.776 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:34:46.776 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:34:46.776 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:34:46.776 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.35978 2026-02-18T00:34:46.777 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.35978/ceph-mon.a.asok 2026-02-18T00:34:46.777 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T00:34:46.777 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.35978/ceph-mon.a.asok config get mon_host 2026-02-18T00:34:46.830 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:246: TEST_0_osd: run_mgr td/ok-to-stop x 2026-02-18T00:34:46.831 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/ok-to-stop 2026-02-18T00:34:46.831 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-18T00:34:46.831 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-18T00:34:46.831 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-18T00:34:46.831 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/ok-to-stop/x 2026-02-18T00:34:46.831 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-18T00:34:46.939 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-18T00:34:46.939 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:34:46.939 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:34:46.939 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:34:46.940 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:34:46.940 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.35978 2026-02-18T00:34:46.940 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.35978/$cluster-$name.asok' 2026-02-18T00:34:46.940 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-18T00:34:46.940 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/ok-to-stop/x '--log-file=td/ok-to-stop/$name.log' '--admin-socket=/tmp/ceph-asok.35978/$cluster-$name.asok' --run-dir=td/ok-to-stop '--pid-file=td/ok-to-stop/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-18T00:34:46.962 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:247: TEST_0_osd: run_osd td/ok-to-stop 0 2026-02-18T00:34:46.962 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/ok-to-stop 2026-02-18T00:34:46.962 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T00:34:46.962 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-18T00:34:46.962 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T00:34:46.962 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/ok-to-stop/0 2026-02-18T00:34:46.963 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=a9d6a614-446b-449b-9b9f-370c60593bc7 --auth-supported=none --mon-host=127.0.0.1:7150 ' 2026-02-18T00:34:46.963 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T00:34:46.963 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T00:34:46.963 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T00:34:46.963 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/ok-to-stop/0' 2026-02-18T00:34:46.963 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/ok-to-stop/0/journal' 2026-02-18T00:34:46.963 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T00:34:46.963 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-18T00:34:46.963 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/ok-to-stop' 2026-02-18T00:34:46.963 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T00:34:46.963 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:34:46.964 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:34:46.964 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:34:46.964 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:34:46.964 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.35978 2026-02-18T00:34:46.964 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.35978/$cluster-$name.asok' 2026-02-18T00:34:46.964 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.35978/$cluster-$name.asok' 2026-02-18T00:34:46.964 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T00:34:46.964 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T00:34:46.964 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T00:34:46.964 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/ok-to-stop/$name.log' 2026-02-18T00:34:46.964 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/ok-to-stop/$name.pid' 2026-02-18T00:34:46.964 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T00:34:46.965 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T00:34:46.965 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T00:34:46.965 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T00:34:46.965 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T00:34:46.965 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-18T00:34:46.965 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/ok-to-stop/0 2026-02-18T00:34:46.965 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T00:34:46.965 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=9b63c09a-2f43-46a5-9b12-d677b64a9948 2026-02-18T00:34:46.966 INFO:tasks.workunit.client.0.trial069.stdout:add osd0 9b63c09a-2f43-46a5-9b12-d677b64a9948 2026-02-18T00:34:46.966 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 9b63c09a-2f43-46a5-9b12-d677b64a9948' 2026-02-18T00:34:46.966 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T00:34:46.973 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQAmCZVpPX74ORAAH+RVQnqTJ4aY5sTR0qvZzg== 2026-02-18T00:34:46.974 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQAmCZVpPX74ORAAH+RVQnqTJ4aY5sTR0qvZzg=="}' 2026-02-18T00:34:46.974 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 9b63c09a-2f43-46a5-9b12-d677b64a9948 -i td/ok-to-stop/0/new.json 2026-02-18T00:34:47.085 INFO:tasks.workunit.client.0.trial069.stdout:0 2026-02-18T00:34:47.093 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/ok-to-stop/0/new.json 2026-02-18T00:34:47.094 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=a9d6a614-446b-449b-9b9f-370c60593bc7 --auth-supported=none --mon-host=127.0.0.1:7150 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ok-to-stop/0 --osd-journal=td/ok-to-stop/0/journal --chdir= --run-dir=td/ok-to-stop '--admin-socket=/tmp/ceph-asok.35978/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ok-to-stop/$name.log' '--pid-file=td/ok-to-stop/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAmCZVpPX74ORAAH+RVQnqTJ4aY5sTR0qvZzg== --osd-uuid 9b63c09a-2f43-46a5-9b12-d677b64a9948 2026-02-18T00:34:47.109 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:34:47.106+0000 7f4602a5ca40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:34:47.111 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:34:47.106+0000 7f4602a5ca40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:34:47.112 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:34:47.110+0000 7f4602a5ca40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:34:47.112 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:34:47.110+0000 7f4602a5ca40 -1 bdev(0x55df4cf20c00 td/ok-to-stop/0/block) open stat got: (1) Operation not permitted 2026-02-18T00:34:47.113 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:34:47.110+0000 7f4602a5ca40 -1 bluestore(td/ok-to-stop/0) _read_fsid unparsable uuid 2026-02-18T00:34:47.879 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/ok-to-stop/0/keyring 2026-02-18T00:34:47.880 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T00:34:47.880 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-18T00:34:47.881 INFO:tasks.workunit.client.0.trial069.stdout:adding osd0 key to auth repository 2026-02-18T00:34:47.881 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/ok-to-stop/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T00:34:48.000 INFO:tasks.workunit.client.0.trial069.stdout:start osd.0 2026-02-18T00:34:48.001 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-18T00:34:48.001 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=a9d6a614-446b-449b-9b9f-370c60593bc7 --auth-supported=none --mon-host=127.0.0.1:7150 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ok-to-stop/0 --osd-journal=td/ok-to-stop/0/journal --chdir= --run-dir=td/ok-to-stop '--admin-socket=/tmp/ceph-asok.35978/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ok-to-stop/$name.log' '--pid-file=td/ok-to-stop/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T00:34:48.001 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T00:34:48.001 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T00:34:48.002 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T00:34:48.022 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:34:48.018+0000 7f1ca5f03a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:34:48.024 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:34:48.022+0000 7f1ca5f03a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:34:48.026 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:34:48.022+0000 7f1ca5f03a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:34:48.107 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-18T00:34:48.107 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:34:48.107 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-18T00:34:48.107 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:34:48.108 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:34:48.108 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:34:48.108 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:34:48.108 INFO:tasks.workunit.client.0.trial069.stdout:0 2026-02-18T00:34:48.109 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:34:48.109 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T00:34:48.212 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:34:48.558 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:34:48.554+0000 7f1ca5f03a40 -1 Falling back to public interface 2026-02-18T00:34:49.213 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:34:49.214 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:34:49.214 INFO:tasks.workunit.client.0.trial069.stdout:1 2026-02-18T00:34:49.215 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T00:34:49.215 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:34:49.215 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T00:34:49.326 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:34:49.531 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:34:49.526+0000 7f1ca5f03a40 -1 osd.0 0 log_to_monitors true 2026-02-18T00:34:50.328 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:34:50.328 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:34:50.329 INFO:tasks.workunit.client.0.trial069.stdout:2 2026-02-18T00:34:50.329 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-18T00:34:50.329 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:34:50.329 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T00:34:50.547 INFO:tasks.workunit.client.0.trial069.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/4198699904,v1:127.0.0.1:6801/4198699904] [v2:127.0.0.1:6802/4198699904,v1:127.0.0.1:6803/4198699904] exists,up 9b63c09a-2f43-46a5-9b12-d677b64a9948 2026-02-18T00:34:50.550 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:34:50.550 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:34:50.550 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:34:50.550 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:248: TEST_0_osd: run_osd td/ok-to-stop 1 2026-02-18T00:34:50.550 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/ok-to-stop 2026-02-18T00:34:50.551 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T00:34:50.551 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2026-02-18T00:34:50.551 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T00:34:50.551 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/ok-to-stop/1 2026-02-18T00:34:50.551 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=a9d6a614-446b-449b-9b9f-370c60593bc7 --auth-supported=none --mon-host=127.0.0.1:7150 ' 2026-02-18T00:34:50.551 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T00:34:50.551 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T00:34:50.551 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T00:34:50.551 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/ok-to-stop/1' 2026-02-18T00:34:50.551 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/ok-to-stop/1/journal' 2026-02-18T00:34:50.551 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T00:34:50.552 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-18T00:34:50.552 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/ok-to-stop' 2026-02-18T00:34:50.552 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T00:34:50.552 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:34:50.552 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:34:50.552 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:34:50.552 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:34:50.552 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.35978 2026-02-18T00:34:50.552 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.35978/$cluster-$name.asok' 2026-02-18T00:34:50.552 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.35978/$cluster-$name.asok' 2026-02-18T00:34:50.552 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T00:34:50.552 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T00:34:50.552 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T00:34:50.553 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/ok-to-stop/$name.log' 2026-02-18T00:34:50.553 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/ok-to-stop/$name.pid' 2026-02-18T00:34:50.553 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T00:34:50.553 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T00:34:50.553 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T00:34:50.553 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T00:34:50.553 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T00:34:50.553 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-18T00:34:50.553 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/ok-to-stop/1 2026-02-18T00:34:50.553 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T00:34:50.554 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=fc390a46-d35e-453f-9bff-7ae4baa6062a 2026-02-18T00:34:50.554 INFO:tasks.workunit.client.0.trial069.stdout:add osd1 fc390a46-d35e-453f-9bff-7ae4baa6062a 2026-02-18T00:34:50.554 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 fc390a46-d35e-453f-9bff-7ae4baa6062a' 2026-02-18T00:34:50.555 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T00:34:50.561 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQAqCZVpCXNlIRAAbUj+GqvBexKwUPx4MVMqvQ== 2026-02-18T00:34:50.561 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQAqCZVpCXNlIRAAbUj+GqvBexKwUPx4MVMqvQ=="}' 2026-02-18T00:34:50.562 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new fc390a46-d35e-453f-9bff-7ae4baa6062a -i td/ok-to-stop/1/new.json 2026-02-18T00:34:50.768 INFO:tasks.workunit.client.0.trial069.stdout:1 2026-02-18T00:34:50.777 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/ok-to-stop/1/new.json 2026-02-18T00:34:50.778 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=a9d6a614-446b-449b-9b9f-370c60593bc7 --auth-supported=none --mon-host=127.0.0.1:7150 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ok-to-stop/1 --osd-journal=td/ok-to-stop/1/journal --chdir= --run-dir=td/ok-to-stop '--admin-socket=/tmp/ceph-asok.35978/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ok-to-stop/$name.log' '--pid-file=td/ok-to-stop/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAqCZVpCXNlIRAAbUj+GqvBexKwUPx4MVMqvQ== --osd-uuid fc390a46-d35e-453f-9bff-7ae4baa6062a 2026-02-18T00:34:50.793 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:34:50.790+0000 7fafc6673a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:34:50.795 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:34:50.790+0000 7fafc6673a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:34:50.796 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:34:50.790+0000 7fafc6673a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:34:50.796 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:34:50.794+0000 7fafc6673a40 -1 bdev(0x564d6c626c00 td/ok-to-stop/1/block) open stat got: (1) Operation not permitted 2026-02-18T00:34:50.796 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:34:50.794+0000 7fafc6673a40 -1 bluestore(td/ok-to-stop/1) _read_fsid unparsable uuid 2026-02-18T00:34:51.455 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/ok-to-stop/1/keyring 2026-02-18T00:34:51.455 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T00:34:51.456 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2026-02-18T00:34:51.456 INFO:tasks.workunit.client.0.trial069.stdout:adding osd1 key to auth repository 2026-02-18T00:34:51.456 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/ok-to-stop/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T00:34:51.741 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2026-02-18T00:34:51.742 INFO:tasks.workunit.client.0.trial069.stdout:start osd.1 2026-02-18T00:34:51.743 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=a9d6a614-446b-449b-9b9f-370c60593bc7 --auth-supported=none --mon-host=127.0.0.1:7150 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ok-to-stop/1 --osd-journal=td/ok-to-stop/1/journal --chdir= --run-dir=td/ok-to-stop '--admin-socket=/tmp/ceph-asok.35978/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ok-to-stop/$name.log' '--pid-file=td/ok-to-stop/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T00:34:51.743 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T00:34:51.743 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T00:34:51.743 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T00:34:51.763 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:34:51.758+0000 7f90473aca40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:34:51.765 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:34:51.762+0000 7f90473aca40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:34:51.765 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:34:51.762+0000 7f90473aca40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:34:51.954 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2026-02-18T00:34:51.954 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:34:51.954 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-18T00:34:51.954 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:34:51.954 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:34:51.955 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:34:51.955 INFO:tasks.workunit.client.0.trial069.stdout:0 2026-02-18T00:34:51.956 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:34:51.956 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:34:51.956 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-18T00:34:52.114 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:34:52.110+0000 7f90473aca40 -1 Falling back to public interface 2026-02-18T00:34:52.162 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:34:52.685 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:34:52.682+0000 7f90473aca40 -1 osd.1 0 log_to_monitors true 2026-02-18T00:34:53.164 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:34:53.164 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:34:53.164 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T00:34:53.164 INFO:tasks.workunit.client.0.trial069.stdout:1 2026-02-18T00:34:53.164 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:34:53.164 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-18T00:34:53.379 INFO:tasks.workunit.client.0.trial069.stdout:osd.1 up in weight 1 up_from 10 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/3340392805,v1:127.0.0.1:6811/3340392805] [v2:127.0.0.1:6812/3340392805,v1:127.0.0.1:6813/3340392805] exists,up fc390a46-d35e-453f-9bff-7ae4baa6062a 2026-02-18T00:34:53.382 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:34:53.382 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:34:53.382 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:34:53.382 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:249: TEST_0_osd: run_osd td/ok-to-stop 2 2026-02-18T00:34:53.382 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/ok-to-stop 2026-02-18T00:34:53.382 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T00:34:53.383 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2026-02-18T00:34:53.383 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T00:34:53.383 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/ok-to-stop/2 2026-02-18T00:34:53.383 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=a9d6a614-446b-449b-9b9f-370c60593bc7 --auth-supported=none --mon-host=127.0.0.1:7150 ' 2026-02-18T00:34:53.383 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T00:34:53.383 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T00:34:53.383 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T00:34:53.383 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/ok-to-stop/2' 2026-02-18T00:34:53.383 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/ok-to-stop/2/journal' 2026-02-18T00:34:53.383 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T00:34:53.383 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-18T00:34:53.383 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/ok-to-stop' 2026-02-18T00:34:53.384 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T00:34:53.384 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:34:53.384 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:34:53.384 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:34:53.384 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:34:53.384 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.35978 2026-02-18T00:34:53.384 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.35978/$cluster-$name.asok' 2026-02-18T00:34:53.384 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.35978/$cluster-$name.asok' 2026-02-18T00:34:53.384 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T00:34:53.384 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T00:34:53.384 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T00:34:53.384 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/ok-to-stop/$name.log' 2026-02-18T00:34:53.384 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/ok-to-stop/$name.pid' 2026-02-18T00:34:53.385 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T00:34:53.385 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T00:34:53.385 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T00:34:53.385 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T00:34:53.385 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T00:34:53.385 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-18T00:34:53.385 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/ok-to-stop/2 2026-02-18T00:34:53.386 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T00:34:53.386 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=8203369b-8fe7-401e-bfaf-47e4c0b6c475 2026-02-18T00:34:53.386 INFO:tasks.workunit.client.0.trial069.stdout:add osd2 8203369b-8fe7-401e-bfaf-47e4c0b6c475 2026-02-18T00:34:53.387 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 8203369b-8fe7-401e-bfaf-47e4c0b6c475' 2026-02-18T00:34:53.387 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T00:34:53.394 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQAtCZVpBiVsFxAAwqIIU+dUDx4EqYoJuQ40DA== 2026-02-18T00:34:53.394 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQAtCZVpBiVsFxAAwqIIU+dUDx4EqYoJuQ40DA=="}' 2026-02-18T00:34:53.394 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 8203369b-8fe7-401e-bfaf-47e4c0b6c475 -i td/ok-to-stop/2/new.json 2026-02-18T00:34:53.609 INFO:tasks.workunit.client.0.trial069.stdout:2 2026-02-18T00:34:53.618 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/ok-to-stop/2/new.json 2026-02-18T00:34:53.619 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --fsid=a9d6a614-446b-449b-9b9f-370c60593bc7 --auth-supported=none --mon-host=127.0.0.1:7150 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ok-to-stop/2 --osd-journal=td/ok-to-stop/2/journal --chdir= --run-dir=td/ok-to-stop '--admin-socket=/tmp/ceph-asok.35978/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ok-to-stop/$name.log' '--pid-file=td/ok-to-stop/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAtCZVpBiVsFxAAwqIIU+dUDx4EqYoJuQ40DA== --osd-uuid 8203369b-8fe7-401e-bfaf-47e4c0b6c475 2026-02-18T00:34:53.633 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:34:53.630+0000 7fd467f10a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:34:53.635 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:34:53.630+0000 7fd467f10a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:34:53.636 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:34:53.634+0000 7fd467f10a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:34:53.637 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:34:53.634+0000 7fd467f10a40 -1 bdev(0x55b494d86c00 td/ok-to-stop/2/block) open stat got: (1) Operation not permitted 2026-02-18T00:34:53.637 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:34:53.634+0000 7fd467f10a40 -1 bluestore(td/ok-to-stop/2) _read_fsid unparsable uuid 2026-02-18T00:34:54.307 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/ok-to-stop/2/keyring 2026-02-18T00:34:54.307 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T00:34:54.308 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2026-02-18T00:34:54.308 INFO:tasks.workunit.client.0.trial069.stdout:adding osd2 key to auth repository 2026-02-18T00:34:54.308 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/ok-to-stop/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T00:34:54.584 INFO:tasks.workunit.client.0.trial069.stdout:start osd.2 2026-02-18T00:34:54.585 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2026-02-18T00:34:54.585 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --fsid=a9d6a614-446b-449b-9b9f-370c60593bc7 --auth-supported=none --mon-host=127.0.0.1:7150 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ok-to-stop/2 --osd-journal=td/ok-to-stop/2/journal --chdir= --run-dir=td/ok-to-stop '--admin-socket=/tmp/ceph-asok.35978/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ok-to-stop/$name.log' '--pid-file=td/ok-to-stop/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T00:34:54.585 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T00:34:54.585 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T00:34:54.585 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T00:34:54.606 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:34:54.602+0000 7fbc0fff5a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:34:54.608 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:34:54.606+0000 7fbc0fff5a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:34:54.609 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:34:54.606+0000 7fbc0fff5a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:34:54.795 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2026-02-18T00:34:54.795 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:34:54.795 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-18T00:34:54.795 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:34:54.795 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:34:54.795 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:34:54.795 INFO:tasks.workunit.client.0.trial069.stdout:0 2026-02-18T00:34:54.796 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:34:54.796 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:34:54.796 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-18T00:34:54.938 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:34:54.934+0000 7fbc0fff5a40 -1 Falling back to public interface 2026-02-18T00:34:55.001 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:34:55.562 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:34:55.558+0000 7fbc0fff5a40 -1 osd.2 0 log_to_monitors true 2026-02-18T00:34:56.003 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:34:56.003 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:34:56.004 INFO:tasks.workunit.client.0.trial069.stdout:1 2026-02-18T00:34:56.004 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T00:34:56.005 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:34:56.005 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-18T00:34:56.211 INFO:tasks.workunit.client.0.trial069.stdout:osd.2 up in weight 1 up_from 14 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/2100551961,v1:127.0.0.1:6819/2100551961] [v2:127.0.0.1:6820/2100551961,v1:127.0.0.1:6821/2100551961] exists,up 8203369b-8fe7-401e-bfaf-47e4c0b6c475 2026-02-18T00:34:56.212 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:34:56.213 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:34:56.213 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:34:56.213 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:250: TEST_0_osd: run_osd td/ok-to-stop 3 2026-02-18T00:34:56.213 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/ok-to-stop 2026-02-18T00:34:56.213 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T00:34:56.213 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=3 2026-02-18T00:34:56.213 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T00:34:56.213 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/ok-to-stop/3 2026-02-18T00:34:56.213 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=a9d6a614-446b-449b-9b9f-370c60593bc7 --auth-supported=none --mon-host=127.0.0.1:7150 ' 2026-02-18T00:34:56.213 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T00:34:56.213 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T00:34:56.213 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T00:34:56.213 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/ok-to-stop/3' 2026-02-18T00:34:56.213 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/ok-to-stop/3/journal' 2026-02-18T00:34:56.213 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T00:34:56.213 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-18T00:34:56.213 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/ok-to-stop' 2026-02-18T00:34:56.213 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T00:34:56.213 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:34:56.214 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:34:56.214 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:34:56.214 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:34:56.214 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.35978 2026-02-18T00:34:56.214 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.35978/$cluster-$name.asok' 2026-02-18T00:34:56.214 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.35978/$cluster-$name.asok' 2026-02-18T00:34:56.214 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T00:34:56.214 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T00:34:56.214 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T00:34:56.214 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/ok-to-stop/$name.log' 2026-02-18T00:34:56.214 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/ok-to-stop/$name.pid' 2026-02-18T00:34:56.214 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T00:34:56.214 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T00:34:56.214 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T00:34:56.214 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T00:34:56.215 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T00:34:56.215 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-18T00:34:56.215 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/ok-to-stop/3 2026-02-18T00:34:56.215 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T00:34:56.215 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=fa3387a8-3203-4114-8965-71d303d4f767 2026-02-18T00:34:56.215 INFO:tasks.workunit.client.0.trial069.stdout:add osd3 fa3387a8-3203-4114-8965-71d303d4f767 2026-02-18T00:34:56.215 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd3 fa3387a8-3203-4114-8965-71d303d4f767' 2026-02-18T00:34:56.215 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T00:34:56.226 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQAwCZVpYaxvDRAA+o7ZgWGwTiB1ydFPzps/zw== 2026-02-18T00:34:56.226 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQAwCZVpYaxvDRAA+o7ZgWGwTiB1ydFPzps/zw=="}' 2026-02-18T00:34:56.226 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new fa3387a8-3203-4114-8965-71d303d4f767 -i td/ok-to-stop/3/new.json 2026-02-18T00:34:56.441 INFO:tasks.workunit.client.0.trial069.stdout:3 2026-02-18T00:34:56.451 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/ok-to-stop/3/new.json 2026-02-18T00:34:56.452 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 3 --fsid=a9d6a614-446b-449b-9b9f-370c60593bc7 --auth-supported=none --mon-host=127.0.0.1:7150 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ok-to-stop/3 --osd-journal=td/ok-to-stop/3/journal --chdir= --run-dir=td/ok-to-stop '--admin-socket=/tmp/ceph-asok.35978/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ok-to-stop/$name.log' '--pid-file=td/ok-to-stop/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAwCZVpYaxvDRAA+o7ZgWGwTiB1ydFPzps/zw== --osd-uuid fa3387a8-3203-4114-8965-71d303d4f767 2026-02-18T00:34:56.467 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:34:56.462+0000 7f000a9c1a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:34:56.469 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:34:56.466+0000 7f000a9c1a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:34:56.470 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:34:56.466+0000 7f000a9c1a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:34:56.470 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:34:56.466+0000 7f000a9c1a40 -1 bdev(0x55e74fb18c00 td/ok-to-stop/3/block) open stat got: (1) Operation not permitted 2026-02-18T00:34:56.470 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:34:56.466+0000 7f000a9c1a40 -1 bluestore(td/ok-to-stop/3) _read_fsid unparsable uuid 2026-02-18T00:34:57.123 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/ok-to-stop/3/keyring 2026-02-18T00:34:57.123 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T00:34:57.124 INFO:tasks.workunit.client.0.trial069.stdout:adding osd3 key to auth repository 2026-02-18T00:34:57.124 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd3 key to auth repository 2026-02-18T00:34:57.125 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/ok-to-stop/3/keyring auth add osd.3 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T00:34:57.409 INFO:tasks.workunit.client.0.trial069.stdout:start osd.3 2026-02-18T00:34:57.410 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.3 2026-02-18T00:34:57.410 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 3 --fsid=a9d6a614-446b-449b-9b9f-370c60593bc7 --auth-supported=none --mon-host=127.0.0.1:7150 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ok-to-stop/3 --osd-journal=td/ok-to-stop/3/journal --chdir= --run-dir=td/ok-to-stop '--admin-socket=/tmp/ceph-asok.35978/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ok-to-stop/$name.log' '--pid-file=td/ok-to-stop/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T00:34:57.410 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T00:34:57.411 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T00:34:57.411 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T00:34:57.432 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:34:57.426+0000 7f9f7e1eca40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:34:57.433 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:34:57.430+0000 7f9f7e1eca40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:34:57.434 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:34:57.430+0000 7f9f7e1eca40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:34:57.621 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 3 2026-02-18T00:34:57.622 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:34:57.622 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=3 2026-02-18T00:34:57.622 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:34:57.622 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:34:57.622 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:34:57.622 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:34:57.622 INFO:tasks.workunit.client.0.trial069.stdout:0 2026-02-18T00:34:57.623 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:34:57.623 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-18T00:34:57.790 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:34:57.786+0000 7f9f7e1eca40 -1 Falling back to public interface 2026-02-18T00:34:57.833 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:34:58.403 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:34:58.398+0000 7f9f7e1eca40 -1 osd.3 0 log_to_monitors true 2026-02-18T00:34:58.835 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:34:58.835 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:34:58.835 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T00:34:58.836 INFO:tasks.workunit.client.0.trial069.stdout:1 2026-02-18T00:34:58.836 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:34:58.836 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-18T00:34:59.045 INFO:tasks.workunit.client.0.trial069.stdout:osd.3 up in weight 1 up_from 18 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6826/3709843270,v1:127.0.0.1:6827/3709843270] [v2:127.0.0.1:6828/3709843270,v1:127.0.0.1:6829/3709843270] exists,up fa3387a8-3203-4114-8965-71d303d4f767 2026-02-18T00:34:59.046 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:34:59.046 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:34:59.046 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:34:59.046 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:252: TEST_0_osd: ceph osd erasure-code-profile set ec-profile m=2 k=2 crush-failure-domain=osd 2026-02-18T00:34:59.283 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:253: TEST_0_osd: ceph osd pool create ec erasure ec-profile 2026-02-18T00:34:59.670 INFO:tasks.workunit.client.0.trial069.stderr:pool 'ec' already exists 2026-02-18T00:34:59.680 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:255: TEST_0_osd: wait_for_clean 2026-02-18T00:34:59.680 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-18T00:34:59.681 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-18T00:34:59.681 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-18T00:34:59.681 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-18T00:34:59.681 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-18T00:34:59.681 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-18T00:34:59.682 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-18T00:34:59.682 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-18T00:34:59.682 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-18T00:34:59.790 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-18T00:34:59.790 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-18T00:34:59.790 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-18T00:34:59.790 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-18T00:34:59.790 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-18T00:34:59.790 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-18T00:34:59.999 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-18T00:34:59.999 INFO:tasks.workunit.client.0.trial069.stderr:1 2026-02-18T00:34:59.999 INFO:tasks.workunit.client.0.trial069.stderr:2 2026-02-18T00:34:59.999 INFO:tasks.workunit.client.0.trial069.stderr:3' 2026-02-18T00:34:59.999 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-18T00:34:59.999 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:34:59.999 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-18T00:35:00.079 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836484 2026-02-18T00:35:00.079 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836484 2026-02-18T00:35:00.079 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836484' 2026-02-18T00:35:00.079 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:35:00.079 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-18T00:35:00.154 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=42949672964 2026-02-18T00:35:00.154 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 42949672964 2026-02-18T00:35:00.154 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836484 1-42949672964' 2026-02-18T00:35:00.154 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:35:00.154 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-18T00:35:00.230 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542147 2026-02-18T00:35:00.230 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542147 2026-02-18T00:35:00.230 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836484 1-42949672964 2-60129542147' 2026-02-18T00:35:00.230 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:35:00.231 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2026-02-18T00:35:00.306 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=77309411331 2026-02-18T00:35:00.306 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 77309411331 2026-02-18T00:35:00.307 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836484 1-42949672964 2-60129542147 3-77309411331' 2026-02-18T00:35:00.307 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:35:00.307 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836484 2026-02-18T00:35:00.307 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:35:00.308 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-18T00:35:00.308 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-21474836484 2026-02-18T00:35:00.308 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:35:00.309 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=21474836484 2026-02-18T00:35:00.310 INFO:tasks.workunit.client.0.trial069.stdout:waiting osd.0 seq 21474836484 2026-02-18T00:35:00.310 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 21474836484' 2026-02-18T00:35:00.310 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T00:35:00.522 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 21474836482 -lt 21474836484 2026-02-18T00:35:00.522 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-18T00:35:01.523 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-18T00:35:01.524 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T00:35:01.737 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 21474836485 -lt 21474836484 2026-02-18T00:35:01.737 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:35:01.738 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-42949672964 2026-02-18T00:35:01.738 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:35:01.739 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=1 2026-02-18T00:35:01.739 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 1-42949672964 2026-02-18T00:35:01.740 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:35:01.741 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=42949672964 2026-02-18T00:35:01.741 INFO:tasks.workunit.client.0.trial069.stdout:waiting osd.1 seq 42949672964 2026-02-18T00:35:01.742 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.1 seq 42949672964' 2026-02-18T00:35:01.742 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-18T00:35:01.953 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 42949672964 -lt 42949672964 2026-02-18T00:35:01.954 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:35:01.954 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542147 2026-02-18T00:35:01.954 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:35:01.955 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=2 2026-02-18T00:35:01.956 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 2-60129542147 2026-02-18T00:35:01.956 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:35:01.957 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=60129542147 2026-02-18T00:35:01.957 INFO:tasks.workunit.client.0.trial069.stdout:waiting osd.2 seq 60129542147 2026-02-18T00:35:01.958 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.2 seq 60129542147' 2026-02-18T00:35:01.958 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-18T00:35:02.167 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 60129542147 -lt 60129542147 2026-02-18T00:35:02.167 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:35:02.167 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-77309411331 2026-02-18T00:35:02.168 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:35:02.168 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=3 2026-02-18T00:35:02.169 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 3-77309411331 2026-02-18T00:35:02.169 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:35:02.170 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=77309411331 2026-02-18T00:35:02.171 INFO:tasks.workunit.client.0.trial069.stdout:waiting osd.3 seq 77309411331 2026-02-18T00:35:02.171 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.3 seq 77309411331' 2026-02-18T00:35:02.171 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-18T00:35:02.392 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 77309411331 -lt 77309411331 2026-02-18T00:35:02.393 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-18T00:35:02.393 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T00:35:02.393 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T00:35:02.672 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 32 == 0 2026-02-18T00:35:02.672 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-18T00:35:02.672 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-18T00:35:02.672 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-18T00:35:02.672 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-18T00:35:02.672 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-18T00:35:02.672 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-18T00:35:02.673 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-18T00:35:02.883 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=32 2026-02-18T00:35:02.883 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-18T00:35:02.884 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T00:35:02.884 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T00:35:03.166 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 32 = 32 2026-02-18T00:35:03.167 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-18T00:35:03.167 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-18T00:35:03.167 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:258: TEST_0_osd: ceph osd pool set ec min_size 3 2026-02-18T00:35:03.419 INFO:tasks.workunit.client.0.trial069.stderr:set pool 1 min_size to 3 2026-02-18T00:35:03.431 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:259: TEST_0_osd: wait_for_clean 2026-02-18T00:35:03.432 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-18T00:35:03.432 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-18T00:35:03.432 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-18T00:35:03.432 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-18T00:35:03.433 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-18T00:35:03.433 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-18T00:35:03.433 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-18T00:35:03.433 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-18T00:35:03.433 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-18T00:35:03.545 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-18T00:35:03.545 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-18T00:35:03.546 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-18T00:35:03.546 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-18T00:35:03.546 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-18T00:35:03.546 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-18T00:35:03.758 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-18T00:35:03.758 INFO:tasks.workunit.client.0.trial069.stderr:1 2026-02-18T00:35:03.758 INFO:tasks.workunit.client.0.trial069.stderr:2 2026-02-18T00:35:03.758 INFO:tasks.workunit.client.0.trial069.stderr:3' 2026-02-18T00:35:03.758 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-18T00:35:03.758 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:35:03.759 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-18T00:35:03.836 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836487 2026-02-18T00:35:03.836 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836487 2026-02-18T00:35:03.836 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836487' 2026-02-18T00:35:03.836 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:35:03.836 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-18T00:35:03.926 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=42949672967 2026-02-18T00:35:03.926 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 42949672967 2026-02-18T00:35:03.926 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836487 1-42949672967' 2026-02-18T00:35:03.927 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:35:03.927 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-18T00:35:04.005 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542150 2026-02-18T00:35:04.005 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542150 2026-02-18T00:35:04.006 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836487 1-42949672967 2-60129542150' 2026-02-18T00:35:04.006 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:35:04.006 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2026-02-18T00:35:04.079 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=77309411333 2026-02-18T00:35:04.080 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 77309411333 2026-02-18T00:35:04.080 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836487 1-42949672967 2-60129542150 3-77309411333' 2026-02-18T00:35:04.080 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:35:04.080 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836487 2026-02-18T00:35:04.080 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:35:04.081 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-18T00:35:04.082 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-21474836487 2026-02-18T00:35:04.082 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:35:04.083 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=21474836487 2026-02-18T00:35:04.084 INFO:tasks.workunit.client.0.trial069.stdout:waiting osd.0 seq 21474836487 2026-02-18T00:35:04.084 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 21474836487' 2026-02-18T00:35:04.084 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T00:35:04.305 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 21474836485 -lt 21474836487 2026-02-18T00:35:04.305 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-18T00:35:05.306 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-18T00:35:05.307 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T00:35:05.521 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 21474836487 -lt 21474836487 2026-02-18T00:35:05.521 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:35:05.522 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-42949672967 2026-02-18T00:35:05.522 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:35:05.523 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=1 2026-02-18T00:35:05.523 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 1-42949672967 2026-02-18T00:35:05.524 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:35:05.525 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=42949672967 2026-02-18T00:35:05.525 INFO:tasks.workunit.client.0.trial069.stdout:waiting osd.1 seq 42949672967 2026-02-18T00:35:05.526 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.1 seq 42949672967' 2026-02-18T00:35:05.526 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-18T00:35:05.749 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 42949672967 -lt 42949672967 2026-02-18T00:35:05.749 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:35:05.750 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542150 2026-02-18T00:35:05.750 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:35:05.750 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=2 2026-02-18T00:35:05.751 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 2-60129542150 2026-02-18T00:35:05.751 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:35:05.752 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=60129542150 2026-02-18T00:35:05.753 INFO:tasks.workunit.client.0.trial069.stdout:waiting osd.2 seq 60129542150 2026-02-18T00:35:05.753 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.2 seq 60129542150' 2026-02-18T00:35:05.753 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-18T00:35:05.965 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 60129542150 -lt 60129542150 2026-02-18T00:35:05.966 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:35:05.966 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-77309411333 2026-02-18T00:35:05.967 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:35:05.967 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=3 2026-02-18T00:35:05.968 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 3-77309411333 2026-02-18T00:35:05.968 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:35:05.969 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=77309411333 2026-02-18T00:35:05.970 INFO:tasks.workunit.client.0.trial069.stdout:waiting osd.3 seq 77309411333 2026-02-18T00:35:05.970 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.3 seq 77309411333' 2026-02-18T00:35:05.970 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-18T00:35:06.178 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 77309411334 -lt 77309411333 2026-02-18T00:35:06.179 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-18T00:35:06.179 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T00:35:06.179 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T00:35:06.454 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 32 == 0 2026-02-18T00:35:06.454 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-18T00:35:06.455 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-18T00:35:06.455 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-18T00:35:06.455 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-18T00:35:06.455 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-18T00:35:06.455 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-18T00:35:06.455 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-18T00:35:06.660 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=32 2026-02-18T00:35:06.660 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-18T00:35:06.661 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T00:35:06.661 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T00:35:06.932 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 32 = 32 2026-02-18T00:35:06.932 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-18T00:35:06.932 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-18T00:35:06.932 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:261: TEST_0_osd: ceph osd ok-to-stop 0 2026-02-18T00:35:07.127 INFO:tasks.workunit.client.0.trial069.stdout:{"ok_to_stop":true,"osds":[0],"num_ok_pgs":32,"num_not_ok_pgs":0,"ok_become_degraded":["1.0","1.1","1.2","1.3","1.4","1.5","1.6","1.7","1.8","1.9","1.a","1.b","1.c","1.d","1.e","1.f","1.10","1.11","1.12","1.13","1.14","1.15","1.16","1.17","1.18","1.19","1.1a","1.1b","1.1c","1.1d","1.1e","1.1f"]} 2026-02-18T00:35:07.138 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:262: TEST_0_osd: ceph osd ok-to-stop 1 2026-02-18T00:35:07.346 INFO:tasks.workunit.client.0.trial069.stdout:{"ok_to_stop":true,"osds":[1],"num_ok_pgs":32,"num_not_ok_pgs":0,"ok_become_degraded":["1.0","1.1","1.2","1.3","1.4","1.5","1.6","1.7","1.8","1.9","1.a","1.b","1.c","1.d","1.e","1.f","1.10","1.11","1.12","1.13","1.14","1.15","1.16","1.17","1.18","1.19","1.1a","1.1b","1.1c","1.1d","1.1e","1.1f"]} 2026-02-18T00:35:07.356 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:263: TEST_0_osd: ceph osd ok-to-stop 2 2026-02-18T00:35:07.571 INFO:tasks.workunit.client.0.trial069.stdout:{"ok_to_stop":true,"osds":[2],"num_ok_pgs":32,"num_not_ok_pgs":0,"ok_become_degraded":["1.0","1.1","1.2","1.3","1.4","1.5","1.6","1.7","1.8","1.9","1.a","1.b","1.c","1.d","1.e","1.f","1.10","1.11","1.12","1.13","1.14","1.15","1.16","1.17","1.18","1.19","1.1a","1.1b","1.1c","1.1d","1.1e","1.1f"]} 2026-02-18T00:35:07.580 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:264: TEST_0_osd: ceph osd ok-to-stop 3 2026-02-18T00:35:07.786 INFO:tasks.workunit.client.0.trial069.stdout:{"ok_to_stop":true,"osds":[3],"num_ok_pgs":32,"num_not_ok_pgs":0,"ok_become_degraded":["1.0","1.1","1.2","1.3","1.4","1.5","1.6","1.7","1.8","1.9","1.a","1.b","1.c","1.d","1.e","1.f","1.10","1.11","1.12","1.13","1.14","1.15","1.16","1.17","1.18","1.19","1.1a","1.1b","1.1c","1.1d","1.1e","1.1f"]} 2026-02-18T00:35:07.796 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:265: TEST_0_osd: ceph osd ok-to-stop 0 1 2026-02-18T00:35:07.966 INFO:tasks.workunit.client.0.trial069.stdout:{"ok_to_stop":false,"osds":[0,1],"num_ok_pgs":0,"num_not_ok_pgs":32,"bad_become_inactive":["1.0","1.1","1.2","1.3","1.4","1.5","1.6","1.7","1.8","1.9","1.a","1.b","1.c","1.d","1.e","1.f","1.10","1.11","1.12","1.13","1.14","1.15","1.16","1.17","1.18","1.19","1.1a","1.1b","1.1c","1.1d","1.1e","1.1f"]} 2026-02-18T00:35:07.966 INFO:tasks.workunit.client.0.trial069.stderr:Error EBUSY: unsafe to stop osd(s) at this time (32 PGs are or would become offline) 2026-02-18T00:35:07.970 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:266: TEST_0_osd: ceph osd ok-to-stop 2 3 2026-02-18T00:35:08.124 INFO:tasks.workunit.client.0.trial069.stdout:{"ok_to_stop":false,"osds":[2,3],"num_ok_pgs":0,"num_not_ok_pgs":32,"bad_become_inactive":["1.0","1.1","1.2","1.3","1.4","1.5","1.6","1.7","1.8","1.9","1.a","1.b","1.c","1.d","1.e","1.f","1.10","1.11","1.12","1.13","1.14","1.15","1.16","1.17","1.18","1.19","1.1a","1.1b","1.1c","1.1d","1.1e","1.1f"]} 2026-02-18T00:35:08.125 INFO:tasks.workunit.client.0.trial069.stderr:Error EBUSY: unsafe to stop osd(s) at this time (32 PGs are or would become offline) 2026-02-18T00:35:08.129 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:267: TEST_0_osd: ceph osd ok-to-stop 0 --max 2 2026-02-18T00:35:08.129 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:267: TEST_0_osd: grep '[0]' 2026-02-18T00:35:08.337 INFO:tasks.workunit.client.0.trial069.stdout:{"ok_to_stop":true,"osds":[0],"num_ok_pgs":32,"num_not_ok_pgs":0,"ok_become_degraded":["1.0","1.1","1.2","1.3","1.4","1.5","1.6","1.7","1.8","1.9","1.a","1.b","1.c","1.d","1.e","1.f","1.10","1.11","1.12","1.13","1.14","1.15","1.16","1.17","1.18","1.19","1.1a","1.1b","1.1c","1.1d","1.1e","1.1f"]} 2026-02-18T00:35:08.338 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:268: TEST_0_osd: ceph osd ok-to-stop 1 --max 2 2026-02-18T00:35:08.338 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:268: TEST_0_osd: grep '[1]' 2026-02-18T00:35:08.545 INFO:tasks.workunit.client.0.trial069.stdout:{"ok_to_stop":true,"osds":[1],"num_ok_pgs":32,"num_not_ok_pgs":0,"ok_become_degraded":["1.0","1.1","1.2","1.3","1.4","1.5","1.6","1.7","1.8","1.9","1.a","1.b","1.c","1.d","1.e","1.f","1.10","1.11","1.12","1.13","1.14","1.15","1.16","1.17","1.18","1.19","1.1a","1.1b","1.1c","1.1d","1.1e","1.1f"]} 2026-02-18T00:35:08.546 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:271: TEST_0_osd: ceph osd pool set ec min_size 2 2026-02-18T00:35:08.853 INFO:tasks.workunit.client.0.trial069.stderr:set pool 1 min_size to 2 2026-02-18T00:35:08.870 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:272: TEST_0_osd: wait_for_clean 2026-02-18T00:35:08.870 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-18T00:35:08.870 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-18T00:35:08.870 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-18T00:35:08.871 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-18T00:35:08.871 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-18T00:35:08.871 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-18T00:35:08.871 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-18T00:35:08.871 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-18T00:35:08.871 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-18T00:35:08.967 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-18T00:35:08.967 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-18T00:35:08.967 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-18T00:35:08.967 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-18T00:35:08.967 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-18T00:35:08.968 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-18T00:35:09.180 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-18T00:35:09.180 INFO:tasks.workunit.client.0.trial069.stderr:1 2026-02-18T00:35:09.180 INFO:tasks.workunit.client.0.trial069.stderr:2 2026-02-18T00:35:09.180 INFO:tasks.workunit.client.0.trial069.stderr:3' 2026-02-18T00:35:09.180 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-18T00:35:09.180 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:35:09.180 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-18T00:35:09.256 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836490 2026-02-18T00:35:09.256 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836490 2026-02-18T00:35:09.256 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836490' 2026-02-18T00:35:09.256 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:35:09.256 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-18T00:35:09.332 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=42949672970 2026-02-18T00:35:09.332 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 42949672970 2026-02-18T00:35:09.332 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836490 1-42949672970' 2026-02-18T00:35:09.332 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:35:09.333 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-18T00:35:09.411 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542153 2026-02-18T00:35:09.411 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542153 2026-02-18T00:35:09.411 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836490 1-42949672970 2-60129542153' 2026-02-18T00:35:09.411 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:35:09.412 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2026-02-18T00:35:09.488 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=77309411336 2026-02-18T00:35:09.488 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 77309411336 2026-02-18T00:35:09.488 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836490 1-42949672970 2-60129542153 3-77309411336' 2026-02-18T00:35:09.488 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:35:09.489 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836490 2026-02-18T00:35:09.489 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:35:09.489 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-18T00:35:09.490 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-21474836490 2026-02-18T00:35:09.490 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:35:09.491 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=21474836490 2026-02-18T00:35:09.492 INFO:tasks.workunit.client.0.trial069.stdout:waiting osd.0 seq 21474836490 2026-02-18T00:35:09.492 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 21474836490' 2026-02-18T00:35:09.492 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T00:35:09.711 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 21474836488 -lt 21474836490 2026-02-18T00:35:09.711 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-18T00:35:10.712 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-18T00:35:10.713 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T00:35:10.933 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 21474836488 -lt 21474836490 2026-02-18T00:35:10.933 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-18T00:35:11.934 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-18T00:35:11.935 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T00:35:12.147 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 21474836491 -lt 21474836490 2026-02-18T00:35:12.147 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:35:12.148 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-42949672970 2026-02-18T00:35:12.148 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:35:12.148 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=1 2026-02-18T00:35:12.149 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 1-42949672970 2026-02-18T00:35:12.149 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:35:12.150 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=42949672970 2026-02-18T00:35:12.151 INFO:tasks.workunit.client.0.trial069.stdout:waiting osd.1 seq 42949672970 2026-02-18T00:35:12.151 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.1 seq 42949672970' 2026-02-18T00:35:12.151 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-18T00:35:12.376 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 42949672970 -lt 42949672970 2026-02-18T00:35:12.376 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:35:12.377 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542153 2026-02-18T00:35:12.377 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:35:12.377 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=2 2026-02-18T00:35:12.378 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 2-60129542153 2026-02-18T00:35:12.378 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:35:12.379 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=60129542153 2026-02-18T00:35:12.380 INFO:tasks.workunit.client.0.trial069.stdout:waiting osd.2 seq 60129542153 2026-02-18T00:35:12.380 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.2 seq 60129542153' 2026-02-18T00:35:12.380 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-18T00:35:12.594 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 60129542153 -lt 60129542153 2026-02-18T00:35:12.594 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:35:12.595 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-77309411336 2026-02-18T00:35:12.595 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:35:12.596 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=3 2026-02-18T00:35:12.596 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 3-77309411336 2026-02-18T00:35:12.597 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:35:12.598 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=77309411336 2026-02-18T00:35:12.598 INFO:tasks.workunit.client.0.trial069.stdout:waiting osd.3 seq 77309411336 2026-02-18T00:35:12.598 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.3 seq 77309411336' 2026-02-18T00:35:12.599 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-18T00:35:12.816 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 77309411337 -lt 77309411336 2026-02-18T00:35:12.817 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-18T00:35:12.817 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T00:35:12.817 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T00:35:13.092 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 32 == 0 2026-02-18T00:35:13.092 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-18T00:35:13.093 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-18T00:35:13.093 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-18T00:35:13.093 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-18T00:35:13.093 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-18T00:35:13.093 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-18T00:35:13.093 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-18T00:35:13.298 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=32 2026-02-18T00:35:13.298 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-18T00:35:13.298 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T00:35:13.299 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T00:35:13.574 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 32 = 32 2026-02-18T00:35:13.574 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-18T00:35:13.574 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-18T00:35:13.574 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:274: TEST_0_osd: ceph osd ok-to-stop 0 1 2026-02-18T00:35:13.773 INFO:tasks.workunit.client.0.trial069.stdout:{"ok_to_stop":true,"osds":[0,1],"num_ok_pgs":32,"num_not_ok_pgs":0,"ok_become_degraded":["1.0","1.1","1.2","1.3","1.4","1.5","1.6","1.7","1.8","1.9","1.a","1.b","1.c","1.d","1.e","1.f","1.10","1.11","1.12","1.13","1.14","1.15","1.16","1.17","1.18","1.19","1.1a","1.1b","1.1c","1.1d","1.1e","1.1f"]} 2026-02-18T00:35:13.783 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:275: TEST_0_osd: ceph osd ok-to-stop 2 3 2026-02-18T00:35:13.998 INFO:tasks.workunit.client.0.trial069.stdout:{"ok_to_stop":true,"osds":[2,3],"num_ok_pgs":32,"num_not_ok_pgs":0,"ok_become_degraded":["1.0","1.1","1.2","1.3","1.4","1.5","1.6","1.7","1.8","1.9","1.a","1.b","1.c","1.d","1.e","1.f","1.10","1.11","1.12","1.13","1.14","1.15","1.16","1.17","1.18","1.19","1.1a","1.1b","1.1c","1.1d","1.1e","1.1f"]} 2026-02-18T00:35:14.008 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:276: TEST_0_osd: ceph osd ok-to-stop 0 1 2 2026-02-18T00:35:14.174 INFO:tasks.workunit.client.0.trial069.stdout:{"ok_to_stop":false,"osds":[0,1,2],"num_ok_pgs":0,"num_not_ok_pgs":32,"bad_become_inactive":["1.0","1.1","1.2","1.3","1.4","1.5","1.6","1.7","1.8","1.9","1.a","1.b","1.c","1.d","1.e","1.f","1.10","1.11","1.12","1.13","1.14","1.15","1.16","1.17","1.18","1.19","1.1a","1.1b","1.1c","1.1d","1.1e","1.1f"]} 2026-02-18T00:35:14.174 INFO:tasks.workunit.client.0.trial069.stderr:Error EBUSY: unsafe to stop osd(s) at this time (32 PGs are or would become offline) 2026-02-18T00:35:14.178 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:277: TEST_0_osd: ceph osd ok-to-stop 1 2 3 2026-02-18T00:35:14.330 INFO:tasks.workunit.client.0.trial069.stdout:{"ok_to_stop":false,"osds":[1,2,3],"num_ok_pgs":0,"num_not_ok_pgs":32,"bad_become_inactive":["1.0","1.1","1.2","1.3","1.4","1.5","1.6","1.7","1.8","1.9","1.a","1.b","1.c","1.d","1.e","1.f","1.10","1.11","1.12","1.13","1.14","1.15","1.16","1.17","1.18","1.19","1.1a","1.1b","1.1c","1.1d","1.1e","1.1f"]} 2026-02-18T00:35:14.331 INFO:tasks.workunit.client.0.trial069.stderr:Error EBUSY: unsafe to stop osd(s) at this time (32 PGs are or would become offline) 2026-02-18T00:35:14.335 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:279: TEST_0_osd: ceph osd ok-to-stop 0 --max 2 2026-02-18T00:35:14.335 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:279: TEST_0_osd: grep '[0,1]' 2026-02-18T00:35:14.551 INFO:tasks.workunit.client.0.trial069.stdout:{"ok_to_stop":true,"osds":[0,1],"num_ok_pgs":32,"num_not_ok_pgs":0,"ok_become_degraded":["1.0","1.1","1.2","1.3","1.4","1.5","1.6","1.7","1.8","1.9","1.a","1.b","1.c","1.d","1.e","1.f","1.10","1.11","1.12","1.13","1.14","1.15","1.16","1.17","1.18","1.19","1.1a","1.1b","1.1c","1.1d","1.1e","1.1f"]} 2026-02-18T00:35:14.551 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:280: TEST_0_osd: ceph osd ok-to-stop 0 --max 20 2026-02-18T00:35:14.552 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:280: TEST_0_osd: grep '[0,1]' 2026-02-18T00:35:14.767 INFO:tasks.workunit.client.0.trial069.stdout:{"ok_to_stop":true,"osds":[0,1],"num_ok_pgs":32,"num_not_ok_pgs":0,"ok_become_degraded":["1.0","1.1","1.2","1.3","1.4","1.5","1.6","1.7","1.8","1.9","1.a","1.b","1.c","1.d","1.e","1.f","1.10","1.11","1.12","1.13","1.14","1.15","1.16","1.17","1.18","1.19","1.1a","1.1b","1.1c","1.1d","1.1e","1.1f"]} 2026-02-18T00:35:14.768 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:281: TEST_0_osd: ceph osd ok-to-stop 2 --max 2 2026-02-18T00:35:14.768 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:281: TEST_0_osd: grep '[2,3]' 2026-02-18T00:35:14.973 INFO:tasks.workunit.client.0.trial069.stdout:{"ok_to_stop":true,"osds":[0,2],"num_ok_pgs":32,"num_not_ok_pgs":0,"ok_become_degraded":["1.0","1.1","1.2","1.3","1.4","1.5","1.6","1.7","1.8","1.9","1.a","1.b","1.c","1.d","1.e","1.f","1.10","1.11","1.12","1.13","1.14","1.15","1.16","1.17","1.18","1.19","1.1a","1.1b","1.1c","1.1d","1.1e","1.1f"]} 2026-02-18T00:35:14.974 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:282: TEST_0_osd: ceph osd ok-to-stop 2 --max 20 2026-02-18T00:35:14.974 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:282: TEST_0_osd: grep '[2,3]' 2026-02-18T00:35:15.187 INFO:tasks.workunit.client.0.trial069.stdout:{"ok_to_stop":true,"osds":[0,2],"num_ok_pgs":32,"num_not_ok_pgs":0,"ok_become_degraded":["1.0","1.1","1.2","1.3","1.4","1.5","1.6","1.7","1.8","1.9","1.a","1.b","1.c","1.d","1.e","1.f","1.10","1.11","1.12","1.13","1.14","1.15","1.16","1.17","1.18","1.19","1.1a","1.1b","1.1c","1.1d","1.1e","1.1f"]} 2026-02-18T00:35:15.188 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:285: TEST_0_osd: kill_daemons td/ok-to-stop TERM osd.0 2026-02-18T00:35:15.189 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:35:15.189 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:35:15.189 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:35:15.189 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:35:15.189 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:35:15.496 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:35:15.496 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:286: TEST_0_osd: ceph osd down 0 2026-02-18T00:35:15.705 INFO:tasks.workunit.client.0.trial069.stderr:osd.0 is already down. 2026-02-18T00:35:15.716 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:287: TEST_0_osd: wait_for_peered 2026-02-18T00:35:15.716 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1731: wait_for_peered: local cmd= 2026-02-18T00:35:15.717 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1732: wait_for_peered: local num_peered=-1 2026-02-18T00:35:15.717 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1733: wait_for_peered: local cur_peered 2026-02-18T00:35:15.717 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1734: wait_for_peered: get_timeout_delays 90 .1 2026-02-18T00:35:15.717 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-18T00:35:15.717 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-18T00:35:15.718 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-18T00:35:15.718 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-18T00:35:15.718 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-18T00:35:15.823 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1734: wait_for_peered: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-18T00:35:15.824 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1734: wait_for_peered: local -a delays 2026-02-18T00:35:15.824 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1735: wait_for_peered: local -i loop=0 2026-02-18T00:35:15.824 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1737: wait_for_peered: flush_pg_stats 2026-02-18T00:35:15.824 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-18T00:35:15.824 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-18T00:35:16.033 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-18T00:35:16.033 INFO:tasks.workunit.client.0.trial069.stderr:1 2026-02-18T00:35:16.033 INFO:tasks.workunit.client.0.trial069.stderr:2 2026-02-18T00:35:16.034 INFO:tasks.workunit.client.0.trial069.stderr:3' 2026-02-18T00:35:16.034 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-18T00:35:16.034 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:35:16.034 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-18T00:35:16.091 INFO:tasks.workunit.client.0.trial069.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-18T00:35:16.095 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq= 2026-02-18T00:35:16.095 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z '' 2026-02-18T00:35:16.095 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2261: flush_pg_stats: continue 2026-02-18T00:35:16.095 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:35:16.095 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-18T00:35:16.169 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=42949672973 2026-02-18T00:35:16.170 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 42949672973 2026-02-18T00:35:16.170 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 1-42949672973' 2026-02-18T00:35:16.170 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:35:16.170 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-18T00:35:16.249 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542156 2026-02-18T00:35:16.249 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542156 2026-02-18T00:35:16.249 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 1-42949672973 2-60129542156' 2026-02-18T00:35:16.249 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:35:16.249 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2026-02-18T00:35:16.327 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=77309411340 2026-02-18T00:35:16.327 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 77309411340 2026-02-18T00:35:16.327 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 1-42949672973 2-60129542156 3-77309411340' 2026-02-18T00:35:16.328 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:35:16.328 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-42949672973 2026-02-18T00:35:16.328 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:35:16.328 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=1 2026-02-18T00:35:16.329 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 1-42949672973 2026-02-18T00:35:16.329 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:35:16.330 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=42949672973 2026-02-18T00:35:16.330 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.1 seq 42949672973' 2026-02-18T00:35:16.331 INFO:tasks.workunit.client.0.trial069.stdout:waiting osd.1 seq 42949672973 2026-02-18T00:35:16.331 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-18T00:35:16.532 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 42949672971 -lt 42949672973 2026-02-18T00:35:16.532 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-18T00:35:17.533 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-18T00:35:17.534 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-18T00:35:17.750 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 42949672973 -lt 42949672973 2026-02-18T00:35:17.750 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:35:17.750 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542156 2026-02-18T00:35:17.751 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:35:17.752 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=2 2026-02-18T00:35:17.753 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 2-60129542156 2026-02-18T00:35:17.753 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:35:17.754 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=60129542156 2026-02-18T00:35:17.754 INFO:tasks.workunit.client.0.trial069.stdout:waiting osd.2 seq 60129542156 2026-02-18T00:35:17.754 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.2 seq 60129542156' 2026-02-18T00:35:17.755 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-18T00:35:17.966 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 60129542157 -lt 60129542156 2026-02-18T00:35:17.967 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:35:17.967 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-77309411340 2026-02-18T00:35:17.967 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:35:17.968 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=3 2026-02-18T00:35:17.969 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 3-77309411340 2026-02-18T00:35:17.969 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:35:17.970 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=77309411340 2026-02-18T00:35:17.970 INFO:tasks.workunit.client.0.trial069.stdout:waiting osd.3 seq 77309411340 2026-02-18T00:35:17.971 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.3 seq 77309411340' 2026-02-18T00:35:17.971 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-18T00:35:18.186 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 77309411340 -lt 77309411340 2026-02-18T00:35:18.187 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1738: wait_for_peered: get_num_pgs 2026-02-18T00:35:18.187 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T00:35:18.187 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T00:35:18.463 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1738: wait_for_peered: test 32 == 0 2026-02-18T00:35:18.463 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1742: wait_for_peered: true 2026-02-18T00:35:18.463 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_peered: get_num_active_or_peered 2026-02-18T00:35:18.463 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1385: get_num_active_or_peered: local expression 2026-02-18T00:35:18.463 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1386: get_num_active_or_peered: expression+='select(contains("active") or contains("peered")) | ' 2026-02-18T00:35:18.463 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1387: get_num_active_or_peered: expression+='select(contains("stale") | not)' 2026-02-18T00:35:18.463 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1388: get_num_active_or_peered: ceph --format json pg dump pgs 2026-02-18T00:35:18.463 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1389: get_num_active_or_peered: jq '.pg_stats | [.[] | .state | select(contains("active") or contains("peered")) | select(contains("stale") | not)] | length' 2026-02-18T00:35:18.667 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_peered: cur_peered=32 2026-02-18T00:35:18.667 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1747: wait_for_peered: get_num_pgs 2026-02-18T00:35:18.667 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T00:35:18.667 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T00:35:18.941 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1747: wait_for_peered: test 32 = 32 2026-02-18T00:35:18.941 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1747: wait_for_peered: break 2026-02-18T00:35:18.941 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1762: wait_for_peered: return 0 2026-02-18T00:35:18.941 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:289: TEST_0_osd: ceph osd ok-to-stop 0 2026-02-18T00:35:19.143 INFO:tasks.workunit.client.0.trial069.stdout:{"ok_to_stop":true,"osds":[0],"num_ok_pgs":0,"num_not_ok_pgs":0} 2026-02-18T00:35:19.152 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:290: TEST_0_osd: ceph osd ok-to-stop 0 1 2026-02-18T00:35:19.369 INFO:tasks.workunit.client.0.trial069.stdout:{"ok_to_stop":true,"osds":[0,1],"num_ok_pgs":32,"num_not_ok_pgs":0,"ok_become_degraded":["1.0","1.1","1.2","1.3","1.4","1.5","1.6","1.7","1.8","1.9","1.a","1.b","1.c","1.d","1.e","1.f","1.10","1.11","1.12","1.13","1.14","1.15","1.16","1.17","1.18","1.19","1.1a","1.1b","1.1c","1.1d","1.1e","1.1f"]} 2026-02-18T00:35:19.378 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:291: TEST_0_osd: ceph osd ok-to-stop 0 1 2 2026-02-18T00:35:19.545 INFO:tasks.workunit.client.0.trial069.stdout:{"ok_to_stop":false,"osds":[0,1,2],"num_ok_pgs":0,"num_not_ok_pgs":32,"bad_become_inactive":["1.0","1.1","1.2","1.3","1.4","1.5","1.6","1.7","1.8","1.9","1.a","1.b","1.c","1.d","1.e","1.f","1.10","1.11","1.12","1.13","1.14","1.15","1.16","1.17","1.18","1.19","1.1a","1.1b","1.1c","1.1d","1.1e","1.1f"]} 2026-02-18T00:35:19.546 INFO:tasks.workunit.client.0.trial069.stderr:Error EBUSY: unsafe to stop osd(s) at this time (32 PGs are or would become offline) 2026-02-18T00:35:19.549 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:292: TEST_0_osd: ceph osd ok-to-stop 1 2 3 2026-02-18T00:35:19.703 INFO:tasks.workunit.client.0.trial069.stdout:{"ok_to_stop":false,"osds":[1,2,3],"num_ok_pgs":0,"num_not_ok_pgs":32,"bad_become_inactive":["1.0","1.1","1.2","1.3","1.4","1.5","1.6","1.7","1.8","1.9","1.a","1.b","1.c","1.d","1.e","1.f","1.10","1.11","1.12","1.13","1.14","1.15","1.16","1.17","1.18","1.19","1.1a","1.1b","1.1c","1.1d","1.1e","1.1f"]} 2026-02-18T00:35:19.704 INFO:tasks.workunit.client.0.trial069.stderr:Error EBUSY: unsafe to stop osd(s) at this time (32 PGs are or would become offline) 2026-02-18T00:35:19.707 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:22: run: kill_daemons td/ok-to-stop KILL 2026-02-18T00:35:19.708 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:35:19.709 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:35:19.709 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:35:19.709 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:35:19.709 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:35:19.819 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:35:19.819 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:23: run: teardown td/ok-to-stop 2026-02-18T00:35:19.820 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/ok-to-stop 2026-02-18T00:35:19.820 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T00:35:19.820 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/ok-to-stop KILL 2026-02-18T00:35:19.820 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:35:19.820 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:35:19.820 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:35:19.820 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:35:19.820 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:35:19.825 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:35:19.826 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T00:35:19.826 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T00:35:19.827 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T00:35:19.828 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T00:35:19.828 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T00:35:19.828 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T00:35:19.829 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:35:19.829 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T00:35:19.830 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T00:35:19.830 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:35:19.831 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T00:35:19.832 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T00:35:19.832 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/ok-to-stop 2026-02-18T00:35:19.851 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T00:35:19.851 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:35:19.851 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.35978 2026-02-18T00:35:19.852 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.35978 2026-02-18T00:35:19.854 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T00:35:19.854 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T00:35:19.854 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:19: run: for func in $funcs 2026-02-18T00:35:19.854 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:20: run: setup td/ok-to-stop 2026-02-18T00:35:19.854 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/ok-to-stop 2026-02-18T00:35:19.854 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/ok-to-stop 2026-02-18T00:35:19.854 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/ok-to-stop 2026-02-18T00:35:19.854 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T00:35:19.854 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/ok-to-stop KILL 2026-02-18T00:35:19.855 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:35:19.855 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:35:19.855 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:35:19.855 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:35:19.855 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:35:19.856 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:35:19.856 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T00:35:19.857 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T00:35:19.858 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T00:35:19.859 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T00:35:19.859 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T00:35:19.859 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T00:35:19.861 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:35:19.861 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T00:35:19.861 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T00:35:19.861 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:35:19.862 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T00:35:19.863 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T00:35:19.863 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/ok-to-stop 2026-02-18T00:35:19.865 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T00:35:19.865 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:35:19.865 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.35978 2026-02-18T00:35:19.865 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.35978 2026-02-18T00:35:19.866 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T00:35:19.866 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T00:35:19.866 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/ok-to-stop 2026-02-18T00:35:19.868 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-18T00:35:19.868 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:35:19.868 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.35978 2026-02-18T00:35:19.868 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.35978 2026-02-18T00:35:19.869 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-18T00:35:19.871 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-18T00:35:19.871 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-18T00:35:19.871 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/ok-to-stop 1' TERM HUP INT 2026-02-18T00:35:19.871 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:21: run: TEST_1_mon_checks td/ok-to-stop 2026-02-18T00:35:19.871 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:28: TEST_1_mon_checks: local dir=td/ok-to-stop 2026-02-18T00:35:19.871 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:30: TEST_1_mon_checks: CEPH_ARGS='--fsid=a9d6a614-446b-449b-9b9f-370c60593bc7 --auth-supported=none --mon-host=127.0.0.1:7150 ' 2026-02-18T00:35:19.871 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:32: TEST_1_mon_checks: run_mon td/ok-to-stop a --public-addr=127.0.0.1:7150 2026-02-18T00:35:19.871 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/ok-to-stop 2026-02-18T00:35:19.871 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-18T00:35:19.872 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-18T00:35:19.872 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-18T00:35:19.872 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/ok-to-stop/a 2026-02-18T00:35:19.872 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/ok-to-stop/a --run-dir=td/ok-to-stop --public-addr=127.0.0.1:7150 2026-02-18T00:35:19.892 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-18T00:35:19.892 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:35:19.892 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:35:19.892 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:35:19.892 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:35:19.892 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.35978 2026-02-18T00:35:19.893 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.35978/$cluster-$name.asok' 2026-02-18T00:35:19.893 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/ok-to-stop/a '--log-file=td/ok-to-stop/$name.log' '--admin-socket=/tmp/ceph-asok.35978/$cluster-$name.asok' --mon-cluster-log-file=td/ok-to-stop/log --run-dir=td/ok-to-stop '--pid-file=td/ok-to-stop/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --public-addr=127.0.0.1:7150 2026-02-18T00:35:19.923 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-18T00:35:19.924 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-18T00:35:19.924 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T00:35:19.924 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-18T00:35:19.924 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-18T00:35:19.924 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-18T00:35:19.926 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-18T00:35:19.926 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:35:19.926 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:35:19.926 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:35:19.926 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:35:19.926 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.35978 2026-02-18T00:35:19.927 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.35978/ceph-mon.a.asok 2026-02-18T00:35:19.927 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T00:35:19.927 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.35978/ceph-mon.a.asok config get fsid 2026-02-18T00:35:19.982 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-18T00:35:19.983 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T00:35:19.983 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-18T00:35:19.983 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-18T00:35:19.983 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-18T00:35:19.983 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-18T00:35:19.983 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:35:19.983 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:35:19.984 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:35:19.985 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:35:19.985 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.35978 2026-02-18T00:35:19.985 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.35978/ceph-mon.a.asok 2026-02-18T00:35:19.985 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T00:35:19.985 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.35978/ceph-mon.a.asok config get mon_host 2026-02-18T00:35:20.039 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:34: TEST_1_mon_checks: ceph mon ok-to-stop dne 2026-02-18T00:35:20.143 INFO:tasks.workunit.client.0.trial069.stderr:invalid mon(s) specified: dne 2026-02-18T00:35:20.154 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:35: TEST_1_mon_checks: ceph mon ok-to-stop a 2026-02-18T00:35:20.240 INFO:tasks.workunit.client.0.trial069.stderr:Error EBUSY: not enough monitors would be available () after stopping mons a 2026-02-18T00:35:20.243 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:37: TEST_1_mon_checks: ceph mon ok-to-add-offline 2026-02-18T00:35:20.329 INFO:tasks.workunit.client.0.trial069.stderr:Error EBUSY: adding a monitor may break quorum (until that monitor starts) 2026-02-18T00:35:20.331 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:39: TEST_1_mon_checks: ceph mon ok-to-rm a 2026-02-18T00:35:20.417 INFO:tasks.workunit.client.0.trial069.stderr:Error EBUSY: removing mon.a would break quorum 2026-02-18T00:35:20.421 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:40: TEST_1_mon_checks: ceph mon ok-to-rm dne 2026-02-18T00:35:20.524 INFO:tasks.workunit.client.0.trial069.stderr:mon.dne does not exist 2026-02-18T00:35:20.534 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:22: run: kill_daemons td/ok-to-stop KILL 2026-02-18T00:35:20.535 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:35:20.535 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:35:20.535 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:35:20.535 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:35:20.535 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:35:20.644 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:35:20.644 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:23: run: teardown td/ok-to-stop 2026-02-18T00:35:20.644 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/ok-to-stop 2026-02-18T00:35:20.644 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T00:35:20.644 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/ok-to-stop KILL 2026-02-18T00:35:20.644 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:35:20.644 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:35:20.644 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:35:20.644 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:35:20.645 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:35:20.648 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:35:20.649 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T00:35:20.649 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T00:35:20.650 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T00:35:20.651 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T00:35:20.652 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T00:35:20.652 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T00:35:20.653 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:35:20.653 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T00:35:20.654 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T00:35:20.654 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:35:20.655 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T00:35:20.656 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T00:35:20.656 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/ok-to-stop 2026-02-18T00:35:20.658 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T00:35:20.658 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:35:20.658 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.35978 2026-02-18T00:35:20.658 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.35978 2026-02-18T00:35:20.660 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T00:35:20.660 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T00:35:20.660 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:19: run: for func in $funcs 2026-02-18T00:35:20.660 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:20: run: setup td/ok-to-stop 2026-02-18T00:35:20.661 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/ok-to-stop 2026-02-18T00:35:20.661 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/ok-to-stop 2026-02-18T00:35:20.661 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/ok-to-stop 2026-02-18T00:35:20.661 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T00:35:20.661 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/ok-to-stop KILL 2026-02-18T00:35:20.661 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:35:20.661 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:35:20.661 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:35:20.661 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:35:20.661 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:35:20.662 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:35:20.663 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T00:35:20.663 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T00:35:20.664 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T00:35:20.665 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T00:35:20.665 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T00:35:20.665 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T00:35:20.666 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:35:20.666 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T00:35:20.667 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T00:35:20.667 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:35:20.668 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T00:35:20.669 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T00:35:20.669 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/ok-to-stop 2026-02-18T00:35:20.670 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T00:35:20.670 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:35:20.670 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.35978 2026-02-18T00:35:20.670 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.35978 2026-02-18T00:35:20.672 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T00:35:20.672 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T00:35:20.672 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/ok-to-stop 2026-02-18T00:35:20.673 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-18T00:35:20.673 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:35:20.673 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.35978 2026-02-18T00:35:20.674 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.35978 2026-02-18T00:35:20.675 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-18T00:35:20.676 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-18T00:35:20.677 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-18T00:35:20.677 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/ok-to-stop 1' TERM HUP INT 2026-02-18T00:35:20.677 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:21: run: TEST_2_mons_checks td/ok-to-stop 2026-02-18T00:35:20.677 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:44: TEST_2_mons_checks: local dir=td/ok-to-stop 2026-02-18T00:35:20.677 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:46: TEST_2_mons_checks: CEPH_ARGS='--fsid=a9d6a614-446b-449b-9b9f-370c60593bc7 --auth-supported=none --mon-host=127.0.0.1:7150,127.0.0.1:7151 ' 2026-02-18T00:35:20.677 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:48: TEST_2_mons_checks: run_mon td/ok-to-stop a --public-addr=127.0.0.1:7150 2026-02-18T00:35:20.677 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/ok-to-stop 2026-02-18T00:35:20.677 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-18T00:35:20.678 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-18T00:35:20.678 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-18T00:35:20.678 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/ok-to-stop/a 2026-02-18T00:35:20.678 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/ok-to-stop/a --run-dir=td/ok-to-stop --public-addr=127.0.0.1:7150 2026-02-18T00:35:20.697 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-18T00:35:20.698 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:35:20.698 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:35:20.698 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:35:20.698 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:35:20.698 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.35978 2026-02-18T00:35:20.698 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.35978/$cluster-$name.asok' 2026-02-18T00:35:20.699 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/ok-to-stop/a '--log-file=td/ok-to-stop/$name.log' '--admin-socket=/tmp/ceph-asok.35978/$cluster-$name.asok' --mon-cluster-log-file=td/ok-to-stop/log --run-dir=td/ok-to-stop '--pid-file=td/ok-to-stop/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --public-addr=127.0.0.1:7150 2026-02-18T00:35:20.727 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-18T00:35:20.728 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-18T00:35:20.728 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T00:35:20.728 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-18T00:35:20.728 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-18T00:35:20.729 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-18T00:35:20.730 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-18T00:35:20.730 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:35:20.730 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:35:20.730 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:35:20.730 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:35:20.731 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.35978 2026-02-18T00:35:20.731 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.35978/ceph-mon.a.asok 2026-02-18T00:35:20.731 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T00:35:20.731 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.35978/ceph-mon.a.asok config get fsid 2026-02-18T00:35:20.786 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-18T00:35:20.786 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T00:35:20.786 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-18T00:35:20.786 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-18T00:35:20.786 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-18T00:35:20.788 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-18T00:35:20.788 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:35:20.788 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:35:20.788 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:35:20.788 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:35:20.788 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.35978 2026-02-18T00:35:20.788 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.35978/ceph-mon.a.asok 2026-02-18T00:35:20.788 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T00:35:20.788 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.35978/ceph-mon.a.asok config get mon_host 2026-02-18T00:35:20.842 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:49: TEST_2_mons_checks: run_mon td/ok-to-stop b --public-addr=127.0.0.1:7151 2026-02-18T00:35:20.842 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/ok-to-stop 2026-02-18T00:35:20.843 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-18T00:35:20.843 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=b 2026-02-18T00:35:20.843 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-18T00:35:20.843 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/ok-to-stop/b 2026-02-18T00:35:20.843 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id b --mkfs --mon-data=td/ok-to-stop/b --run-dir=td/ok-to-stop --public-addr=127.0.0.1:7151 2026-02-18T00:35:20.861 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-18T00:35:20.862 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:35:20.862 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:35:20.862 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:35:20.862 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:35:20.862 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.35978 2026-02-18T00:35:20.862 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.35978/$cluster-$name.asok' 2026-02-18T00:35:20.863 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id b --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/ok-to-stop/b '--log-file=td/ok-to-stop/$name.log' '--admin-socket=/tmp/ceph-asok.35978/$cluster-$name.asok' --mon-cluster-log-file=td/ok-to-stop/log --run-dir=td/ok-to-stop '--pid-file=td/ok-to-stop/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --public-addr=127.0.0.1:7151 2026-02-18T00:35:20.888 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-18T00:35:20.888 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon b fsid 2026-02-18T00:35:20.889 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T00:35:20.889 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=b 2026-02-18T00:35:20.889 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-18T00:35:20.889 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-18T00:35:20.889 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.b 2026-02-18T00:35:20.889 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.b 2026-02-18T00:35:20.889 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.b ']' 2026-02-18T00:35:20.890 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:35:20.890 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:35:20.890 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.35978 2026-02-18T00:35:20.890 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.35978/ceph-mon.b.asok 2026-02-18T00:35:20.891 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T00:35:20.891 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.35978/ceph-mon.b.asok config get fsid 2026-02-18T00:35:20.947 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon b mon_host 2026-02-18T00:35:20.948 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T00:35:20.948 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=b 2026-02-18T00:35:20.948 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-18T00:35:20.948 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-18T00:35:20.949 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.b 2026-02-18T00:35:20.949 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.b 2026-02-18T00:35:20.949 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.b ']' 2026-02-18T00:35:20.949 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:35:20.949 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:35:20.949 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.35978 2026-02-18T00:35:20.949 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.35978/ceph-mon.b.asok 2026-02-18T00:35:20.949 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T00:35:20.949 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.35978/ceph-mon.b.asok config get mon_host 2026-02-18T00:35:21.005 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:51: TEST_2_mons_checks: ceph mon ok-to-stop dne 2026-02-18T00:35:21.108 INFO:tasks.workunit.client.0.trial069.stderr:invalid mon(s) specified: dne 2026-02-18T00:35:21.117 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:52: TEST_2_mons_checks: ceph mon ok-to-stop a 2026-02-18T00:35:21.206 INFO:tasks.workunit.client.0.trial069.stderr:Error EBUSY: not enough monitors would be available (b) after stopping mons a 2026-02-18T00:35:21.208 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:53: TEST_2_mons_checks: ceph mon ok-to-stop b 2026-02-18T00:35:21.295 INFO:tasks.workunit.client.0.trial069.stderr:Error EBUSY: not enough monitors would be available (a) after stopping mons b 2026-02-18T00:35:21.298 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:54: TEST_2_mons_checks: ceph mon ok-to-stop a b 2026-02-18T00:35:21.386 INFO:tasks.workunit.client.0.trial069.stderr:Error EBUSY: not enough monitors would be available () after stopping mons a b 2026-02-18T00:35:21.390 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:56: TEST_2_mons_checks: ceph mon ok-to-add-offline 2026-02-18T00:35:21.497 INFO:tasks.workunit.client.0.trial069.stderr:adding another mon that is not yet online will not break quorum 2026-02-18T00:35:21.505 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:58: TEST_2_mons_checks: ceph mon ok-to-rm a 2026-02-18T00:35:21.619 INFO:tasks.workunit.client.0.trial069.stderr:safe to remove mon.a 2026-02-18T00:35:21.629 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:59: TEST_2_mons_checks: ceph mon ok-to-rm b 2026-02-18T00:35:21.736 INFO:tasks.workunit.client.0.trial069.stderr:safe to remove mon.b 2026-02-18T00:35:21.744 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:60: TEST_2_mons_checks: ceph mon ok-to-rm dne 2026-02-18T00:35:21.865 INFO:tasks.workunit.client.0.trial069.stderr:mon.dne does not exist 2026-02-18T00:35:21.873 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:22: run: kill_daemons td/ok-to-stop KILL 2026-02-18T00:35:21.874 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:35:21.874 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:35:21.874 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:35:21.874 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:35:21.874 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:35:21.983 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:35:21.983 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:23: run: teardown td/ok-to-stop 2026-02-18T00:35:21.983 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/ok-to-stop 2026-02-18T00:35:21.983 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T00:35:21.983 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/ok-to-stop KILL 2026-02-18T00:35:21.983 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:35:21.983 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:35:21.983 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:35:21.984 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:35:21.984 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:35:21.988 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:35:21.988 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T00:35:21.989 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T00:35:21.989 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T00:35:21.990 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T00:35:21.990 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T00:35:21.991 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T00:35:21.992 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:35:21.992 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T00:35:21.993 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T00:35:21.993 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:35:21.993 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T00:35:21.994 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T00:35:21.994 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/ok-to-stop 2026-02-18T00:35:21.996 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T00:35:21.997 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:35:21.997 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.35978 2026-02-18T00:35:21.997 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.35978 2026-02-18T00:35:21.999 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T00:35:21.999 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T00:35:21.999 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:19: run: for func in $funcs 2026-02-18T00:35:21.999 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:20: run: setup td/ok-to-stop 2026-02-18T00:35:21.999 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/ok-to-stop 2026-02-18T00:35:22.000 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/ok-to-stop 2026-02-18T00:35:22.000 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/ok-to-stop 2026-02-18T00:35:22.000 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T00:35:22.000 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/ok-to-stop KILL 2026-02-18T00:35:22.000 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:35:22.000 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:35:22.000 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:35:22.000 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:35:22.000 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:35:22.001 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:35:22.001 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T00:35:22.002 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T00:35:22.002 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T00:35:22.003 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T00:35:22.003 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T00:35:22.004 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T00:35:22.004 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:35:22.004 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T00:35:22.005 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T00:35:22.005 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:35:22.006 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T00:35:22.007 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T00:35:22.007 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/ok-to-stop 2026-02-18T00:35:22.008 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T00:35:22.009 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:35:22.009 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.35978 2026-02-18T00:35:22.009 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.35978 2026-02-18T00:35:22.010 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T00:35:22.010 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T00:35:22.010 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/ok-to-stop 2026-02-18T00:35:22.011 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-18T00:35:22.011 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:35:22.011 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.35978 2026-02-18T00:35:22.012 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.35978 2026-02-18T00:35:22.013 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-18T00:35:22.015 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-18T00:35:22.015 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-18T00:35:22.015 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/ok-to-stop 1' TERM HUP INT 2026-02-18T00:35:22.015 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:21: run: TEST_3_mons_checks td/ok-to-stop 2026-02-18T00:35:22.015 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:64: TEST_3_mons_checks: local dir=td/ok-to-stop 2026-02-18T00:35:22.015 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:66: TEST_3_mons_checks: CEPH_ARGS='--fsid=a9d6a614-446b-449b-9b9f-370c60593bc7 --auth-supported=none --mon-host=127.0.0.1:7150,127.0.0.1:7151,127.0.0.1:7152 ' 2026-02-18T00:35:22.015 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:68: TEST_3_mons_checks: run_mon td/ok-to-stop a --public-addr=127.0.0.1:7150 2026-02-18T00:35:22.015 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/ok-to-stop 2026-02-18T00:35:22.015 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-18T00:35:22.015 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-18T00:35:22.015 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-18T00:35:22.016 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/ok-to-stop/a 2026-02-18T00:35:22.016 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/ok-to-stop/a --run-dir=td/ok-to-stop --public-addr=127.0.0.1:7150 2026-02-18T00:35:22.035 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-18T00:35:22.036 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:35:22.036 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:35:22.036 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:35:22.036 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:35:22.036 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.35978 2026-02-18T00:35:22.036 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.35978/$cluster-$name.asok' 2026-02-18T00:35:22.036 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/ok-to-stop/a '--log-file=td/ok-to-stop/$name.log' '--admin-socket=/tmp/ceph-asok.35978/$cluster-$name.asok' --mon-cluster-log-file=td/ok-to-stop/log --run-dir=td/ok-to-stop '--pid-file=td/ok-to-stop/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --public-addr=127.0.0.1:7150 2026-02-18T00:35:22.063 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-18T00:35:22.064 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-18T00:35:22.064 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T00:35:22.065 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-18T00:35:22.065 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-18T00:35:22.066 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-18T00:35:22.066 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-18T00:35:22.066 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:35:22.066 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:35:22.067 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:35:22.067 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:35:22.067 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.35978 2026-02-18T00:35:22.067 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.35978/ceph-mon.a.asok 2026-02-18T00:35:22.067 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T00:35:22.067 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.35978/ceph-mon.a.asok config get fsid 2026-02-18T00:35:22.123 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-18T00:35:22.124 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T00:35:22.124 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-18T00:35:22.124 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-18T00:35:22.124 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-18T00:35:22.124 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-18T00:35:22.124 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:35:22.124 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:35:22.124 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:35:22.124 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:35:22.124 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.35978 2026-02-18T00:35:22.125 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.35978/ceph-mon.a.asok 2026-02-18T00:35:22.125 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T00:35:22.125 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.35978/ceph-mon.a.asok config get mon_host 2026-02-18T00:35:22.181 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:69: TEST_3_mons_checks: run_mon td/ok-to-stop b --public-addr=127.0.0.1:7151 2026-02-18T00:35:22.181 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/ok-to-stop 2026-02-18T00:35:22.181 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-18T00:35:22.181 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=b 2026-02-18T00:35:22.181 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-18T00:35:22.181 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/ok-to-stop/b 2026-02-18T00:35:22.182 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id b --mkfs --mon-data=td/ok-to-stop/b --run-dir=td/ok-to-stop --public-addr=127.0.0.1:7151 2026-02-18T00:35:22.200 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-18T00:35:22.200 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:35:22.200 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:35:22.200 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:35:22.200 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:35:22.200 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.35978 2026-02-18T00:35:22.201 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.35978/$cluster-$name.asok' 2026-02-18T00:35:22.201 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id b --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/ok-to-stop/b '--log-file=td/ok-to-stop/$name.log' '--admin-socket=/tmp/ceph-asok.35978/$cluster-$name.asok' --mon-cluster-log-file=td/ok-to-stop/log --run-dir=td/ok-to-stop '--pid-file=td/ok-to-stop/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --public-addr=127.0.0.1:7151 2026-02-18T00:35:22.227 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-18T00:35:22.228 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon b fsid 2026-02-18T00:35:22.228 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T00:35:22.228 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=b 2026-02-18T00:35:22.229 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-18T00:35:22.230 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-18T00:35:22.230 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.b 2026-02-18T00:35:22.230 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.b 2026-02-18T00:35:22.230 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.b ']' 2026-02-18T00:35:22.230 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:35:22.230 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:35:22.230 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.35978 2026-02-18T00:35:22.231 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.35978/ceph-mon.b.asok 2026-02-18T00:35:22.231 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T00:35:22.231 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.35978/ceph-mon.b.asok config get fsid 2026-02-18T00:35:22.296 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon b mon_host 2026-02-18T00:35:22.296 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T00:35:22.296 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=b 2026-02-18T00:35:22.296 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-18T00:35:22.296 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-18T00:35:22.298 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.b 2026-02-18T00:35:22.298 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.b 2026-02-18T00:35:22.298 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.b ']' 2026-02-18T00:35:22.298 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:35:22.298 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:35:22.298 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.35978 2026-02-18T00:35:22.298 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.35978/ceph-mon.b.asok 2026-02-18T00:35:22.298 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T00:35:22.298 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.35978/ceph-mon.b.asok config get mon_host 2026-02-18T00:35:22.352 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:70: TEST_3_mons_checks: run_mon td/ok-to-stop c --public-addr=127.0.0.1:7152 2026-02-18T00:35:22.353 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/ok-to-stop 2026-02-18T00:35:22.353 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-18T00:35:22.353 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=c 2026-02-18T00:35:22.353 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-18T00:35:22.353 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/ok-to-stop/c 2026-02-18T00:35:22.353 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id c --mkfs --mon-data=td/ok-to-stop/c --run-dir=td/ok-to-stop --public-addr=127.0.0.1:7152 2026-02-18T00:35:22.371 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-18T00:35:22.372 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:35:22.372 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:35:22.372 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:35:22.372 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:35:22.372 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.35978 2026-02-18T00:35:22.372 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.35978/$cluster-$name.asok' 2026-02-18T00:35:22.373 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id c --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/ok-to-stop/c '--log-file=td/ok-to-stop/$name.log' '--admin-socket=/tmp/ceph-asok.35978/$cluster-$name.asok' --mon-cluster-log-file=td/ok-to-stop/log --run-dir=td/ok-to-stop '--pid-file=td/ok-to-stop/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --public-addr=127.0.0.1:7152 2026-02-18T00:35:22.400 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-18T00:35:22.401 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon c fsid 2026-02-18T00:35:22.401 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T00:35:22.401 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=c 2026-02-18T00:35:22.401 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-18T00:35:22.403 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-18T00:35:22.403 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.c 2026-02-18T00:35:22.403 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.c 2026-02-18T00:35:22.403 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.c ']' 2026-02-18T00:35:22.403 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:35:22.403 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:35:22.404 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.35978 2026-02-18T00:35:22.404 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.35978/ceph-mon.c.asok 2026-02-18T00:35:22.404 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T00:35:22.404 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.35978/ceph-mon.c.asok config get fsid 2026-02-18T00:35:22.458 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon c mon_host 2026-02-18T00:35:22.459 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T00:35:22.459 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=c 2026-02-18T00:35:22.459 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-18T00:35:22.459 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-18T00:35:22.459 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.c 2026-02-18T00:35:22.459 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.c 2026-02-18T00:35:22.459 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.c ']' 2026-02-18T00:35:22.460 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:35:22.460 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:35:22.461 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.35978 2026-02-18T00:35:22.461 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.35978/ceph-mon.c.asok 2026-02-18T00:35:22.461 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T00:35:22.461 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.35978/ceph-mon.c.asok config get mon_host 2026-02-18T00:35:22.515 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:71: TEST_3_mons_checks: wait_for_quorum 60 3 2026-02-18T00:35:22.515 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1046: wait_for_quorum: local timeout=60 2026-02-18T00:35:22.515 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1047: wait_for_quorum: local quorumsize=3 2026-02-18T00:35:22.515 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1049: wait_for_quorum: [[ -z 60 ]] 2026-02-18T00:35:22.515 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1053: wait_for_quorum: [[ -z 3 ]] 2026-02-18T00:35:22.515 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1058: wait_for_quorum: no_quorum=1 2026-02-18T00:35:22.516 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1059: wait_for_quorum: date +%s 2026-02-18T00:35:22.516 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1059: wait_for_quorum: wait_until=1771374982 2026-02-18T00:35:22.516 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1060: wait_for_quorum: date +%s 2026-02-18T00:35:22.517 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1060: wait_for_quorum: [[ 1771374922 -lt 1771374982 ]] 2026-02-18T00:35:22.517 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1061: wait_for_quorum: jqfilter='.quorum | length == 3' 2026-02-18T00:35:22.518 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2026-02-18T00:35:28.632 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: jqinput=' 2026-02-18T00:35:28.633 INFO:tasks.workunit.client.0.trial069.stderr:{"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"a9d6a614-446b-449b-9b9f-370c60593bc7","modified":"2026-02-18T00:35:22.026628Z","created":"2026-02-18T00:35:22.026628Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-18T00:35:28.634 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: jq '.quorum | length == 3' 2026-02-18T00:35:28.634 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: echo '{"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"a9d6a614-446b-449b-9b9f-370c60593bc7","modified":"2026-02-18T00:35:22.026628Z","created":"2026-02-18T00:35:22.026628Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-18T00:35:28.642 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: res=true 2026-02-18T00:35:28.643 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: wait_for_quorum: [[ true == \t\r\u\e ]] 2026-02-18T00:35:28.643 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: wait_for_quorum: no_quorum=0 2026-02-18T00:35:28.643 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1066: wait_for_quorum: break 2026-02-18T00:35:28.643 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1069: wait_for_quorum: return 0 2026-02-18T00:35:28.643 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:73: TEST_3_mons_checks: ceph mon ok-to-stop dne 2026-02-18T00:35:31.750 INFO:tasks.workunit.client.0.trial069.stderr:invalid mon(s) specified: dne 2026-02-18T00:35:31.757 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:74: TEST_3_mons_checks: ceph mon ok-to-stop a 2026-02-18T00:35:31.873 INFO:tasks.workunit.client.0.trial069.stderr:quorum should be preserved (b,c) after stopping a 2026-02-18T00:35:31.881 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:75: TEST_3_mons_checks: ceph mon ok-to-stop b 2026-02-18T00:35:31.998 INFO:tasks.workunit.client.0.trial069.stderr:quorum should be preserved (a,c) after stopping b 2026-02-18T00:35:32.007 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:76: TEST_3_mons_checks: ceph mon ok-to-stop c 2026-02-18T00:35:32.126 INFO:tasks.workunit.client.0.trial069.stderr:quorum should be preserved (a,b) after stopping c 2026-02-18T00:35:32.134 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:77: TEST_3_mons_checks: ceph mon ok-to-stop a b 2026-02-18T00:35:32.231 INFO:tasks.workunit.client.0.trial069.stderr:Error EBUSY: not enough monitors would be available (c) after stopping mons a b 2026-02-18T00:35:32.234 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:78: TEST_3_mons_checks: ceph mon ok-to-stop b c 2026-02-18T00:35:32.323 INFO:tasks.workunit.client.0.trial069.stderr:Error EBUSY: not enough monitors would be available (a) after stopping mons b c 2026-02-18T00:35:32.326 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:79: TEST_3_mons_checks: ceph mon ok-to-stop a b c 2026-02-18T00:35:32.413 INFO:tasks.workunit.client.0.trial069.stderr:Error EBUSY: not enough monitors would be available () after stopping mons a b c 2026-02-18T00:35:32.415 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:81: TEST_3_mons_checks: ceph mon ok-to-add-offline 2026-02-18T00:35:32.522 INFO:tasks.workunit.client.0.trial069.stderr:adding another mon that is not yet online will not break quorum 2026-02-18T00:35:32.530 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:83: TEST_3_mons_checks: ceph mon ok-to-rm a 2026-02-18T00:35:32.648 INFO:tasks.workunit.client.0.trial069.stderr:safe to remove mon.a 2026-02-18T00:35:32.658 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:84: TEST_3_mons_checks: ceph mon ok-to-rm b 2026-02-18T00:35:32.765 INFO:tasks.workunit.client.0.trial069.stderr:safe to remove mon.b 2026-02-18T00:35:32.773 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:85: TEST_3_mons_checks: ceph mon ok-to-rm c 2026-02-18T00:35:32.891 INFO:tasks.workunit.client.0.trial069.stderr:safe to remove mon.c 2026-02-18T00:35:32.901 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:87: TEST_3_mons_checks: kill_daemons td/ok-to-stop KILL mon.b 2026-02-18T00:35:32.902 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:35:32.902 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:35:32.902 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:35:32.902 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:35:32.902 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:35:33.010 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:35:33.010 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:88: TEST_3_mons_checks: wait_for_quorum 60 2 2026-02-18T00:35:33.010 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1046: wait_for_quorum: local timeout=60 2026-02-18T00:35:33.010 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1047: wait_for_quorum: local quorumsize=2 2026-02-18T00:35:33.010 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1049: wait_for_quorum: [[ -z 60 ]] 2026-02-18T00:35:33.010 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1053: wait_for_quorum: [[ -z 2 ]] 2026-02-18T00:35:33.010 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1058: wait_for_quorum: no_quorum=1 2026-02-18T00:35:33.010 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1059: wait_for_quorum: date +%s 2026-02-18T00:35:33.010 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1059: wait_for_quorum: wait_until=1771374993 2026-02-18T00:35:33.011 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1060: wait_for_quorum: date +%s 2026-02-18T00:35:33.011 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1060: wait_for_quorum: [[ 1771374933 -lt 1771374993 ]] 2026-02-18T00:35:33.011 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1061: wait_for_quorum: jqfilter='.quorum | length == 2' 2026-02-18T00:35:33.012 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2026-02-18T00:35:33.130 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: jqinput=' 2026-02-18T00:35:33.130 INFO:tasks.workunit.client.0.trial069.stderr:{"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":5,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"a9d6a614-446b-449b-9b9f-370c60593bc7","modified":"2026-02-18T00:35:22.026628Z","created":"2026-02-18T00:35:22.026628Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-18T00:35:33.130 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: echo '{"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":5,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"a9d6a614-446b-449b-9b9f-370c60593bc7","modified":"2026-02-18T00:35:22.026628Z","created":"2026-02-18T00:35:22.026628Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-18T00:35:33.131 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: jq '.quorum | length == 2' 2026-02-18T00:35:33.140 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: res=false 2026-02-18T00:35:33.140 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: wait_for_quorum: [[ false == \t\r\u\e ]] 2026-02-18T00:35:33.141 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1060: wait_for_quorum: date +%s 2026-02-18T00:35:33.142 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1060: wait_for_quorum: [[ 1771374933 -lt 1771374993 ]] 2026-02-18T00:35:33.142 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1061: wait_for_quorum: jqfilter='.quorum | length == 2' 2026-02-18T00:35:33.142 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2026-02-18T00:35:33.259 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: jqinput=' 2026-02-18T00:35:33.260 INFO:tasks.workunit.client.0.trial069.stderr:{"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":5,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"a9d6a614-446b-449b-9b9f-370c60593bc7","modified":"2026-02-18T00:35:22.026628Z","created":"2026-02-18T00:35:22.026628Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-18T00:35:33.260 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: echo '{"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":5,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"a9d6a614-446b-449b-9b9f-370c60593bc7","modified":"2026-02-18T00:35:22.026628Z","created":"2026-02-18T00:35:22.026628Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-18T00:35:33.260 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: jq '.quorum | length == 2' 2026-02-18T00:35:33.271 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: res=false 2026-02-18T00:35:33.272 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: wait_for_quorum: [[ false == \t\r\u\e ]] 2026-02-18T00:35:33.272 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1060: wait_for_quorum: date +%s 2026-02-18T00:35:33.272 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1060: wait_for_quorum: [[ 1771374933 -lt 1771374993 ]] 2026-02-18T00:35:33.273 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1061: wait_for_quorum: jqfilter='.quorum | length == 2' 2026-02-18T00:35:33.273 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2026-02-18T00:35:33.387 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: jqinput=' 2026-02-18T00:35:33.387 INFO:tasks.workunit.client.0.trial069.stderr:{"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":5,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"a9d6a614-446b-449b-9b9f-370c60593bc7","modified":"2026-02-18T00:35:22.026628Z","created":"2026-02-18T00:35:22.026628Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-18T00:35:33.387 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: jq '.quorum | length == 2' 2026-02-18T00:35:33.388 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: echo '{"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":5,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"a9d6a614-446b-449b-9b9f-370c60593bc7","modified":"2026-02-18T00:35:22.026628Z","created":"2026-02-18T00:35:22.026628Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-18T00:35:33.397 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: res=false 2026-02-18T00:35:33.397 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: wait_for_quorum: [[ false == \t\r\u\e ]] 2026-02-18T00:35:33.397 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1060: wait_for_quorum: date +%s 2026-02-18T00:35:33.398 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1060: wait_for_quorum: [[ 1771374933 -lt 1771374993 ]] 2026-02-18T00:35:33.398 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1061: wait_for_quorum: jqfilter='.quorum | length == 2' 2026-02-18T00:35:33.399 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2026-02-18T00:35:33.511 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: jqinput=' 2026-02-18T00:35:33.512 INFO:tasks.workunit.client.0.trial069.stderr:{"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":5,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"a9d6a614-446b-449b-9b9f-370c60593bc7","modified":"2026-02-18T00:35:22.026628Z","created":"2026-02-18T00:35:22.026628Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-18T00:35:33.512 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: jq '.quorum | length == 2' 2026-02-18T00:35:33.512 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: echo '{"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":5,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"a9d6a614-446b-449b-9b9f-370c60593bc7","modified":"2026-02-18T00:35:22.026628Z","created":"2026-02-18T00:35:22.026628Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-18T00:35:33.522 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: res=false 2026-02-18T00:35:33.522 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: wait_for_quorum: [[ false == \t\r\u\e ]] 2026-02-18T00:35:33.522 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1060: wait_for_quorum: date +%s 2026-02-18T00:35:33.524 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1060: wait_for_quorum: [[ 1771374933 -lt 1771374993 ]] 2026-02-18T00:35:33.524 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1061: wait_for_quorum: jqfilter='.quorum | length == 2' 2026-02-18T00:35:33.524 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2026-02-18T00:35:33.638 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: jqinput=' 2026-02-18T00:35:33.638 INFO:tasks.workunit.client.0.trial069.stderr:{"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":5,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"a9d6a614-446b-449b-9b9f-370c60593bc7","modified":"2026-02-18T00:35:22.026628Z","created":"2026-02-18T00:35:22.026628Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-18T00:35:33.639 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: jq '.quorum | length == 2' 2026-02-18T00:35:33.639 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: echo '{"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":5,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"a9d6a614-446b-449b-9b9f-370c60593bc7","modified":"2026-02-18T00:35:22.026628Z","created":"2026-02-18T00:35:22.026628Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-18T00:35:33.649 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: res=false 2026-02-18T00:35:33.649 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: wait_for_quorum: [[ false == \t\r\u\e ]] 2026-02-18T00:35:33.649 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1060: wait_for_quorum: date +%s 2026-02-18T00:35:33.650 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1060: wait_for_quorum: [[ 1771374933 -lt 1771374993 ]] 2026-02-18T00:35:33.650 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1061: wait_for_quorum: jqfilter='.quorum | length == 2' 2026-02-18T00:35:33.650 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2026-02-18T00:35:33.767 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: jqinput=' 2026-02-18T00:35:33.767 INFO:tasks.workunit.client.0.trial069.stderr:{"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":6,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"a9d6a614-446b-449b-9b9f-370c60593bc7","modified":"2026-02-18T00:35:22.026628Z","created":"2026-02-18T00:35:22.026628Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-18T00:35:33.768 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: echo '{"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":6,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"a9d6a614-446b-449b-9b9f-370c60593bc7","modified":"2026-02-18T00:35:22.026628Z","created":"2026-02-18T00:35:22.026628Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-18T00:35:33.768 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: jq '.quorum | length == 2' 2026-02-18T00:35:33.777 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: res=false 2026-02-18T00:35:33.777 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: wait_for_quorum: [[ false == \t\r\u\e ]] 2026-02-18T00:35:33.777 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1060: wait_for_quorum: date +%s 2026-02-18T00:35:33.778 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1060: wait_for_quorum: [[ 1771374933 -lt 1771374993 ]] 2026-02-18T00:35:33.778 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1061: wait_for_quorum: jqfilter='.quorum | length == 2' 2026-02-18T00:35:33.778 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2026-02-18T00:35:36.898 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: jqinput=' 2026-02-18T00:35:36.899 INFO:tasks.workunit.client.0.trial069.stderr:{"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":9,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"a9d6a614-446b-449b-9b9f-370c60593bc7","modified":"2026-02-18T00:35:22.026628Z","created":"2026-02-18T00:35:22.026628Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-18T00:35:36.900 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: echo '{"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":9,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"a9d6a614-446b-449b-9b9f-370c60593bc7","modified":"2026-02-18T00:35:22.026628Z","created":"2026-02-18T00:35:22.026628Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-18T00:35:36.900 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: jq '.quorum | length == 2' 2026-02-18T00:35:36.909 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: res=false 2026-02-18T00:35:36.910 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: wait_for_quorum: [[ false == \t\r\u\e ]] 2026-02-18T00:35:36.910 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1060: wait_for_quorum: date +%s 2026-02-18T00:35:36.911 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1060: wait_for_quorum: [[ 1771374936 -lt 1771374993 ]] 2026-02-18T00:35:36.911 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1061: wait_for_quorum: jqfilter='.quorum | length == 2' 2026-02-18T00:35:36.911 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2026-02-18T00:35:40.028 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: jqinput=' 2026-02-18T00:35:40.028 INFO:tasks.workunit.client.0.trial069.stderr:{"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":12,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"a9d6a614-446b-449b-9b9f-370c60593bc7","modified":"2026-02-18T00:35:22.026628Z","created":"2026-02-18T00:35:22.026628Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-18T00:35:40.028 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: echo '{"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":12,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"a9d6a614-446b-449b-9b9f-370c60593bc7","modified":"2026-02-18T00:35:22.026628Z","created":"2026-02-18T00:35:22.026628Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-18T00:35:40.029 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: jq '.quorum | length == 2' 2026-02-18T00:35:40.037 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: res=false 2026-02-18T00:35:40.038 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: wait_for_quorum: [[ false == \t\r\u\e ]] 2026-02-18T00:35:40.038 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1060: wait_for_quorum: date +%s 2026-02-18T00:35:40.040 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1060: wait_for_quorum: [[ 1771374940 -lt 1771374993 ]] 2026-02-18T00:35:40.040 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1061: wait_for_quorum: jqfilter='.quorum | length == 2' 2026-02-18T00:35:40.040 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2026-02-18T00:35:40.155 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: jqinput=' 2026-02-18T00:35:40.155 INFO:tasks.workunit.client.0.trial069.stderr:{"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":12,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"a9d6a614-446b-449b-9b9f-370c60593bc7","modified":"2026-02-18T00:35:22.026628Z","created":"2026-02-18T00:35:22.026628Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-18T00:35:40.156 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: echo '{"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":12,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"a9d6a614-446b-449b-9b9f-370c60593bc7","modified":"2026-02-18T00:35:22.026628Z","created":"2026-02-18T00:35:22.026628Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-18T00:35:40.156 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: jq '.quorum | length == 2' 2026-02-18T00:35:40.165 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: res=false 2026-02-18T00:35:40.165 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: wait_for_quorum: [[ false == \t\r\u\e ]] 2026-02-18T00:35:40.166 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1060: wait_for_quorum: date +%s 2026-02-18T00:35:40.167 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1060: wait_for_quorum: [[ 1771374940 -lt 1771374993 ]] 2026-02-18T00:35:40.167 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1061: wait_for_quorum: jqfilter='.quorum | length == 2' 2026-02-18T00:35:40.167 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2026-02-18T00:35:40.277 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: jqinput=' 2026-02-18T00:35:40.277 INFO:tasks.workunit.client.0.trial069.stderr:{"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":12,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"a9d6a614-446b-449b-9b9f-370c60593bc7","modified":"2026-02-18T00:35:22.026628Z","created":"2026-02-18T00:35:22.026628Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-18T00:35:40.278 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: jq '.quorum | length == 2' 2026-02-18T00:35:40.278 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: echo '{"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":12,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"a9d6a614-446b-449b-9b9f-370c60593bc7","modified":"2026-02-18T00:35:22.026628Z","created":"2026-02-18T00:35:22.026628Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-18T00:35:40.288 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: res=false 2026-02-18T00:35:40.289 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: wait_for_quorum: [[ false == \t\r\u\e ]] 2026-02-18T00:35:40.289 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1060: wait_for_quorum: date +%s 2026-02-18T00:35:40.290 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1060: wait_for_quorum: [[ 1771374940 -lt 1771374993 ]] 2026-02-18T00:35:40.290 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1061: wait_for_quorum: jqfilter='.quorum | length == 2' 2026-02-18T00:35:40.290 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2026-02-18T00:35:40.404 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: jqinput=' 2026-02-18T00:35:40.404 INFO:tasks.workunit.client.0.trial069.stderr:{"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":12,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"a9d6a614-446b-449b-9b9f-370c60593bc7","modified":"2026-02-18T00:35:22.026628Z","created":"2026-02-18T00:35:22.026628Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-18T00:35:40.404 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: jq '.quorum | length == 2' 2026-02-18T00:35:40.405 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: echo '{"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":12,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"a9d6a614-446b-449b-9b9f-370c60593bc7","modified":"2026-02-18T00:35:22.026628Z","created":"2026-02-18T00:35:22.026628Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-18T00:35:40.414 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: res=false 2026-02-18T00:35:40.414 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: wait_for_quorum: [[ false == \t\r\u\e ]] 2026-02-18T00:35:40.414 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1060: wait_for_quorum: date +%s 2026-02-18T00:35:40.415 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1060: wait_for_quorum: [[ 1771374940 -lt 1771374993 ]] 2026-02-18T00:35:40.415 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1061: wait_for_quorum: jqfilter='.quorum | length == 2' 2026-02-18T00:35:40.416 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2026-02-18T00:35:40.525 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: jqinput=' 2026-02-18T00:35:40.525 INFO:tasks.workunit.client.0.trial069.stderr:{"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":12,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"a9d6a614-446b-449b-9b9f-370c60593bc7","modified":"2026-02-18T00:35:22.026628Z","created":"2026-02-18T00:35:22.026628Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-18T00:35:40.526 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: jq '.quorum | length == 2' 2026-02-18T00:35:40.526 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: echo '{"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":12,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"a9d6a614-446b-449b-9b9f-370c60593bc7","modified":"2026-02-18T00:35:22.026628Z","created":"2026-02-18T00:35:22.026628Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-18T00:35:40.537 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: res=false 2026-02-18T00:35:40.537 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: wait_for_quorum: [[ false == \t\r\u\e ]] 2026-02-18T00:35:40.537 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1060: wait_for_quorum: date +%s 2026-02-18T00:35:40.538 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1060: wait_for_quorum: [[ 1771374940 -lt 1771374993 ]] 2026-02-18T00:35:40.539 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1061: wait_for_quorum: jqfilter='.quorum | length == 2' 2026-02-18T00:35:40.539 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2026-02-18T00:35:40.653 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: jqinput=' 2026-02-18T00:35:40.653 INFO:tasks.workunit.client.0.trial069.stderr:{"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":12,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"a9d6a614-446b-449b-9b9f-370c60593bc7","modified":"2026-02-18T00:35:22.026628Z","created":"2026-02-18T00:35:22.026628Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-18T00:35:40.654 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: jq '.quorum | length == 2' 2026-02-18T00:35:40.654 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: echo '{"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":12,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"a9d6a614-446b-449b-9b9f-370c60593bc7","modified":"2026-02-18T00:35:22.026628Z","created":"2026-02-18T00:35:22.026628Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-18T00:35:40.664 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: res=false 2026-02-18T00:35:40.664 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: wait_for_quorum: [[ false == \t\r\u\e ]] 2026-02-18T00:35:40.665 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1060: wait_for_quorum: date +%s 2026-02-18T00:35:40.666 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1060: wait_for_quorum: [[ 1771374940 -lt 1771374993 ]] 2026-02-18T00:35:40.666 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1061: wait_for_quorum: jqfilter='.quorum | length == 2' 2026-02-18T00:35:40.666 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2026-02-18T00:35:40.778 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: jqinput=' 2026-02-18T00:35:40.778 INFO:tasks.workunit.client.0.trial069.stderr:{"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":13,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"a9d6a614-446b-449b-9b9f-370c60593bc7","modified":"2026-02-18T00:35:22.026628Z","created":"2026-02-18T00:35:22.026628Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-18T00:35:40.779 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: jq '.quorum | length == 2' 2026-02-18T00:35:40.779 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: echo '{"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":13,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"a9d6a614-446b-449b-9b9f-370c60593bc7","modified":"2026-02-18T00:35:22.026628Z","created":"2026-02-18T00:35:22.026628Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-18T00:35:40.789 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: res=false 2026-02-18T00:35:40.789 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: wait_for_quorum: [[ false == \t\r\u\e ]] 2026-02-18T00:35:40.790 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1060: wait_for_quorum: date +%s 2026-02-18T00:35:40.790 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1060: wait_for_quorum: [[ 1771374940 -lt 1771374993 ]] 2026-02-18T00:35:40.790 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1061: wait_for_quorum: jqfilter='.quorum | length == 2' 2026-02-18T00:35:40.791 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2026-02-18T00:35:40.907 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: jqinput=' 2026-02-18T00:35:40.907 INFO:tasks.workunit.client.0.trial069.stderr:{"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":13,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"a9d6a614-446b-449b-9b9f-370c60593bc7","modified":"2026-02-18T00:35:22.026628Z","created":"2026-02-18T00:35:22.026628Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-18T00:35:40.908 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: jq '.quorum | length == 2' 2026-02-18T00:35:40.908 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: echo '{"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":13,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"a9d6a614-446b-449b-9b9f-370c60593bc7","modified":"2026-02-18T00:35:22.026628Z","created":"2026-02-18T00:35:22.026628Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-18T00:35:40.917 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: res=false 2026-02-18T00:35:40.918 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: wait_for_quorum: [[ false == \t\r\u\e ]] 2026-02-18T00:35:40.918 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1060: wait_for_quorum: date +%s 2026-02-18T00:35:40.919 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1060: wait_for_quorum: [[ 1771374940 -lt 1771374993 ]] 2026-02-18T00:35:40.919 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1061: wait_for_quorum: jqfilter='.quorum | length == 2' 2026-02-18T00:35:40.920 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2026-02-18T00:35:41.031 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: jqinput=' 2026-02-18T00:35:41.031 INFO:tasks.workunit.client.0.trial069.stderr:{"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":13,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"a9d6a614-446b-449b-9b9f-370c60593bc7","modified":"2026-02-18T00:35:22.026628Z","created":"2026-02-18T00:35:22.026628Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-18T00:35:41.032 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: jq '.quorum | length == 2' 2026-02-18T00:35:41.032 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: echo '{"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":13,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"a9d6a614-446b-449b-9b9f-370c60593bc7","modified":"2026-02-18T00:35:22.026628Z","created":"2026-02-18T00:35:22.026628Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-18T00:35:41.041 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: res=false 2026-02-18T00:35:41.042 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: wait_for_quorum: [[ false == \t\r\u\e ]] 2026-02-18T00:35:41.042 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1060: wait_for_quorum: date +%s 2026-02-18T00:35:41.043 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1060: wait_for_quorum: [[ 1771374941 -lt 1771374993 ]] 2026-02-18T00:35:41.043 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1061: wait_for_quorum: jqfilter='.quorum | length == 2' 2026-02-18T00:35:41.044 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2026-02-18T00:35:41.156 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: jqinput=' 2026-02-18T00:35:41.156 INFO:tasks.workunit.client.0.trial069.stderr:{"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":13,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"a9d6a614-446b-449b-9b9f-370c60593bc7","modified":"2026-02-18T00:35:22.026628Z","created":"2026-02-18T00:35:22.026628Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-18T00:35:41.156 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: jq '.quorum | length == 2' 2026-02-18T00:35:41.156 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: echo '{"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":13,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"a9d6a614-446b-449b-9b9f-370c60593bc7","modified":"2026-02-18T00:35:22.026628Z","created":"2026-02-18T00:35:22.026628Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-18T00:35:41.165 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: res=false 2026-02-18T00:35:41.166 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: wait_for_quorum: [[ false == \t\r\u\e ]] 2026-02-18T00:35:41.166 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1060: wait_for_quorum: date +%s 2026-02-18T00:35:41.167 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1060: wait_for_quorum: [[ 1771374941 -lt 1771374993 ]] 2026-02-18T00:35:41.167 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1061: wait_for_quorum: jqfilter='.quorum | length == 2' 2026-02-18T00:35:41.167 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2026-02-18T00:35:41.282 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: jqinput=' 2026-02-18T00:35:41.282 INFO:tasks.workunit.client.0.trial069.stderr:{"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":13,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"a9d6a614-446b-449b-9b9f-370c60593bc7","modified":"2026-02-18T00:35:22.026628Z","created":"2026-02-18T00:35:22.026628Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-18T00:35:41.282 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: echo '{"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":13,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"a9d6a614-446b-449b-9b9f-370c60593bc7","modified":"2026-02-18T00:35:22.026628Z","created":"2026-02-18T00:35:22.026628Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-18T00:35:41.282 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: jq '.quorum | length == 2' 2026-02-18T00:35:41.292 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: res=false 2026-02-18T00:35:41.292 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: wait_for_quorum: [[ false == \t\r\u\e ]] 2026-02-18T00:35:41.293 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1060: wait_for_quorum: date +%s 2026-02-18T00:35:41.294 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1060: wait_for_quorum: [[ 1771374941 -lt 1771374993 ]] 2026-02-18T00:35:41.294 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1061: wait_for_quorum: jqfilter='.quorum | length == 2' 2026-02-18T00:35:41.294 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2026-02-18T00:35:41.407 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: jqinput=' 2026-02-18T00:35:41.407 INFO:tasks.workunit.client.0.trial069.stderr:{"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":13,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"a9d6a614-446b-449b-9b9f-370c60593bc7","modified":"2026-02-18T00:35:22.026628Z","created":"2026-02-18T00:35:22.026628Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-18T00:35:41.408 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: echo '{"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":13,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"a9d6a614-446b-449b-9b9f-370c60593bc7","modified":"2026-02-18T00:35:22.026628Z","created":"2026-02-18T00:35:22.026628Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-18T00:35:41.408 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: jq '.quorum | length == 2' 2026-02-18T00:35:41.417 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: res=false 2026-02-18T00:35:41.417 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: wait_for_quorum: [[ false == \t\r\u\e ]] 2026-02-18T00:35:41.418 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1060: wait_for_quorum: date +%s 2026-02-18T00:35:41.419 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1060: wait_for_quorum: [[ 1771374941 -lt 1771374993 ]] 2026-02-18T00:35:41.419 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1061: wait_for_quorum: jqfilter='.quorum | length == 2' 2026-02-18T00:35:41.419 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2026-02-18T00:35:41.533 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: jqinput=' 2026-02-18T00:35:41.533 INFO:tasks.workunit.client.0.trial069.stderr:{"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":13,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"a9d6a614-446b-449b-9b9f-370c60593bc7","modified":"2026-02-18T00:35:22.026628Z","created":"2026-02-18T00:35:22.026628Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-18T00:35:41.534 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: jq '.quorum | length == 2' 2026-02-18T00:35:41.534 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: echo '{"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":13,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"a9d6a614-446b-449b-9b9f-370c60593bc7","modified":"2026-02-18T00:35:22.026628Z","created":"2026-02-18T00:35:22.026628Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-18T00:35:41.544 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: res=false 2026-02-18T00:35:41.544 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: wait_for_quorum: [[ false == \t\r\u\e ]] 2026-02-18T00:35:41.544 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1060: wait_for_quorum: date +%s 2026-02-18T00:35:41.545 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1060: wait_for_quorum: [[ 1771374941 -lt 1771374993 ]] 2026-02-18T00:35:41.545 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1061: wait_for_quorum: jqfilter='.quorum | length == 2' 2026-02-18T00:35:41.546 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2026-02-18T00:35:41.656 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: jqinput=' 2026-02-18T00:35:41.656 INFO:tasks.workunit.client.0.trial069.stderr:{"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":13,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"a9d6a614-446b-449b-9b9f-370c60593bc7","modified":"2026-02-18T00:35:22.026628Z","created":"2026-02-18T00:35:22.026628Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-18T00:35:41.657 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: jq '.quorum | length == 2' 2026-02-18T00:35:41.657 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: echo '{"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":13,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"a9d6a614-446b-449b-9b9f-370c60593bc7","modified":"2026-02-18T00:35:22.026628Z","created":"2026-02-18T00:35:22.026628Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-18T00:35:41.666 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: res=false 2026-02-18T00:35:41.666 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: wait_for_quorum: [[ false == \t\r\u\e ]] 2026-02-18T00:35:41.666 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1060: wait_for_quorum: date +%s 2026-02-18T00:35:41.667 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1060: wait_for_quorum: [[ 1771374941 -lt 1771374993 ]] 2026-02-18T00:35:41.667 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1061: wait_for_quorum: jqfilter='.quorum | length == 2' 2026-02-18T00:35:41.668 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2026-02-18T00:35:41.784 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: jqinput=' 2026-02-18T00:35:41.784 INFO:tasks.workunit.client.0.trial069.stderr:{"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":14,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"a9d6a614-446b-449b-9b9f-370c60593bc7","modified":"2026-02-18T00:35:22.026628Z","created":"2026-02-18T00:35:22.026628Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-18T00:35:41.785 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: jq '.quorum | length == 2' 2026-02-18T00:35:41.785 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: echo '{"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":14,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"a9d6a614-446b-449b-9b9f-370c60593bc7","modified":"2026-02-18T00:35:22.026628Z","created":"2026-02-18T00:35:22.026628Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-18T00:35:41.794 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: res=false 2026-02-18T00:35:41.794 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: wait_for_quorum: [[ false == \t\r\u\e ]] 2026-02-18T00:35:41.794 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1060: wait_for_quorum: date +%s 2026-02-18T00:35:41.795 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1060: wait_for_quorum: [[ 1771374941 -lt 1771374993 ]] 2026-02-18T00:35:41.795 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1061: wait_for_quorum: jqfilter='.quorum | length == 2' 2026-02-18T00:35:41.796 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2026-02-18T00:35:41.911 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: jqinput=' 2026-02-18T00:35:41.911 INFO:tasks.workunit.client.0.trial069.stderr:{"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":14,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"a9d6a614-446b-449b-9b9f-370c60593bc7","modified":"2026-02-18T00:35:22.026628Z","created":"2026-02-18T00:35:22.026628Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-18T00:35:41.912 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: echo '{"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":14,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"a9d6a614-446b-449b-9b9f-370c60593bc7","modified":"2026-02-18T00:35:22.026628Z","created":"2026-02-18T00:35:22.026628Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-18T00:35:41.912 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: jq '.quorum | length == 2' 2026-02-18T00:35:41.921 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: res=false 2026-02-18T00:35:41.921 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: wait_for_quorum: [[ false == \t\r\u\e ]] 2026-02-18T00:35:41.922 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1060: wait_for_quorum: date +%s 2026-02-18T00:35:41.923 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1060: wait_for_quorum: [[ 1771374941 -lt 1771374993 ]] 2026-02-18T00:35:41.923 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1061: wait_for_quorum: jqfilter='.quorum | length == 2' 2026-02-18T00:35:41.923 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2026-02-18T00:35:48.053 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: jqinput=' 2026-02-18T00:35:48.054 INFO:tasks.workunit.client.0.trial069.stderr:{"election_epoch":12,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"a9d6a614-446b-449b-9b9f-370c60593bc7","modified":"2026-02-18T00:35:22.026628Z","created":"2026-02-18T00:35:22.026628Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-18T00:35:48.054 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: echo '{"election_epoch":12,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"a9d6a614-446b-449b-9b9f-370c60593bc7","modified":"2026-02-18T00:35:22.026628Z","created":"2026-02-18T00:35:22.026628Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-18T00:35:48.054 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: jq '.quorum | length == 2' 2026-02-18T00:35:48.065 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: res=true 2026-02-18T00:35:48.065 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: wait_for_quorum: [[ true == \t\r\u\e ]] 2026-02-18T00:35:48.065 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: wait_for_quorum: no_quorum=0 2026-02-18T00:35:48.065 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1066: wait_for_quorum: break 2026-02-18T00:35:48.065 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1069: wait_for_quorum: return 0 2026-02-18T00:35:48.066 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:90: TEST_3_mons_checks: ceph mon ok-to-stop a 2026-02-18T00:35:48.148 INFO:tasks.workunit.client.0.trial069.stderr:Error EBUSY: not enough monitors would be available (c) after stopping mons a 2026-02-18T00:35:48.152 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:91: TEST_3_mons_checks: ceph mon ok-to-stop b 2026-02-18T00:35:48.252 INFO:tasks.workunit.client.0.trial069.stderr:quorum should be preserved (a,c) after stopping b 2026-02-18T00:35:48.259 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:92: TEST_3_mons_checks: ceph mon ok-to-stop c 2026-02-18T00:35:48.358 INFO:tasks.workunit.client.0.trial069.stderr:Error EBUSY: not enough monitors would be available (a) after stopping mons c 2026-02-18T00:35:48.362 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:94: TEST_3_mons_checks: ceph mon ok-to-add-offline 2026-02-18T00:35:51.449 INFO:tasks.workunit.client.0.trial069.stderr:Error EBUSY: adding a monitor may break quorum (until that monitor starts) 2026-02-18T00:35:51.452 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:96: TEST_3_mons_checks: ceph mon ok-to-rm a 2026-02-18T00:35:51.540 INFO:tasks.workunit.client.0.trial069.stderr:Error EBUSY: removing mon.a would break quorum 2026-02-18T00:35:51.543 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:97: TEST_3_mons_checks: ceph mon ok-to-rm b 2026-02-18T00:35:51.645 INFO:tasks.workunit.client.0.trial069.stderr:safe to remove mon.b 2026-02-18T00:35:51.652 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:98: TEST_3_mons_checks: ceph mon ok-to-rm c 2026-02-18T00:35:51.753 INFO:tasks.workunit.client.0.trial069.stderr:Error EBUSY: removing mon.c would break quorum 2026-02-18T00:35:51.757 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:22: run: kill_daemons td/ok-to-stop KILL 2026-02-18T00:35:51.758 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:35:51.758 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:35:51.758 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:35:51.758 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:35:51.758 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:35:51.866 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:35:51.866 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:23: run: teardown td/ok-to-stop 2026-02-18T00:35:51.867 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/ok-to-stop 2026-02-18T00:35:51.867 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T00:35:51.867 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/ok-to-stop KILL 2026-02-18T00:35:51.867 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:35:51.867 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:35:51.867 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:35:51.867 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:35:51.867 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:35:51.872 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:35:51.872 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T00:35:51.873 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T00:35:51.874 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T00:35:51.875 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T00:35:51.875 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T00:35:51.875 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T00:35:51.876 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:35:51.876 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T00:35:51.877 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T00:35:51.877 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:35:51.878 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T00:35:51.880 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T00:35:51.880 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/ok-to-stop 2026-02-18T00:35:51.885 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T00:35:51.885 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:35:51.885 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.35978 2026-02-18T00:35:51.885 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.35978 2026-02-18T00:35:51.887 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T00:35:51.887 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T00:35:51.887 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:19: run: for func in $funcs 2026-02-18T00:35:51.887 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:20: run: setup td/ok-to-stop 2026-02-18T00:35:51.887 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/ok-to-stop 2026-02-18T00:35:51.888 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/ok-to-stop 2026-02-18T00:35:51.888 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/ok-to-stop 2026-02-18T00:35:51.888 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T00:35:51.888 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/ok-to-stop KILL 2026-02-18T00:35:51.888 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:35:51.888 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:35:51.888 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:35:51.888 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:35:51.888 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:35:51.889 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:35:51.890 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T00:35:51.891 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T00:35:51.891 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T00:35:51.892 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T00:35:51.892 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T00:35:51.892 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T00:35:51.893 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:35:51.894 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T00:35:51.894 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T00:35:51.894 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:35:51.895 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T00:35:51.896 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T00:35:51.897 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/ok-to-stop 2026-02-18T00:35:51.898 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T00:35:51.898 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:35:51.898 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.35978 2026-02-18T00:35:51.898 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.35978 2026-02-18T00:35:51.899 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T00:35:51.899 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T00:35:51.899 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/ok-to-stop 2026-02-18T00:35:51.900 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-18T00:35:51.901 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:35:51.901 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.35978 2026-02-18T00:35:51.901 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.35978 2026-02-18T00:35:51.902 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-18T00:35:51.904 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-18T00:35:51.904 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-18T00:35:51.904 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/ok-to-stop 1' TERM HUP INT 2026-02-18T00:35:51.904 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:21: run: TEST_4_mons_checks td/ok-to-stop 2026-02-18T00:35:51.904 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:102: TEST_4_mons_checks: local dir=td/ok-to-stop 2026-02-18T00:35:51.904 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:104: TEST_4_mons_checks: CEPH_ARGS='--fsid=a9d6a614-446b-449b-9b9f-370c60593bc7 --auth-supported=none --mon-host=127.0.0.1:7150,127.0.0.1:7151,127.0.0.1:7152,127.0.0.1:7153 ' 2026-02-18T00:35:51.904 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:106: TEST_4_mons_checks: run_mon td/ok-to-stop a --public-addr=127.0.0.1:7150 2026-02-18T00:35:51.904 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/ok-to-stop 2026-02-18T00:35:51.904 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-18T00:35:51.904 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-18T00:35:51.905 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-18T00:35:51.905 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/ok-to-stop/a 2026-02-18T00:35:51.905 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/ok-to-stop/a --run-dir=td/ok-to-stop --public-addr=127.0.0.1:7150 2026-02-18T00:35:51.925 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-18T00:35:51.925 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:35:51.925 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:35:51.925 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:35:51.925 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:35:51.925 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.35978 2026-02-18T00:35:51.926 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.35978/$cluster-$name.asok' 2026-02-18T00:35:51.926 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/ok-to-stop/a '--log-file=td/ok-to-stop/$name.log' '--admin-socket=/tmp/ceph-asok.35978/$cluster-$name.asok' --mon-cluster-log-file=td/ok-to-stop/log --run-dir=td/ok-to-stop '--pid-file=td/ok-to-stop/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --public-addr=127.0.0.1:7150 2026-02-18T00:35:51.953 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-18T00:35:51.954 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-18T00:35:51.954 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T00:35:51.954 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-18T00:35:51.954 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-18T00:35:51.955 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-18T00:35:51.955 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-18T00:35:51.956 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:35:51.956 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:35:51.956 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:35:51.956 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:35:51.956 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.35978 2026-02-18T00:35:51.956 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.35978/ceph-mon.a.asok 2026-02-18T00:35:51.956 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T00:35:51.957 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.35978/ceph-mon.a.asok config get fsid 2026-02-18T00:35:52.011 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-18T00:35:52.011 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T00:35:52.011 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-18T00:35:52.011 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-18T00:35:52.011 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-18T00:35:52.011 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-18T00:35:52.011 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:35:52.011 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:35:52.012 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:35:52.012 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:35:52.013 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.35978 2026-02-18T00:35:52.013 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.35978/ceph-mon.a.asok 2026-02-18T00:35:52.013 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T00:35:52.013 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.35978/ceph-mon.a.asok config get mon_host 2026-02-18T00:35:52.066 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:107: TEST_4_mons_checks: run_mon td/ok-to-stop b --public-addr=127.0.0.1:7151 2026-02-18T00:35:52.066 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/ok-to-stop 2026-02-18T00:35:52.066 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-18T00:35:52.067 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=b 2026-02-18T00:35:52.067 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-18T00:35:52.067 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/ok-to-stop/b 2026-02-18T00:35:52.067 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id b --mkfs --mon-data=td/ok-to-stop/b --run-dir=td/ok-to-stop --public-addr=127.0.0.1:7151 2026-02-18T00:35:52.086 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-18T00:35:52.086 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:35:52.086 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:35:52.087 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:35:52.087 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:35:52.087 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.35978 2026-02-18T00:35:52.087 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.35978/$cluster-$name.asok' 2026-02-18T00:35:52.087 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id b --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/ok-to-stop/b '--log-file=td/ok-to-stop/$name.log' '--admin-socket=/tmp/ceph-asok.35978/$cluster-$name.asok' --mon-cluster-log-file=td/ok-to-stop/log --run-dir=td/ok-to-stop '--pid-file=td/ok-to-stop/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --public-addr=127.0.0.1:7151 2026-02-18T00:35:52.114 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-18T00:35:52.115 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon b fsid 2026-02-18T00:35:52.115 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T00:35:52.115 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=b 2026-02-18T00:35:52.115 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-18T00:35:52.117 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-18T00:35:52.117 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.b 2026-02-18T00:35:52.117 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.b 2026-02-18T00:35:52.117 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.b ']' 2026-02-18T00:35:52.117 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:35:52.117 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:35:52.117 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.35978 2026-02-18T00:35:52.117 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.35978/ceph-mon.b.asok 2026-02-18T00:35:52.117 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T00:35:52.117 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.35978/ceph-mon.b.asok config get fsid 2026-02-18T00:35:52.188 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon b mon_host 2026-02-18T00:35:52.188 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T00:35:52.189 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=b 2026-02-18T00:35:52.189 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-18T00:35:52.190 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-18T00:35:52.190 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.b 2026-02-18T00:35:52.190 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.b 2026-02-18T00:35:52.190 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.b ']' 2026-02-18T00:35:52.190 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:35:52.191 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:35:52.191 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.35978 2026-02-18T00:35:52.191 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.35978/ceph-mon.b.asok 2026-02-18T00:35:52.191 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T00:35:52.191 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.35978/ceph-mon.b.asok config get mon_host 2026-02-18T00:35:52.244 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:108: TEST_4_mons_checks: run_mon td/ok-to-stop c --public-addr=127.0.0.1:7152 2026-02-18T00:35:52.244 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/ok-to-stop 2026-02-18T00:35:52.244 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-18T00:35:52.244 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=c 2026-02-18T00:35:52.244 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-18T00:35:52.244 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/ok-to-stop/c 2026-02-18T00:35:52.244 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id c --mkfs --mon-data=td/ok-to-stop/c --run-dir=td/ok-to-stop --public-addr=127.0.0.1:7152 2026-02-18T00:35:52.262 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-18T00:35:52.262 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:35:52.262 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:35:52.262 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:35:52.262 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:35:52.263 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.35978 2026-02-18T00:35:52.263 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.35978/$cluster-$name.asok' 2026-02-18T00:35:52.263 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id c --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/ok-to-stop/c '--log-file=td/ok-to-stop/$name.log' '--admin-socket=/tmp/ceph-asok.35978/$cluster-$name.asok' --mon-cluster-log-file=td/ok-to-stop/log --run-dir=td/ok-to-stop '--pid-file=td/ok-to-stop/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --public-addr=127.0.0.1:7152 2026-02-18T00:35:52.292 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-18T00:35:52.293 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon c fsid 2026-02-18T00:35:52.293 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T00:35:52.293 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=c 2026-02-18T00:35:52.293 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-18T00:35:52.294 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-18T00:35:52.294 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.c 2026-02-18T00:35:52.294 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.c 2026-02-18T00:35:52.294 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.c ']' 2026-02-18T00:35:52.294 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:35:52.295 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:35:52.295 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.35978 2026-02-18T00:35:52.295 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.35978/ceph-mon.c.asok 2026-02-18T00:35:52.295 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T00:35:52.295 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.35978/ceph-mon.c.asok config get fsid 2026-02-18T00:35:52.350 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon c mon_host 2026-02-18T00:35:52.350 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T00:35:52.350 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=c 2026-02-18T00:35:52.350 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-18T00:35:52.350 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-18T00:35:52.351 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.c 2026-02-18T00:35:52.351 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.c 2026-02-18T00:35:52.352 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.c ']' 2026-02-18T00:35:52.352 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:35:52.352 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:35:52.352 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.35978 2026-02-18T00:35:52.352 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.35978/ceph-mon.c.asok 2026-02-18T00:35:52.352 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T00:35:52.352 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.35978/ceph-mon.c.asok config get mon_host 2026-02-18T00:35:52.406 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:109: TEST_4_mons_checks: run_mon td/ok-to-stop d --public-addr=127.0.0.1:7153 2026-02-18T00:35:52.406 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/ok-to-stop 2026-02-18T00:35:52.406 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-18T00:35:52.406 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=d 2026-02-18T00:35:52.406 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-18T00:35:52.406 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/ok-to-stop/d 2026-02-18T00:35:52.407 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id d --mkfs --mon-data=td/ok-to-stop/d --run-dir=td/ok-to-stop --public-addr=127.0.0.1:7153 2026-02-18T00:35:52.426 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-18T00:35:52.426 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:35:52.426 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:35:52.427 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:35:52.427 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:35:52.427 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.35978 2026-02-18T00:35:52.427 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.35978/$cluster-$name.asok' 2026-02-18T00:35:52.427 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id d --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/ok-to-stop/d '--log-file=td/ok-to-stop/$name.log' '--admin-socket=/tmp/ceph-asok.35978/$cluster-$name.asok' --mon-cluster-log-file=td/ok-to-stop/log --run-dir=td/ok-to-stop '--pid-file=td/ok-to-stop/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --public-addr=127.0.0.1:7153 2026-02-18T00:35:52.456 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-18T00:35:52.457 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon d fsid 2026-02-18T00:35:52.457 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T00:35:52.457 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=d 2026-02-18T00:35:52.457 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-18T00:35:52.457 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-18T00:35:52.459 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.d 2026-02-18T00:35:52.459 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.d 2026-02-18T00:35:52.459 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.d ']' 2026-02-18T00:35:52.459 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:35:52.459 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:35:52.459 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.35978 2026-02-18T00:35:52.459 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.35978/ceph-mon.d.asok 2026-02-18T00:35:52.459 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T00:35:52.459 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.35978/ceph-mon.d.asok config get fsid 2026-02-18T00:35:52.513 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon d mon_host 2026-02-18T00:35:52.514 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T00:35:52.514 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=d 2026-02-18T00:35:52.514 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-18T00:35:52.515 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-18T00:35:52.515 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.d 2026-02-18T00:35:52.515 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.d 2026-02-18T00:35:52.515 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.d ']' 2026-02-18T00:35:52.515 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:35:52.515 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:35:52.515 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.35978 2026-02-18T00:35:52.516 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.35978/ceph-mon.d.asok 2026-02-18T00:35:52.516 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T00:35:52.516 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.35978/ceph-mon.d.asok config get mon_host 2026-02-18T00:35:52.573 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:110: TEST_4_mons_checks: wait_for_quorum 60 4 2026-02-18T00:35:52.574 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1046: wait_for_quorum: local timeout=60 2026-02-18T00:35:52.574 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1047: wait_for_quorum: local quorumsize=4 2026-02-18T00:35:52.574 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1049: wait_for_quorum: [[ -z 60 ]] 2026-02-18T00:35:52.574 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1053: wait_for_quorum: [[ -z 4 ]] 2026-02-18T00:35:52.574 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1058: wait_for_quorum: no_quorum=1 2026-02-18T00:35:52.574 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1059: wait_for_quorum: date +%s 2026-02-18T00:35:52.575 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1059: wait_for_quorum: wait_until=1771375012 2026-02-18T00:35:52.575 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1060: wait_for_quorum: date +%s 2026-02-18T00:35:52.576 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1060: wait_for_quorum: [[ 1771374952 -lt 1771375012 ]] 2026-02-18T00:35:52.576 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1061: wait_for_quorum: jqfilter='.quorum | length == 4' 2026-02-18T00:35:52.577 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2026-02-18T00:35:52.896 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: jqinput=' 2026-02-18T00:35:52.896 INFO:tasks.workunit.client.0.trial069.stderr:{"election_epoch":4,"quorum":[0,1,2,3],"quorum_names":["a","b","c","d"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"a9d6a614-446b-449b-9b9f-370c60593bc7","modified":"2026-02-18T00:35:51.915207Z","created":"2026-02-18T00:35:51.915207Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-18T00:35:52.897 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: echo '{"election_epoch":4,"quorum":[0,1,2,3],"quorum_names":["a","b","c","d"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"a9d6a614-446b-449b-9b9f-370c60593bc7","modified":"2026-02-18T00:35:51.915207Z","created":"2026-02-18T00:35:51.915207Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-18T00:35:52.897 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: jq '.quorum | length == 4' 2026-02-18T00:35:52.906 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: res=true 2026-02-18T00:35:52.907 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: wait_for_quorum: [[ true == \t\r\u\e ]] 2026-02-18T00:35:52.907 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: wait_for_quorum: no_quorum=0 2026-02-18T00:35:52.907 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1066: wait_for_quorum: break 2026-02-18T00:35:52.907 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1069: wait_for_quorum: return 0 2026-02-18T00:35:52.907 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:112: TEST_4_mons_checks: ceph mon ok-to-stop dne 2026-02-18T00:35:53.012 INFO:tasks.workunit.client.0.trial069.stderr:invalid mon(s) specified: dne 2026-02-18T00:35:53.020 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:113: TEST_4_mons_checks: ceph mon ok-to-stop a 2026-02-18T00:35:53.126 INFO:tasks.workunit.client.0.trial069.stderr:quorum should be preserved (b,c,d) after stopping a 2026-02-18T00:35:53.134 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:114: TEST_4_mons_checks: ceph mon ok-to-stop b 2026-02-18T00:35:53.242 INFO:tasks.workunit.client.0.trial069.stderr:quorum should be preserved (a,c,d) after stopping b 2026-02-18T00:35:53.250 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:115: TEST_4_mons_checks: ceph mon ok-to-stop c 2026-02-18T00:35:53.364 INFO:tasks.workunit.client.0.trial069.stderr:quorum should be preserved (a,b,d) after stopping c 2026-02-18T00:35:53.374 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:116: TEST_4_mons_checks: ceph mon ok-to-stop d 2026-02-18T00:35:56.482 INFO:tasks.workunit.client.0.trial069.stderr:quorum should be preserved (a,b,c) after stopping d 2026-02-18T00:35:56.492 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:117: TEST_4_mons_checks: ceph mon ok-to-stop a b 2026-02-18T00:35:56.578 INFO:tasks.workunit.client.0.trial069.stderr:Error EBUSY: not enough monitors would be available (c,d) after stopping mons a b 2026-02-18T00:35:56.580 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:118: TEST_4_mons_checks: ceph mon ok-to-stop c d 2026-02-18T00:35:56.680 INFO:tasks.workunit.client.0.trial069.stderr:Error EBUSY: not enough monitors would be available (a,b) after stopping mons c d 2026-02-18T00:35:56.684 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:120: TEST_4_mons_checks: ceph mon ok-to-add-offline 2026-02-18T00:35:56.790 INFO:tasks.workunit.client.0.trial069.stderr:adding another mon that is not yet online will not break quorum 2026-02-18T00:35:56.798 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:122: TEST_4_mons_checks: ceph mon ok-to-rm a 2026-02-18T00:35:56.903 INFO:tasks.workunit.client.0.trial069.stderr:safe to remove mon.a 2026-02-18T00:35:56.911 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:123: TEST_4_mons_checks: ceph mon ok-to-rm b 2026-02-18T00:35:57.023 INFO:tasks.workunit.client.0.trial069.stderr:safe to remove mon.b 2026-02-18T00:35:57.031 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:124: TEST_4_mons_checks: ceph mon ok-to-rm c 2026-02-18T00:35:57.148 INFO:tasks.workunit.client.0.trial069.stderr:safe to remove mon.c 2026-02-18T00:35:57.156 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:126: TEST_4_mons_checks: kill_daemons td/ok-to-stop KILL mon.a 2026-02-18T00:35:57.157 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:35:57.157 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:35:57.157 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:35:57.157 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:35:57.157 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:35:57.265 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:35:57.265 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:127: TEST_4_mons_checks: wait_for_quorum 60 3 2026-02-18T00:35:57.265 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1046: wait_for_quorum: local timeout=60 2026-02-18T00:35:57.265 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1047: wait_for_quorum: local quorumsize=3 2026-02-18T00:35:57.265 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1049: wait_for_quorum: [[ -z 60 ]] 2026-02-18T00:35:57.265 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1053: wait_for_quorum: [[ -z 3 ]] 2026-02-18T00:35:57.265 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1058: wait_for_quorum: no_quorum=1 2026-02-18T00:35:57.265 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1059: wait_for_quorum: date +%s 2026-02-18T00:35:57.266 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1059: wait_for_quorum: wait_until=1771375017 2026-02-18T00:35:57.266 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1060: wait_for_quorum: date +%s 2026-02-18T00:35:57.267 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1060: wait_for_quorum: [[ 1771374957 -lt 1771375017 ]] 2026-02-18T00:35:57.267 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1061: wait_for_quorum: jqfilter='.quorum | length == 3' 2026-02-18T00:35:57.267 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2026-02-18T00:35:57.380 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: jqinput=' 2026-02-18T00:35:57.380 INFO:tasks.workunit.client.0.trial069.stderr:{"election_epoch":4,"quorum":[0,1,2,3],"quorum_names":["a","b","c","d"],"quorum_leader_name":"a","quorum_age":4,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"a9d6a614-446b-449b-9b9f-370c60593bc7","modified":"2026-02-18T00:35:51.915207Z","created":"2026-02-18T00:35:51.915207Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-18T00:35:57.381 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: jq '.quorum | length == 3' 2026-02-18T00:35:57.381 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: echo '{"election_epoch":4,"quorum":[0,1,2,3],"quorum_names":["a","b","c","d"],"quorum_leader_name":"a","quorum_age":4,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"a9d6a614-446b-449b-9b9f-370c60593bc7","modified":"2026-02-18T00:35:51.915207Z","created":"2026-02-18T00:35:51.915207Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-18T00:35:57.390 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: res=false 2026-02-18T00:35:57.390 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: wait_for_quorum: [[ false == \t\r\u\e ]] 2026-02-18T00:35:57.391 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1060: wait_for_quorum: date +%s 2026-02-18T00:35:57.392 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1060: wait_for_quorum: [[ 1771374957 -lt 1771375017 ]] 2026-02-18T00:35:57.392 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1061: wait_for_quorum: jqfilter='.quorum | length == 3' 2026-02-18T00:35:57.392 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2026-02-18T00:35:57.505 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: jqinput=' 2026-02-18T00:35:57.505 INFO:tasks.workunit.client.0.trial069.stderr:{"election_epoch":4,"quorum":[0,1,2,3],"quorum_names":["a","b","c","d"],"quorum_leader_name":"a","quorum_age":4,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"a9d6a614-446b-449b-9b9f-370c60593bc7","modified":"2026-02-18T00:35:51.915207Z","created":"2026-02-18T00:35:51.915207Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-18T00:35:57.505 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: jq '.quorum | length == 3' 2026-02-18T00:35:57.505 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: echo '{"election_epoch":4,"quorum":[0,1,2,3],"quorum_names":["a","b","c","d"],"quorum_leader_name":"a","quorum_age":4,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"a9d6a614-446b-449b-9b9f-370c60593bc7","modified":"2026-02-18T00:35:51.915207Z","created":"2026-02-18T00:35:51.915207Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-18T00:35:57.514 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: res=false 2026-02-18T00:35:57.514 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: wait_for_quorum: [[ false == \t\r\u\e ]] 2026-02-18T00:35:57.514 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1060: wait_for_quorum: date +%s 2026-02-18T00:35:57.516 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1060: wait_for_quorum: [[ 1771374957 -lt 1771375017 ]] 2026-02-18T00:35:57.516 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1061: wait_for_quorum: jqfilter='.quorum | length == 3' 2026-02-18T00:35:57.516 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2026-02-18T00:35:57.628 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: jqinput=' 2026-02-18T00:35:57.628 INFO:tasks.workunit.client.0.trial069.stderr:{"election_epoch":4,"quorum":[0,1,2,3],"quorum_names":["a","b","c","d"],"quorum_leader_name":"a","quorum_age":4,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"a9d6a614-446b-449b-9b9f-370c60593bc7","modified":"2026-02-18T00:35:51.915207Z","created":"2026-02-18T00:35:51.915207Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-18T00:35:57.628 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: jq '.quorum | length == 3' 2026-02-18T00:35:57.629 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: echo '{"election_epoch":4,"quorum":[0,1,2,3],"quorum_names":["a","b","c","d"],"quorum_leader_name":"a","quorum_age":4,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"a9d6a614-446b-449b-9b9f-370c60593bc7","modified":"2026-02-18T00:35:51.915207Z","created":"2026-02-18T00:35:51.915207Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-18T00:35:57.638 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: res=false 2026-02-18T00:35:57.638 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: wait_for_quorum: [[ false == \t\r\u\e ]] 2026-02-18T00:35:57.638 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1060: wait_for_quorum: date +%s 2026-02-18T00:35:57.639 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1060: wait_for_quorum: [[ 1771374957 -lt 1771375017 ]] 2026-02-18T00:35:57.639 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1061: wait_for_quorum: jqfilter='.quorum | length == 3' 2026-02-18T00:35:57.640 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2026-02-18T00:36:00.755 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: jqinput=' 2026-02-18T00:36:00.755 INFO:tasks.workunit.client.0.trial069.stderr:{"election_epoch":4,"quorum":[0,1,2,3],"quorum_names":["a","b","c","d"],"quorum_leader_name":"a","quorum_age":8,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"a9d6a614-446b-449b-9b9f-370c60593bc7","modified":"2026-02-18T00:35:51.915207Z","created":"2026-02-18T00:35:51.915207Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-18T00:36:00.756 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: jq '.quorum | length == 3' 2026-02-18T00:36:00.756 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: echo '{"election_epoch":4,"quorum":[0,1,2,3],"quorum_names":["a","b","c","d"],"quorum_leader_name":"a","quorum_age":8,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"a9d6a614-446b-449b-9b9f-370c60593bc7","modified":"2026-02-18T00:35:51.915207Z","created":"2026-02-18T00:35:51.915207Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-18T00:36:00.765 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: res=false 2026-02-18T00:36:00.765 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: wait_for_quorum: [[ false == \t\r\u\e ]] 2026-02-18T00:36:00.765 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1060: wait_for_quorum: date +%s 2026-02-18T00:36:00.766 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1060: wait_for_quorum: [[ 1771374960 -lt 1771375017 ]] 2026-02-18T00:36:00.766 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1061: wait_for_quorum: jqfilter='.quorum | length == 3' 2026-02-18T00:36:00.767 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2026-02-18T00:36:03.879 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: jqinput=' 2026-02-18T00:36:03.879 INFO:tasks.workunit.client.0.trial069.stderr:{"election_epoch":4,"quorum":[0,1,2,3],"quorum_names":["a","b","c","d"],"quorum_leader_name":"a","quorum_age":11,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"a9d6a614-446b-449b-9b9f-370c60593bc7","modified":"2026-02-18T00:35:51.915207Z","created":"2026-02-18T00:35:51.915207Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-18T00:36:03.880 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: jq '.quorum | length == 3' 2026-02-18T00:36:03.880 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: echo '{"election_epoch":4,"quorum":[0,1,2,3],"quorum_names":["a","b","c","d"],"quorum_leader_name":"a","quorum_age":11,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"a9d6a614-446b-449b-9b9f-370c60593bc7","modified":"2026-02-18T00:35:51.915207Z","created":"2026-02-18T00:35:51.915207Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-18T00:36:03.890 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: res=false 2026-02-18T00:36:03.890 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: wait_for_quorum: [[ false == \t\r\u\e ]] 2026-02-18T00:36:03.890 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1060: wait_for_quorum: date +%s 2026-02-18T00:36:03.891 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1060: wait_for_quorum: [[ 1771374963 -lt 1771375017 ]] 2026-02-18T00:36:03.892 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1061: wait_for_quorum: jqfilter='.quorum | length == 3' 2026-02-18T00:36:03.892 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2026-02-18T00:36:04.004 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: jqinput=' 2026-02-18T00:36:04.005 INFO:tasks.workunit.client.0.trial069.stderr:{"election_epoch":4,"quorum":[0,1,2,3],"quorum_names":["a","b","c","d"],"quorum_leader_name":"a","quorum_age":11,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"a9d6a614-446b-449b-9b9f-370c60593bc7","modified":"2026-02-18T00:35:51.915207Z","created":"2026-02-18T00:35:51.915207Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-18T00:36:04.005 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: jq '.quorum | length == 3' 2026-02-18T00:36:04.005 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: echo '{"election_epoch":4,"quorum":[0,1,2,3],"quorum_names":["a","b","c","d"],"quorum_leader_name":"a","quorum_age":11,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"a9d6a614-446b-449b-9b9f-370c60593bc7","modified":"2026-02-18T00:35:51.915207Z","created":"2026-02-18T00:35:51.915207Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-18T00:36:04.014 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: res=false 2026-02-18T00:36:04.014 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: wait_for_quorum: [[ false == \t\r\u\e ]] 2026-02-18T00:36:04.015 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1060: wait_for_quorum: date +%s 2026-02-18T00:36:04.016 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1060: wait_for_quorum: [[ 1771374964 -lt 1771375017 ]] 2026-02-18T00:36:04.016 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1061: wait_for_quorum: jqfilter='.quorum | length == 3' 2026-02-18T00:36:04.016 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2026-02-18T00:36:07.130 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: jqinput=' 2026-02-18T00:36:07.131 INFO:tasks.workunit.client.0.trial069.stderr:{"election_epoch":4,"quorum":[0,1,2,3],"quorum_names":["a","b","c","d"],"quorum_leader_name":"a","quorum_age":14,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"a9d6a614-446b-449b-9b9f-370c60593bc7","modified":"2026-02-18T00:35:51.915207Z","created":"2026-02-18T00:35:51.915207Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-18T00:36:07.131 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: jq '.quorum | length == 3' 2026-02-18T00:36:07.132 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: echo '{"election_epoch":4,"quorum":[0,1,2,3],"quorum_names":["a","b","c","d"],"quorum_leader_name":"a","quorum_age":14,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"a9d6a614-446b-449b-9b9f-370c60593bc7","modified":"2026-02-18T00:35:51.915207Z","created":"2026-02-18T00:35:51.915207Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-18T00:36:07.142 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: res=false 2026-02-18T00:36:07.142 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: wait_for_quorum: [[ false == \t\r\u\e ]] 2026-02-18T00:36:07.142 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1060: wait_for_quorum: date +%s 2026-02-18T00:36:07.143 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1060: wait_for_quorum: [[ 1771374967 -lt 1771375017 ]] 2026-02-18T00:36:07.143 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1061: wait_for_quorum: jqfilter='.quorum | length == 3' 2026-02-18T00:36:07.143 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2026-02-18T00:36:16.262 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: jqinput=' 2026-02-18T00:36:16.262 INFO:tasks.workunit.client.0.trial069.stderr:{"election_epoch":6,"quorum":[1,2,3],"quorum_names":["b","c","d"],"quorum_leader_name":"b","quorum_age":4,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"a9d6a614-446b-449b-9b9f-370c60593bc7","modified":"2026-02-18T00:35:51.915207Z","created":"2026-02-18T00:35:51.915207Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-18T00:36:16.262 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: jq '.quorum | length == 3' 2026-02-18T00:36:16.262 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: echo '{"election_epoch":6,"quorum":[1,2,3],"quorum_names":["b","c","d"],"quorum_leader_name":"b","quorum_age":4,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"a9d6a614-446b-449b-9b9f-370c60593bc7","modified":"2026-02-18T00:35:51.915207Z","created":"2026-02-18T00:35:51.915207Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-18T00:36:16.273 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: res=true 2026-02-18T00:36:16.273 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: wait_for_quorum: [[ true == \t\r\u\e ]] 2026-02-18T00:36:16.273 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: wait_for_quorum: no_quorum=0 2026-02-18T00:36:16.273 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1066: wait_for_quorum: break 2026-02-18T00:36:16.273 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1069: wait_for_quorum: return 0 2026-02-18T00:36:16.273 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:129: TEST_4_mons_checks: ceph mon ok-to-stop a 2026-02-18T00:36:19.378 INFO:tasks.workunit.client.0.trial069.stderr:quorum should be preserved (b,c,d) after stopping a 2026-02-18T00:36:19.387 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:130: TEST_4_mons_checks: ceph mon ok-to-stop b 2026-02-18T00:36:19.476 INFO:tasks.workunit.client.0.trial069.stderr:Error EBUSY: not enough monitors would be available (c,d) after stopping mons b 2026-02-18T00:36:19.479 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:131: TEST_4_mons_checks: ceph mon ok-to-stop c 2026-02-18T00:36:19.568 INFO:tasks.workunit.client.0.trial069.stderr:Error EBUSY: not enough monitors would be available (b,d) after stopping mons c 2026-02-18T00:36:19.571 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:132: TEST_4_mons_checks: ceph mon ok-to-stop d 2026-02-18T00:36:19.658 INFO:tasks.workunit.client.0.trial069.stderr:Error EBUSY: not enough monitors would be available (b,c) after stopping mons d 2026-02-18T00:36:19.660 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:134: TEST_4_mons_checks: ceph mon ok-to-add-offline 2026-02-18T00:36:19.769 INFO:tasks.workunit.client.0.trial069.stderr:adding another mon that is not yet online will not break quorum 2026-02-18T00:36:19.777 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:136: TEST_4_mons_checks: ceph mon ok-to-rm a 2026-02-18T00:36:19.895 INFO:tasks.workunit.client.0.trial069.stderr:safe to remove mon.a 2026-02-18T00:36:19.903 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:137: TEST_4_mons_checks: ceph mon ok-to-rm b 2026-02-18T00:36:23.021 INFO:tasks.workunit.client.0.trial069.stderr:safe to remove mon.b 2026-02-18T00:36:23.031 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:138: TEST_4_mons_checks: ceph mon ok-to-rm c 2026-02-18T00:36:23.137 INFO:tasks.workunit.client.0.trial069.stderr:safe to remove mon.c 2026-02-18T00:36:23.145 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:139: TEST_4_mons_checks: ceph mon ok-to-rm d 2026-02-18T00:36:23.262 INFO:tasks.workunit.client.0.trial069.stderr:safe to remove mon.d 2026-02-18T00:36:23.270 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:22: run: kill_daemons td/ok-to-stop KILL 2026-02-18T00:36:23.270 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:36:23.270 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:36:23.271 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:36:23.271 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:36:23.271 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:36:23.380 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:36:23.380 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:23: run: teardown td/ok-to-stop 2026-02-18T00:36:23.380 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/ok-to-stop 2026-02-18T00:36:23.380 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T00:36:23.380 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/ok-to-stop KILL 2026-02-18T00:36:23.380 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:36:23.380 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:36:23.380 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:36:23.380 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:36:23.381 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:36:23.385 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:36:23.385 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T00:36:23.386 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T00:36:23.387 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T00:36:23.388 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T00:36:23.388 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T00:36:23.388 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T00:36:23.390 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:36:23.390 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T00:36:23.390 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T00:36:23.390 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:36:23.391 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T00:36:23.392 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T00:36:23.392 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/ok-to-stop 2026-02-18T00:36:23.399 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T00:36:23.399 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:36:23.399 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.35978 2026-02-18T00:36:23.399 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.35978 2026-02-18T00:36:23.401 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T00:36:23.401 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T00:36:23.401 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:19: run: for func in $funcs 2026-02-18T00:36:23.402 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:20: run: setup td/ok-to-stop 2026-02-18T00:36:23.402 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/ok-to-stop 2026-02-18T00:36:23.402 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/ok-to-stop 2026-02-18T00:36:23.402 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/ok-to-stop 2026-02-18T00:36:23.402 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T00:36:23.402 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/ok-to-stop KILL 2026-02-18T00:36:23.402 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:36:23.402 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:36:23.402 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:36:23.402 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:36:23.402 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:36:23.404 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:36:23.404 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T00:36:23.405 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T00:36:23.405 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T00:36:23.406 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T00:36:23.407 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T00:36:23.407 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T00:36:23.408 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:36:23.408 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T00:36:23.408 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T00:36:23.409 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:36:23.410 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T00:36:23.411 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T00:36:23.411 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/ok-to-stop 2026-02-18T00:36:23.412 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T00:36:23.412 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:36:23.412 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.35978 2026-02-18T00:36:23.412 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.35978 2026-02-18T00:36:23.414 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T00:36:23.414 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T00:36:23.414 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/ok-to-stop 2026-02-18T00:36:23.415 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-18T00:36:23.415 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:36:23.415 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.35978 2026-02-18T00:36:23.415 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.35978 2026-02-18T00:36:23.417 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-18T00:36:23.418 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-18T00:36:23.418 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-18T00:36:23.418 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/ok-to-stop 1' TERM HUP INT 2026-02-18T00:36:23.418 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:21: run: TEST_5_mons_checks td/ok-to-stop 2026-02-18T00:36:23.418 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:143: TEST_5_mons_checks: local dir=td/ok-to-stop 2026-02-18T00:36:23.418 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:145: TEST_5_mons_checks: CEPH_ARGS='--fsid=a9d6a614-446b-449b-9b9f-370c60593bc7 --auth-supported=none --mon-host=127.0.0.1:7150,127.0.0.1:7151,127.0.0.1:7152,127.0.0.1:7153,127.0.0.1:7154 ' 2026-02-18T00:36:23.418 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:147: TEST_5_mons_checks: run_mon td/ok-to-stop a --public-addr=127.0.0.1:7150 2026-02-18T00:36:23.418 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/ok-to-stop 2026-02-18T00:36:23.418 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-18T00:36:23.418 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-18T00:36:23.418 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-18T00:36:23.418 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/ok-to-stop/a 2026-02-18T00:36:23.418 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/ok-to-stop/a --run-dir=td/ok-to-stop --public-addr=127.0.0.1:7150 2026-02-18T00:36:23.437 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-18T00:36:23.438 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:36:23.438 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:36:23.438 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:36:23.438 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:36:23.438 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.35978 2026-02-18T00:36:23.438 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.35978/$cluster-$name.asok' 2026-02-18T00:36:23.439 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/ok-to-stop/a '--log-file=td/ok-to-stop/$name.log' '--admin-socket=/tmp/ceph-asok.35978/$cluster-$name.asok' --mon-cluster-log-file=td/ok-to-stop/log --run-dir=td/ok-to-stop '--pid-file=td/ok-to-stop/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --public-addr=127.0.0.1:7150 2026-02-18T00:36:23.466 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-18T00:36:23.467 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-18T00:36:23.467 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T00:36:23.467 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-18T00:36:23.467 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-18T00:36:23.468 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-18T00:36:23.468 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-18T00:36:23.468 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:36:23.468 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:36:23.468 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:36:23.468 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:36:23.468 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.35978 2026-02-18T00:36:23.469 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.35978/ceph-mon.a.asok 2026-02-18T00:36:23.469 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T00:36:23.469 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.35978/ceph-mon.a.asok config get fsid 2026-02-18T00:36:23.523 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-18T00:36:23.523 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T00:36:23.523 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-18T00:36:23.523 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-18T00:36:23.523 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-18T00:36:23.523 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-18T00:36:23.523 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:36:23.524 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:36:23.524 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:36:23.524 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:36:23.524 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.35978 2026-02-18T00:36:23.524 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.35978/ceph-mon.a.asok 2026-02-18T00:36:23.524 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T00:36:23.524 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.35978/ceph-mon.a.asok config get mon_host 2026-02-18T00:36:23.578 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:148: TEST_5_mons_checks: run_mon td/ok-to-stop b --public-addr=127.0.0.1:7151 2026-02-18T00:36:23.579 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/ok-to-stop 2026-02-18T00:36:23.579 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-18T00:36:23.579 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=b 2026-02-18T00:36:23.579 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-18T00:36:23.579 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/ok-to-stop/b 2026-02-18T00:36:23.579 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id b --mkfs --mon-data=td/ok-to-stop/b --run-dir=td/ok-to-stop --public-addr=127.0.0.1:7151 2026-02-18T00:36:23.598 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-18T00:36:23.599 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:36:23.599 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:36:23.599 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:36:23.599 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:36:23.599 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.35978 2026-02-18T00:36:23.599 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.35978/$cluster-$name.asok' 2026-02-18T00:36:23.599 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id b --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/ok-to-stop/b '--log-file=td/ok-to-stop/$name.log' '--admin-socket=/tmp/ceph-asok.35978/$cluster-$name.asok' --mon-cluster-log-file=td/ok-to-stop/log --run-dir=td/ok-to-stop '--pid-file=td/ok-to-stop/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --public-addr=127.0.0.1:7151 2026-02-18T00:36:23.634 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-18T00:36:23.635 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon b fsid 2026-02-18T00:36:23.635 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T00:36:23.636 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=b 2026-02-18T00:36:23.636 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-18T00:36:23.636 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-18T00:36:23.636 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.b 2026-02-18T00:36:23.637 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.b 2026-02-18T00:36:23.637 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.b ']' 2026-02-18T00:36:23.637 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:36:23.637 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:36:23.637 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.35978 2026-02-18T00:36:23.637 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.35978/ceph-mon.b.asok 2026-02-18T00:36:23.637 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T00:36:23.637 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.35978/ceph-mon.b.asok config get fsid 2026-02-18T00:36:23.691 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon b mon_host 2026-02-18T00:36:23.691 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T00:36:23.691 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=b 2026-02-18T00:36:23.691 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-18T00:36:23.692 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-18T00:36:23.692 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.b 2026-02-18T00:36:23.692 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.b 2026-02-18T00:36:23.692 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.b ']' 2026-02-18T00:36:23.692 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:36:23.692 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:36:23.692 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.35978 2026-02-18T00:36:23.692 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.35978/ceph-mon.b.asok 2026-02-18T00:36:23.693 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T00:36:23.693 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.35978/ceph-mon.b.asok config get mon_host 2026-02-18T00:36:23.746 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:149: TEST_5_mons_checks: run_mon td/ok-to-stop c --public-addr=127.0.0.1:7152 2026-02-18T00:36:23.747 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/ok-to-stop 2026-02-18T00:36:23.747 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-18T00:36:23.747 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=c 2026-02-18T00:36:23.747 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-18T00:36:23.747 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/ok-to-stop/c 2026-02-18T00:36:23.747 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id c --mkfs --mon-data=td/ok-to-stop/c --run-dir=td/ok-to-stop --public-addr=127.0.0.1:7152 2026-02-18T00:36:23.766 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-18T00:36:23.766 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:36:23.766 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:36:23.767 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:36:23.767 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:36:23.767 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.35978 2026-02-18T00:36:23.767 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.35978/$cluster-$name.asok' 2026-02-18T00:36:23.767 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id c --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/ok-to-stop/c '--log-file=td/ok-to-stop/$name.log' '--admin-socket=/tmp/ceph-asok.35978/$cluster-$name.asok' --mon-cluster-log-file=td/ok-to-stop/log --run-dir=td/ok-to-stop '--pid-file=td/ok-to-stop/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --public-addr=127.0.0.1:7152 2026-02-18T00:36:23.796 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-18T00:36:23.797 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon c fsid 2026-02-18T00:36:23.797 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T00:36:23.797 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=c 2026-02-18T00:36:23.797 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-18T00:36:23.798 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-18T00:36:23.798 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.c 2026-02-18T00:36:23.798 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.c 2026-02-18T00:36:23.798 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.c ']' 2026-02-18T00:36:23.798 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:36:23.798 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:36:23.799 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.35978 2026-02-18T00:36:23.799 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.35978/ceph-mon.c.asok 2026-02-18T00:36:23.799 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T00:36:23.799 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.35978/ceph-mon.c.asok config get fsid 2026-02-18T00:36:23.854 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon c mon_host 2026-02-18T00:36:23.854 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T00:36:23.855 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=c 2026-02-18T00:36:23.855 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-18T00:36:23.855 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-18T00:36:23.856 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.c 2026-02-18T00:36:23.856 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.c 2026-02-18T00:36:23.856 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.c ']' 2026-02-18T00:36:23.856 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:36:23.856 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:36:23.856 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.35978 2026-02-18T00:36:23.856 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.35978/ceph-mon.c.asok 2026-02-18T00:36:23.856 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T00:36:23.856 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.35978/ceph-mon.c.asok config get mon_host 2026-02-18T00:36:23.914 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:150: TEST_5_mons_checks: run_mon td/ok-to-stop d --public-addr=127.0.0.1:7153 2026-02-18T00:36:23.914 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/ok-to-stop 2026-02-18T00:36:23.914 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-18T00:36:23.914 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=d 2026-02-18T00:36:23.914 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-18T00:36:23.914 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/ok-to-stop/d 2026-02-18T00:36:23.914 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id d --mkfs --mon-data=td/ok-to-stop/d --run-dir=td/ok-to-stop --public-addr=127.0.0.1:7153 2026-02-18T00:36:23.935 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-18T00:36:23.935 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:36:23.935 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:36:23.936 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:36:23.936 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:36:23.936 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.35978 2026-02-18T00:36:23.936 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.35978/$cluster-$name.asok' 2026-02-18T00:36:23.936 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id d --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/ok-to-stop/d '--log-file=td/ok-to-stop/$name.log' '--admin-socket=/tmp/ceph-asok.35978/$cluster-$name.asok' --mon-cluster-log-file=td/ok-to-stop/log --run-dir=td/ok-to-stop '--pid-file=td/ok-to-stop/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --public-addr=127.0.0.1:7153 2026-02-18T00:36:23.964 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-18T00:36:23.965 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon d fsid 2026-02-18T00:36:23.965 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T00:36:23.965 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=d 2026-02-18T00:36:23.965 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-18T00:36:23.965 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-18T00:36:23.966 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.d 2026-02-18T00:36:23.966 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.d 2026-02-18T00:36:23.966 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.d ']' 2026-02-18T00:36:23.966 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:36:23.966 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:36:23.966 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.35978 2026-02-18T00:36:23.967 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.35978/ceph-mon.d.asok 2026-02-18T00:36:23.967 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T00:36:23.967 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.35978/ceph-mon.d.asok config get fsid 2026-02-18T00:36:24.021 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon d mon_host 2026-02-18T00:36:24.021 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T00:36:24.022 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=d 2026-02-18T00:36:24.022 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-18T00:36:24.022 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-18T00:36:24.023 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.d 2026-02-18T00:36:24.023 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.d 2026-02-18T00:36:24.023 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.d ']' 2026-02-18T00:36:24.023 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:36:24.023 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:36:24.023 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.35978 2026-02-18T00:36:24.023 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.35978/ceph-mon.d.asok 2026-02-18T00:36:24.023 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T00:36:24.023 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.35978/ceph-mon.d.asok config get mon_host 2026-02-18T00:36:24.076 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:151: TEST_5_mons_checks: run_mon td/ok-to-stop e --public-addr=127.0.0.1:7154 2026-02-18T00:36:24.076 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/ok-to-stop 2026-02-18T00:36:24.076 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-18T00:36:24.076 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=e 2026-02-18T00:36:24.076 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-18T00:36:24.076 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/ok-to-stop/e 2026-02-18T00:36:24.076 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id e --mkfs --mon-data=td/ok-to-stop/e --run-dir=td/ok-to-stop --public-addr=127.0.0.1:7154 2026-02-18T00:36:24.096 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-18T00:36:24.096 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:36:24.096 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:36:24.096 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:36:24.096 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:36:24.097 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.35978 2026-02-18T00:36:24.097 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.35978/$cluster-$name.asok' 2026-02-18T00:36:24.097 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id e --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/ok-to-stop/e '--log-file=td/ok-to-stop/$name.log' '--admin-socket=/tmp/ceph-asok.35978/$cluster-$name.asok' --mon-cluster-log-file=td/ok-to-stop/log --run-dir=td/ok-to-stop '--pid-file=td/ok-to-stop/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --public-addr=127.0.0.1:7154 2026-02-18T00:36:24.122 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-18T00:36:24.123 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon e fsid 2026-02-18T00:36:24.123 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T00:36:24.123 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=e 2026-02-18T00:36:24.124 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-18T00:36:24.125 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-18T00:36:24.125 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.e 2026-02-18T00:36:24.125 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.e 2026-02-18T00:36:24.125 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.e ']' 2026-02-18T00:36:24.125 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:36:24.125 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:36:24.125 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.35978 2026-02-18T00:36:24.125 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.35978/ceph-mon.e.asok 2026-02-18T00:36:24.126 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T00:36:24.126 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.35978/ceph-mon.e.asok config get fsid 2026-02-18T00:36:24.180 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon e mon_host 2026-02-18T00:36:24.180 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T00:36:24.180 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=e 2026-02-18T00:36:24.180 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-18T00:36:24.181 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-18T00:36:24.181 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.e 2026-02-18T00:36:24.181 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.e 2026-02-18T00:36:24.181 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.e ']' 2026-02-18T00:36:24.181 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:36:24.181 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:36:24.181 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.35978 2026-02-18T00:36:24.182 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.35978/ceph-mon.e.asok 2026-02-18T00:36:24.182 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T00:36:24.182 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.35978/ceph-mon.e.asok config get mon_host 2026-02-18T00:36:24.236 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:152: TEST_5_mons_checks: wait_for_quorum 60 5 2026-02-18T00:36:24.236 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1046: wait_for_quorum: local timeout=60 2026-02-18T00:36:24.236 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1047: wait_for_quorum: local quorumsize=5 2026-02-18T00:36:24.236 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1049: wait_for_quorum: [[ -z 60 ]] 2026-02-18T00:36:24.237 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1053: wait_for_quorum: [[ -z 5 ]] 2026-02-18T00:36:24.237 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1058: wait_for_quorum: no_quorum=1 2026-02-18T00:36:24.237 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1059: wait_for_quorum: date +%s 2026-02-18T00:36:24.237 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1059: wait_for_quorum: wait_until=1771375044 2026-02-18T00:36:24.238 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1060: wait_for_quorum: date +%s 2026-02-18T00:36:24.239 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1060: wait_for_quorum: [[ 1771374984 -lt 1771375044 ]] 2026-02-18T00:36:24.239 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1061: wait_for_quorum: jqfilter='.quorum | length == 5' 2026-02-18T00:36:24.239 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2026-02-18T00:36:30.354 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: jqinput=' 2026-02-18T00:36:30.354 INFO:tasks.workunit.client.0.trial069.stderr:{"election_epoch":8,"quorum":[0,1,2,3,4],"quorum_names":["a","b","c","d","e"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"a9d6a614-446b-449b-9b9f-370c60593bc7","modified":"2026-02-18T00:36:23.427919Z","created":"2026-02-18T00:36:23.427919Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-18T00:36:30.354 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: jq '.quorum | length == 5' 2026-02-18T00:36:30.354 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: echo '{"election_epoch":8,"quorum":[0,1,2,3,4],"quorum_names":["a","b","c","d","e"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"a9d6a614-446b-449b-9b9f-370c60593bc7","modified":"2026-02-18T00:36:23.427919Z","created":"2026-02-18T00:36:23.427919Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-18T00:36:30.365 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: res=true 2026-02-18T00:36:30.365 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: wait_for_quorum: [[ true == \t\r\u\e ]] 2026-02-18T00:36:30.365 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: wait_for_quorum: no_quorum=0 2026-02-18T00:36:30.365 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1066: wait_for_quorum: break 2026-02-18T00:36:30.365 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1069: wait_for_quorum: return 0 2026-02-18T00:36:30.365 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:154: TEST_5_mons_checks: ceph mon ok-to-stop dne 2026-02-18T00:36:30.469 INFO:tasks.workunit.client.0.trial069.stderr:invalid mon(s) specified: dne 2026-02-18T00:36:30.476 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:155: TEST_5_mons_checks: ceph mon ok-to-stop a 2026-02-18T00:36:30.592 INFO:tasks.workunit.client.0.trial069.stderr:quorum should be preserved (b,c,d,e) after stopping a 2026-02-18T00:36:30.600 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:156: TEST_5_mons_checks: ceph mon ok-to-stop b 2026-02-18T00:36:30.716 INFO:tasks.workunit.client.0.trial069.stderr:quorum should be preserved (a,c,d,e) after stopping b 2026-02-18T00:36:30.724 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:157: TEST_5_mons_checks: ceph mon ok-to-stop c 2026-02-18T00:36:30.838 INFO:tasks.workunit.client.0.trial069.stderr:quorum should be preserved (a,b,d,e) after stopping c 2026-02-18T00:36:30.846 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:158: TEST_5_mons_checks: ceph mon ok-to-stop d 2026-02-18T00:36:30.962 INFO:tasks.workunit.client.0.trial069.stderr:quorum should be preserved (a,b,c,e) after stopping d 2026-02-18T00:36:30.969 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:159: TEST_5_mons_checks: ceph mon ok-to-stop e 2026-02-18T00:36:31.088 INFO:tasks.workunit.client.0.trial069.stderr:quorum should be preserved (a,b,c,d) after stopping e 2026-02-18T00:36:31.098 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:160: TEST_5_mons_checks: ceph mon ok-to-stop a b 2026-02-18T00:36:31.201 INFO:tasks.workunit.client.0.trial069.stderr:quorum should be preserved (c,d,e) after stopping a b 2026-02-18T00:36:31.209 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:161: TEST_5_mons_checks: ceph mon ok-to-stop c d 2026-02-18T00:36:31.325 INFO:tasks.workunit.client.0.trial069.stderr:quorum should be preserved (a,b,e) after stopping c d 2026-02-18T00:36:31.333 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:162: TEST_5_mons_checks: ceph mon ok-to-stop a b c 2026-02-18T00:36:31.431 INFO:tasks.workunit.client.0.trial069.stderr:Error EBUSY: not enough monitors would be available (d,e) after stopping mons a b c 2026-02-18T00:36:31.435 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:164: TEST_5_mons_checks: ceph mon ok-to-add-offline 2026-02-18T00:36:31.539 INFO:tasks.workunit.client.0.trial069.stderr:adding another mon that is not yet online will not break quorum 2026-02-18T00:36:31.549 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:166: TEST_5_mons_checks: ceph mon ok-to-rm a 2026-02-18T00:36:31.652 INFO:tasks.workunit.client.0.trial069.stderr:safe to remove mon.a 2026-02-18T00:36:31.659 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:167: TEST_5_mons_checks: ceph mon ok-to-rm b 2026-02-18T00:36:31.773 INFO:tasks.workunit.client.0.trial069.stderr:safe to remove mon.b 2026-02-18T00:36:31.780 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:168: TEST_5_mons_checks: ceph mon ok-to-rm c 2026-02-18T00:36:31.890 INFO:tasks.workunit.client.0.trial069.stderr:safe to remove mon.c 2026-02-18T00:36:31.898 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:169: TEST_5_mons_checks: ceph mon ok-to-rm d 2026-02-18T00:36:32.002 INFO:tasks.workunit.client.0.trial069.stderr:safe to remove mon.d 2026-02-18T00:36:32.010 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:170: TEST_5_mons_checks: ceph mon ok-to-rm e 2026-02-18T00:36:32.115 INFO:tasks.workunit.client.0.trial069.stderr:safe to remove mon.e 2026-02-18T00:36:32.125 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:172: TEST_5_mons_checks: kill_daemons td/ok-to-stop KILL mon.a 2026-02-18T00:36:32.126 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:36:32.127 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:36:32.127 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:36:32.127 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:36:32.127 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:36:32.235 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:36:32.235 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:173: TEST_5_mons_checks: wait_for_quorum 60 4 2026-02-18T00:36:32.235 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1046: wait_for_quorum: local timeout=60 2026-02-18T00:36:32.235 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1047: wait_for_quorum: local quorumsize=4 2026-02-18T00:36:32.235 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1049: wait_for_quorum: [[ -z 60 ]] 2026-02-18T00:36:32.235 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1053: wait_for_quorum: [[ -z 4 ]] 2026-02-18T00:36:32.235 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1058: wait_for_quorum: no_quorum=1 2026-02-18T00:36:32.235 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1059: wait_for_quorum: date +%s 2026-02-18T00:36:32.236 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1059: wait_for_quorum: wait_until=1771375052 2026-02-18T00:36:32.236 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1060: wait_for_quorum: date +%s 2026-02-18T00:36:32.237 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1060: wait_for_quorum: [[ 1771374992 -lt 1771375052 ]] 2026-02-18T00:36:32.237 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1061: wait_for_quorum: jqfilter='.quorum | length == 4' 2026-02-18T00:36:32.237 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2026-02-18T00:36:32.350 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: jqinput=' 2026-02-18T00:36:32.350 INFO:tasks.workunit.client.0.trial069.stderr:{"election_epoch":8,"quorum":[0,1,2,3,4],"quorum_names":["a","b","c","d","e"],"quorum_leader_name":"a","quorum_age":2,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"a9d6a614-446b-449b-9b9f-370c60593bc7","modified":"2026-02-18T00:36:23.427919Z","created":"2026-02-18T00:36:23.427919Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-18T00:36:32.351 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: jq '.quorum | length == 4' 2026-02-18T00:36:32.351 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: echo '{"election_epoch":8,"quorum":[0,1,2,3,4],"quorum_names":["a","b","c","d","e"],"quorum_leader_name":"a","quorum_age":2,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"a9d6a614-446b-449b-9b9f-370c60593bc7","modified":"2026-02-18T00:36:23.427919Z","created":"2026-02-18T00:36:23.427919Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-18T00:36:32.361 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: res=false 2026-02-18T00:36:32.361 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: wait_for_quorum: [[ false == \t\r\u\e ]] 2026-02-18T00:36:32.362 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1060: wait_for_quorum: date +%s 2026-02-18T00:36:32.363 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1060: wait_for_quorum: [[ 1771374992 -lt 1771375052 ]] 2026-02-18T00:36:32.363 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1061: wait_for_quorum: jqfilter='.quorum | length == 4' 2026-02-18T00:36:32.363 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2026-02-18T00:36:32.474 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: jqinput=' 2026-02-18T00:36:32.474 INFO:tasks.workunit.client.0.trial069.stderr:{"election_epoch":8,"quorum":[0,1,2,3,4],"quorum_names":["a","b","c","d","e"],"quorum_leader_name":"a","quorum_age":2,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"a9d6a614-446b-449b-9b9f-370c60593bc7","modified":"2026-02-18T00:36:23.427919Z","created":"2026-02-18T00:36:23.427919Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-18T00:36:32.475 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: jq '.quorum | length == 4' 2026-02-18T00:36:32.475 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: echo '{"election_epoch":8,"quorum":[0,1,2,3,4],"quorum_names":["a","b","c","d","e"],"quorum_leader_name":"a","quorum_age":2,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"a9d6a614-446b-449b-9b9f-370c60593bc7","modified":"2026-02-18T00:36:23.427919Z","created":"2026-02-18T00:36:23.427919Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-18T00:36:32.486 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: res=false 2026-02-18T00:36:32.486 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: wait_for_quorum: [[ false == \t\r\u\e ]] 2026-02-18T00:36:32.486 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1060: wait_for_quorum: date +%s 2026-02-18T00:36:32.487 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1060: wait_for_quorum: [[ 1771374992 -lt 1771375052 ]] 2026-02-18T00:36:32.487 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1061: wait_for_quorum: jqfilter='.quorum | length == 4' 2026-02-18T00:36:32.487 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2026-02-18T00:36:32.600 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: jqinput=' 2026-02-18T00:36:32.600 INFO:tasks.workunit.client.0.trial069.stderr:{"election_epoch":8,"quorum":[0,1,2,3,4],"quorum_names":["a","b","c","d","e"],"quorum_leader_name":"a","quorum_age":2,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"a9d6a614-446b-449b-9b9f-370c60593bc7","modified":"2026-02-18T00:36:23.427919Z","created":"2026-02-18T00:36:23.427919Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-18T00:36:32.601 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: jq '.quorum | length == 4' 2026-02-18T00:36:32.601 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: echo '{"election_epoch":8,"quorum":[0,1,2,3,4],"quorum_names":["a","b","c","d","e"],"quorum_leader_name":"a","quorum_age":2,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"a9d6a614-446b-449b-9b9f-370c60593bc7","modified":"2026-02-18T00:36:23.427919Z","created":"2026-02-18T00:36:23.427919Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-18T00:36:32.610 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: res=false 2026-02-18T00:36:32.610 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: wait_for_quorum: [[ false == \t\r\u\e ]] 2026-02-18T00:36:32.610 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1060: wait_for_quorum: date +%s 2026-02-18T00:36:32.611 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1060: wait_for_quorum: [[ 1771374992 -lt 1771375052 ]] 2026-02-18T00:36:32.612 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1061: wait_for_quorum: jqfilter='.quorum | length == 4' 2026-02-18T00:36:32.612 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2026-02-18T00:36:32.728 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: jqinput=' 2026-02-18T00:36:32.729 INFO:tasks.workunit.client.0.trial069.stderr:{"election_epoch":8,"quorum":[0,1,2,3,4],"quorum_names":["a","b","c","d","e"],"quorum_leader_name":"a","quorum_age":2,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"a9d6a614-446b-449b-9b9f-370c60593bc7","modified":"2026-02-18T00:36:23.427919Z","created":"2026-02-18T00:36:23.427919Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-18T00:36:32.729 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: echo '{"election_epoch":8,"quorum":[0,1,2,3,4],"quorum_names":["a","b","c","d","e"],"quorum_leader_name":"a","quorum_age":2,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"a9d6a614-446b-449b-9b9f-370c60593bc7","modified":"2026-02-18T00:36:23.427919Z","created":"2026-02-18T00:36:23.427919Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-18T00:36:32.729 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: jq '.quorum | length == 4' 2026-02-18T00:36:32.739 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: res=false 2026-02-18T00:36:32.739 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: wait_for_quorum: [[ false == \t\r\u\e ]] 2026-02-18T00:36:32.739 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1060: wait_for_quorum: date +%s 2026-02-18T00:36:32.740 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1060: wait_for_quorum: [[ 1771374992 -lt 1771375052 ]] 2026-02-18T00:36:32.740 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1061: wait_for_quorum: jqfilter='.quorum | length == 4' 2026-02-18T00:36:32.741 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2026-02-18T00:36:32.851 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: jqinput=' 2026-02-18T00:36:32.851 INFO:tasks.workunit.client.0.trial069.stderr:{"election_epoch":8,"quorum":[0,1,2,3,4],"quorum_names":["a","b","c","d","e"],"quorum_leader_name":"a","quorum_age":2,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"a9d6a614-446b-449b-9b9f-370c60593bc7","modified":"2026-02-18T00:36:23.427919Z","created":"2026-02-18T00:36:23.427919Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-18T00:36:32.852 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: echo '{"election_epoch":8,"quorum":[0,1,2,3,4],"quorum_names":["a","b","c","d","e"],"quorum_leader_name":"a","quorum_age":2,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"a9d6a614-446b-449b-9b9f-370c60593bc7","modified":"2026-02-18T00:36:23.427919Z","created":"2026-02-18T00:36:23.427919Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-18T00:36:32.852 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: jq '.quorum | length == 4' 2026-02-18T00:36:32.862 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: res=false 2026-02-18T00:36:32.862 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: wait_for_quorum: [[ false == \t\r\u\e ]] 2026-02-18T00:36:32.863 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1060: wait_for_quorum: date +%s 2026-02-18T00:36:32.864 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1060: wait_for_quorum: [[ 1771374992 -lt 1771375052 ]] 2026-02-18T00:36:32.864 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1061: wait_for_quorum: jqfilter='.quorum | length == 4' 2026-02-18T00:36:32.864 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2026-02-18T00:36:32.977 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: jqinput=' 2026-02-18T00:36:32.977 INFO:tasks.workunit.client.0.trial069.stderr:{"election_epoch":8,"quorum":[0,1,2,3,4],"quorum_names":["a","b","c","d","e"],"quorum_leader_name":"a","quorum_age":3,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"a9d6a614-446b-449b-9b9f-370c60593bc7","modified":"2026-02-18T00:36:23.427919Z","created":"2026-02-18T00:36:23.427919Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-18T00:36:32.978 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: jq '.quorum | length == 4' 2026-02-18T00:36:32.978 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: echo '{"election_epoch":8,"quorum":[0,1,2,3,4],"quorum_names":["a","b","c","d","e"],"quorum_leader_name":"a","quorum_age":3,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"a9d6a614-446b-449b-9b9f-370c60593bc7","modified":"2026-02-18T00:36:23.427919Z","created":"2026-02-18T00:36:23.427919Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-18T00:36:32.989 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: res=false 2026-02-18T00:36:32.989 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: wait_for_quorum: [[ false == \t\r\u\e ]] 2026-02-18T00:36:32.989 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1060: wait_for_quorum: date +%s 2026-02-18T00:36:32.990 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1060: wait_for_quorum: [[ 1771374992 -lt 1771375052 ]] 2026-02-18T00:36:32.990 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1061: wait_for_quorum: jqfilter='.quorum | length == 4' 2026-02-18T00:36:32.991 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2026-02-18T00:36:33.100 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: jqinput=' 2026-02-18T00:36:33.101 INFO:tasks.workunit.client.0.trial069.stderr:{"election_epoch":8,"quorum":[0,1,2,3,4],"quorum_names":["a","b","c","d","e"],"quorum_leader_name":"a","quorum_age":3,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"a9d6a614-446b-449b-9b9f-370c60593bc7","modified":"2026-02-18T00:36:23.427919Z","created":"2026-02-18T00:36:23.427919Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-18T00:36:33.101 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: jq '.quorum | length == 4' 2026-02-18T00:36:33.102 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: echo '{"election_epoch":8,"quorum":[0,1,2,3,4],"quorum_names":["a","b","c","d","e"],"quorum_leader_name":"a","quorum_age":3,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"a9d6a614-446b-449b-9b9f-370c60593bc7","modified":"2026-02-18T00:36:23.427919Z","created":"2026-02-18T00:36:23.427919Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-18T00:36:33.111 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: res=false 2026-02-18T00:36:33.111 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: wait_for_quorum: [[ false == \t\r\u\e ]] 2026-02-18T00:36:33.112 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1060: wait_for_quorum: date +%s 2026-02-18T00:36:33.113 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1060: wait_for_quorum: [[ 1771374993 -lt 1771375052 ]] 2026-02-18T00:36:33.113 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1061: wait_for_quorum: jqfilter='.quorum | length == 4' 2026-02-18T00:36:33.113 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2026-02-18T00:36:33.226 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: jqinput=' 2026-02-18T00:36:33.226 INFO:tasks.workunit.client.0.trial069.stderr:{"election_epoch":8,"quorum":[0,1,2,3,4],"quorum_names":["a","b","c","d","e"],"quorum_leader_name":"a","quorum_age":3,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"a9d6a614-446b-449b-9b9f-370c60593bc7","modified":"2026-02-18T00:36:23.427919Z","created":"2026-02-18T00:36:23.427919Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-18T00:36:33.227 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: echo '{"election_epoch":8,"quorum":[0,1,2,3,4],"quorum_names":["a","b","c","d","e"],"quorum_leader_name":"a","quorum_age":3,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"a9d6a614-446b-449b-9b9f-370c60593bc7","modified":"2026-02-18T00:36:23.427919Z","created":"2026-02-18T00:36:23.427919Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-18T00:36:33.227 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: jq '.quorum | length == 4' 2026-02-18T00:36:33.238 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: res=false 2026-02-18T00:36:33.238 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: wait_for_quorum: [[ false == \t\r\u\e ]] 2026-02-18T00:36:33.238 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1060: wait_for_quorum: date +%s 2026-02-18T00:36:33.239 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1060: wait_for_quorum: [[ 1771374993 -lt 1771375052 ]] 2026-02-18T00:36:33.239 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1061: wait_for_quorum: jqfilter='.quorum | length == 4' 2026-02-18T00:36:33.240 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2026-02-18T00:36:33.354 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: jqinput=' 2026-02-18T00:36:33.354 INFO:tasks.workunit.client.0.trial069.stderr:{"election_epoch":8,"quorum":[0,1,2,3,4],"quorum_names":["a","b","c","d","e"],"quorum_leader_name":"a","quorum_age":3,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"a9d6a614-446b-449b-9b9f-370c60593bc7","modified":"2026-02-18T00:36:23.427919Z","created":"2026-02-18T00:36:23.427919Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-18T00:36:33.355 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: jq '.quorum | length == 4' 2026-02-18T00:36:33.355 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: echo '{"election_epoch":8,"quorum":[0,1,2,3,4],"quorum_names":["a","b","c","d","e"],"quorum_leader_name":"a","quorum_age":3,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"a9d6a614-446b-449b-9b9f-370c60593bc7","modified":"2026-02-18T00:36:23.427919Z","created":"2026-02-18T00:36:23.427919Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-18T00:36:33.365 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: res=false 2026-02-18T00:36:33.366 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: wait_for_quorum: [[ false == \t\r\u\e ]] 2026-02-18T00:36:33.366 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1060: wait_for_quorum: date +%s 2026-02-18T00:36:33.367 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1060: wait_for_quorum: [[ 1771374993 -lt 1771375052 ]] 2026-02-18T00:36:33.367 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1061: wait_for_quorum: jqfilter='.quorum | length == 4' 2026-02-18T00:36:33.367 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2026-02-18T00:36:36.481 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: jqinput=' 2026-02-18T00:36:36.482 INFO:tasks.workunit.client.0.trial069.stderr:{"election_epoch":8,"quorum":[0,1,2,3,4],"quorum_names":["a","b","c","d","e"],"quorum_leader_name":"a","quorum_age":6,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"a9d6a614-446b-449b-9b9f-370c60593bc7","modified":"2026-02-18T00:36:23.427919Z","created":"2026-02-18T00:36:23.427919Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-18T00:36:36.482 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: jq '.quorum | length == 4' 2026-02-18T00:36:36.482 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: echo '{"election_epoch":8,"quorum":[0,1,2,3,4],"quorum_names":["a","b","c","d","e"],"quorum_leader_name":"a","quorum_age":6,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"a9d6a614-446b-449b-9b9f-370c60593bc7","modified":"2026-02-18T00:36:23.427919Z","created":"2026-02-18T00:36:23.427919Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-18T00:36:36.491 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: res=false 2026-02-18T00:36:36.491 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: wait_for_quorum: [[ false == \t\r\u\e ]] 2026-02-18T00:36:36.492 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1060: wait_for_quorum: date +%s 2026-02-18T00:36:36.493 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1060: wait_for_quorum: [[ 1771374996 -lt 1771375052 ]] 2026-02-18T00:36:36.493 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1061: wait_for_quorum: jqfilter='.quorum | length == 4' 2026-02-18T00:36:36.493 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2026-02-18T00:36:36.608 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: jqinput=' 2026-02-18T00:36:36.608 INFO:tasks.workunit.client.0.trial069.stderr:{"election_epoch":8,"quorum":[0,1,2,3,4],"quorum_names":["a","b","c","d","e"],"quorum_leader_name":"a","quorum_age":6,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"a9d6a614-446b-449b-9b9f-370c60593bc7","modified":"2026-02-18T00:36:23.427919Z","created":"2026-02-18T00:36:23.427919Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-18T00:36:36.609 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: jq '.quorum | length == 4' 2026-02-18T00:36:36.609 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: echo '{"election_epoch":8,"quorum":[0,1,2,3,4],"quorum_names":["a","b","c","d","e"],"quorum_leader_name":"a","quorum_age":6,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"a9d6a614-446b-449b-9b9f-370c60593bc7","modified":"2026-02-18T00:36:23.427919Z","created":"2026-02-18T00:36:23.427919Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-18T00:36:36.618 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: res=false 2026-02-18T00:36:36.619 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: wait_for_quorum: [[ false == \t\r\u\e ]] 2026-02-18T00:36:36.619 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1060: wait_for_quorum: date +%s 2026-02-18T00:36:36.621 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1060: wait_for_quorum: [[ 1771374996 -lt 1771375052 ]] 2026-02-18T00:36:36.621 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1061: wait_for_quorum: jqfilter='.quorum | length == 4' 2026-02-18T00:36:36.621 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2026-02-18T00:36:36.732 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: jqinput=' 2026-02-18T00:36:36.732 INFO:tasks.workunit.client.0.trial069.stderr:{"election_epoch":8,"quorum":[0,1,2,3,4],"quorum_names":["a","b","c","d","e"],"quorum_leader_name":"a","quorum_age":6,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"a9d6a614-446b-449b-9b9f-370c60593bc7","modified":"2026-02-18T00:36:23.427919Z","created":"2026-02-18T00:36:23.427919Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-18T00:36:36.733 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: echo '{"election_epoch":8,"quorum":[0,1,2,3,4],"quorum_names":["a","b","c","d","e"],"quorum_leader_name":"a","quorum_age":6,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"a9d6a614-446b-449b-9b9f-370c60593bc7","modified":"2026-02-18T00:36:23.427919Z","created":"2026-02-18T00:36:23.427919Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-18T00:36:36.733 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: jq '.quorum | length == 4' 2026-02-18T00:36:36.742 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: res=false 2026-02-18T00:36:36.742 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: wait_for_quorum: [[ false == \t\r\u\e ]] 2026-02-18T00:36:36.743 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1060: wait_for_quorum: date +%s 2026-02-18T00:36:36.743 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1060: wait_for_quorum: [[ 1771374996 -lt 1771375052 ]] 2026-02-18T00:36:36.744 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1061: wait_for_quorum: jqfilter='.quorum | length == 4' 2026-02-18T00:36:36.744 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2026-02-18T00:36:36.858 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: jqinput=' 2026-02-18T00:36:36.859 INFO:tasks.workunit.client.0.trial069.stderr:{"election_epoch":8,"quorum":[0,1,2,3,4],"quorum_names":["a","b","c","d","e"],"quorum_leader_name":"a","quorum_age":6,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"a9d6a614-446b-449b-9b9f-370c60593bc7","modified":"2026-02-18T00:36:23.427919Z","created":"2026-02-18T00:36:23.427919Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-18T00:36:36.859 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: jq '.quorum | length == 4' 2026-02-18T00:36:36.859 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: echo '{"election_epoch":8,"quorum":[0,1,2,3,4],"quorum_names":["a","b","c","d","e"],"quorum_leader_name":"a","quorum_age":6,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"a9d6a614-446b-449b-9b9f-370c60593bc7","modified":"2026-02-18T00:36:23.427919Z","created":"2026-02-18T00:36:23.427919Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-18T00:36:36.869 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: res=false 2026-02-18T00:36:36.869 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: wait_for_quorum: [[ false == \t\r\u\e ]] 2026-02-18T00:36:36.870 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1060: wait_for_quorum: date +%s 2026-02-18T00:36:36.871 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1060: wait_for_quorum: [[ 1771374996 -lt 1771375052 ]] 2026-02-18T00:36:36.871 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1061: wait_for_quorum: jqfilter='.quorum | length == 4' 2026-02-18T00:36:36.871 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2026-02-18T00:36:36.981 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: jqinput=' 2026-02-18T00:36:36.982 INFO:tasks.workunit.client.0.trial069.stderr:{"election_epoch":8,"quorum":[0,1,2,3,4],"quorum_names":["a","b","c","d","e"],"quorum_leader_name":"a","quorum_age":7,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"a9d6a614-446b-449b-9b9f-370c60593bc7","modified":"2026-02-18T00:36:23.427919Z","created":"2026-02-18T00:36:23.427919Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-18T00:36:36.982 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: jq '.quorum | length == 4' 2026-02-18T00:36:36.983 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: echo '{"election_epoch":8,"quorum":[0,1,2,3,4],"quorum_names":["a","b","c","d","e"],"quorum_leader_name":"a","quorum_age":7,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"a9d6a614-446b-449b-9b9f-370c60593bc7","modified":"2026-02-18T00:36:23.427919Z","created":"2026-02-18T00:36:23.427919Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-18T00:36:36.991 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: res=false 2026-02-18T00:36:36.991 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: wait_for_quorum: [[ false == \t\r\u\e ]] 2026-02-18T00:36:36.992 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1060: wait_for_quorum: date +%s 2026-02-18T00:36:36.993 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1060: wait_for_quorum: [[ 1771374996 -lt 1771375052 ]] 2026-02-18T00:36:36.993 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1061: wait_for_quorum: jqfilter='.quorum | length == 4' 2026-02-18T00:36:36.993 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2026-02-18T00:36:37.105 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: jqinput=' 2026-02-18T00:36:37.105 INFO:tasks.workunit.client.0.trial069.stderr:{"election_epoch":8,"quorum":[0,1,2,3,4],"quorum_names":["a","b","c","d","e"],"quorum_leader_name":"a","quorum_age":7,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"a9d6a614-446b-449b-9b9f-370c60593bc7","modified":"2026-02-18T00:36:23.427919Z","created":"2026-02-18T00:36:23.427919Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-18T00:36:37.106 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: jq '.quorum | length == 4' 2026-02-18T00:36:37.106 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: echo '{"election_epoch":8,"quorum":[0,1,2,3,4],"quorum_names":["a","b","c","d","e"],"quorum_leader_name":"a","quorum_age":7,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"a9d6a614-446b-449b-9b9f-370c60593bc7","modified":"2026-02-18T00:36:23.427919Z","created":"2026-02-18T00:36:23.427919Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-18T00:36:37.115 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: res=false 2026-02-18T00:36:37.115 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: wait_for_quorum: [[ false == \t\r\u\e ]] 2026-02-18T00:36:37.116 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1060: wait_for_quorum: date +%s 2026-02-18T00:36:37.117 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1060: wait_for_quorum: [[ 1771374997 -lt 1771375052 ]] 2026-02-18T00:36:37.117 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1061: wait_for_quorum: jqfilter='.quorum | length == 4' 2026-02-18T00:36:37.117 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2026-02-18T00:36:37.232 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: jqinput=' 2026-02-18T00:36:37.232 INFO:tasks.workunit.client.0.trial069.stderr:{"election_epoch":8,"quorum":[0,1,2,3,4],"quorum_names":["a","b","c","d","e"],"quorum_leader_name":"a","quorum_age":7,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"a9d6a614-446b-449b-9b9f-370c60593bc7","modified":"2026-02-18T00:36:23.427919Z","created":"2026-02-18T00:36:23.427919Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-18T00:36:37.233 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: jq '.quorum | length == 4' 2026-02-18T00:36:37.233 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: echo '{"election_epoch":8,"quorum":[0,1,2,3,4],"quorum_names":["a","b","c","d","e"],"quorum_leader_name":"a","quorum_age":7,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"a9d6a614-446b-449b-9b9f-370c60593bc7","modified":"2026-02-18T00:36:23.427919Z","created":"2026-02-18T00:36:23.427919Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-18T00:36:37.242 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: res=false 2026-02-18T00:36:37.242 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: wait_for_quorum: [[ false == \t\r\u\e ]] 2026-02-18T00:36:37.243 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1060: wait_for_quorum: date +%s 2026-02-18T00:36:37.243 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1060: wait_for_quorum: [[ 1771374997 -lt 1771375052 ]] 2026-02-18T00:36:37.244 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1061: wait_for_quorum: jqfilter='.quorum | length == 4' 2026-02-18T00:36:37.244 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2026-02-18T00:36:37.358 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: jqinput=' 2026-02-18T00:36:37.358 INFO:tasks.workunit.client.0.trial069.stderr:{"election_epoch":8,"quorum":[0,1,2,3,4],"quorum_names":["a","b","c","d","e"],"quorum_leader_name":"a","quorum_age":7,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"a9d6a614-446b-449b-9b9f-370c60593bc7","modified":"2026-02-18T00:36:23.427919Z","created":"2026-02-18T00:36:23.427919Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-18T00:36:37.358 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: jq '.quorum | length == 4' 2026-02-18T00:36:37.359 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: echo '{"election_epoch":8,"quorum":[0,1,2,3,4],"quorum_names":["a","b","c","d","e"],"quorum_leader_name":"a","quorum_age":7,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"a9d6a614-446b-449b-9b9f-370c60593bc7","modified":"2026-02-18T00:36:23.427919Z","created":"2026-02-18T00:36:23.427919Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-18T00:36:37.367 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: res=false 2026-02-18T00:36:37.367 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: wait_for_quorum: [[ false == \t\r\u\e ]] 2026-02-18T00:36:37.368 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1060: wait_for_quorum: date +%s 2026-02-18T00:36:37.369 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1060: wait_for_quorum: [[ 1771374997 -lt 1771375052 ]] 2026-02-18T00:36:37.369 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1061: wait_for_quorum: jqfilter='.quorum | length == 4' 2026-02-18T00:36:37.369 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2026-02-18T00:36:40.486 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: jqinput=' 2026-02-18T00:36:40.486 INFO:tasks.workunit.client.0.trial069.stderr:{"election_epoch":8,"quorum":[0,1,2,3,4],"quorum_names":["a","b","c","d","e"],"quorum_leader_name":"a","quorum_age":10,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"a9d6a614-446b-449b-9b9f-370c60593bc7","modified":"2026-02-18T00:36:23.427919Z","created":"2026-02-18T00:36:23.427919Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-18T00:36:40.487 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: jq '.quorum | length == 4' 2026-02-18T00:36:40.487 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: echo '{"election_epoch":8,"quorum":[0,1,2,3,4],"quorum_names":["a","b","c","d","e"],"quorum_leader_name":"a","quorum_age":10,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"a9d6a614-446b-449b-9b9f-370c60593bc7","modified":"2026-02-18T00:36:23.427919Z","created":"2026-02-18T00:36:23.427919Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-18T00:36:40.498 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: res=false 2026-02-18T00:36:40.498 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: wait_for_quorum: [[ false == \t\r\u\e ]] 2026-02-18T00:36:40.498 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1060: wait_for_quorum: date +%s 2026-02-18T00:36:40.499 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1060: wait_for_quorum: [[ 1771375000 -lt 1771375052 ]] 2026-02-18T00:36:40.499 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1061: wait_for_quorum: jqfilter='.quorum | length == 4' 2026-02-18T00:36:40.500 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2026-02-18T00:36:40.613 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: jqinput=' 2026-02-18T00:36:40.613 INFO:tasks.workunit.client.0.trial069.stderr:{"election_epoch":8,"quorum":[0,1,2,3,4],"quorum_names":["a","b","c","d","e"],"quorum_leader_name":"a","quorum_age":10,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"a9d6a614-446b-449b-9b9f-370c60593bc7","modified":"2026-02-18T00:36:23.427919Z","created":"2026-02-18T00:36:23.427919Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-18T00:36:40.614 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: jq '.quorum | length == 4' 2026-02-18T00:36:40.614 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: echo '{"election_epoch":8,"quorum":[0,1,2,3,4],"quorum_names":["a","b","c","d","e"],"quorum_leader_name":"a","quorum_age":10,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"a9d6a614-446b-449b-9b9f-370c60593bc7","modified":"2026-02-18T00:36:23.427919Z","created":"2026-02-18T00:36:23.427919Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-18T00:36:40.623 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: res=false 2026-02-18T00:36:40.623 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: wait_for_quorum: [[ false == \t\r\u\e ]] 2026-02-18T00:36:40.623 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1060: wait_for_quorum: date +%s 2026-02-18T00:36:40.624 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1060: wait_for_quorum: [[ 1771375000 -lt 1771375052 ]] 2026-02-18T00:36:40.624 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1061: wait_for_quorum: jqfilter='.quorum | length == 4' 2026-02-18T00:36:40.625 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2026-02-18T00:36:40.741 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: jqinput=' 2026-02-18T00:36:40.742 INFO:tasks.workunit.client.0.trial069.stderr:{"election_epoch":8,"quorum":[0,1,2,3,4],"quorum_names":["a","b","c","d","e"],"quorum_leader_name":"a","quorum_age":10,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"a9d6a614-446b-449b-9b9f-370c60593bc7","modified":"2026-02-18T00:36:23.427919Z","created":"2026-02-18T00:36:23.427919Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-18T00:36:40.742 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: echo '{"election_epoch":8,"quorum":[0,1,2,3,4],"quorum_names":["a","b","c","d","e"],"quorum_leader_name":"a","quorum_age":10,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"a9d6a614-446b-449b-9b9f-370c60593bc7","modified":"2026-02-18T00:36:23.427919Z","created":"2026-02-18T00:36:23.427919Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-18T00:36:40.743 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: jq '.quorum | length == 4' 2026-02-18T00:36:40.752 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: res=false 2026-02-18T00:36:40.752 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: wait_for_quorum: [[ false == \t\r\u\e ]] 2026-02-18T00:36:40.752 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1060: wait_for_quorum: date +%s 2026-02-18T00:36:40.753 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1060: wait_for_quorum: [[ 1771375000 -lt 1771375052 ]] 2026-02-18T00:36:40.753 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1061: wait_for_quorum: jqfilter='.quorum | length == 4' 2026-02-18T00:36:40.754 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2026-02-18T00:36:40.868 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: jqinput=' 2026-02-18T00:36:40.868 INFO:tasks.workunit.client.0.trial069.stderr:{"election_epoch":8,"quorum":[0,1,2,3,4],"quorum_names":["a","b","c","d","e"],"quorum_leader_name":"a","quorum_age":10,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"a9d6a614-446b-449b-9b9f-370c60593bc7","modified":"2026-02-18T00:36:23.427919Z","created":"2026-02-18T00:36:23.427919Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-18T00:36:40.869 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: echo '{"election_epoch":8,"quorum":[0,1,2,3,4],"quorum_names":["a","b","c","d","e"],"quorum_leader_name":"a","quorum_age":10,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"a9d6a614-446b-449b-9b9f-370c60593bc7","modified":"2026-02-18T00:36:23.427919Z","created":"2026-02-18T00:36:23.427919Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-18T00:36:40.869 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: jq '.quorum | length == 4' 2026-02-18T00:36:40.879 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: res=false 2026-02-18T00:36:40.879 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: wait_for_quorum: [[ false == \t\r\u\e ]] 2026-02-18T00:36:40.879 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1060: wait_for_quorum: date +%s 2026-02-18T00:36:40.880 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1060: wait_for_quorum: [[ 1771375000 -lt 1771375052 ]] 2026-02-18T00:36:40.880 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1061: wait_for_quorum: jqfilter='.quorum | length == 4' 2026-02-18T00:36:40.881 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2026-02-18T00:36:40.995 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: jqinput=' 2026-02-18T00:36:40.995 INFO:tasks.workunit.client.0.trial069.stderr:{"election_epoch":8,"quorum":[0,1,2,3,4],"quorum_names":["a","b","c","d","e"],"quorum_leader_name":"a","quorum_age":11,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"a9d6a614-446b-449b-9b9f-370c60593bc7","modified":"2026-02-18T00:36:23.427919Z","created":"2026-02-18T00:36:23.427919Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-18T00:36:40.996 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: echo '{"election_epoch":8,"quorum":[0,1,2,3,4],"quorum_names":["a","b","c","d","e"],"quorum_leader_name":"a","quorum_age":11,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"a9d6a614-446b-449b-9b9f-370c60593bc7","modified":"2026-02-18T00:36:23.427919Z","created":"2026-02-18T00:36:23.427919Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-18T00:36:40.996 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: jq '.quorum | length == 4' 2026-02-18T00:36:41.006 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: res=false 2026-02-18T00:36:41.006 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: wait_for_quorum: [[ false == \t\r\u\e ]] 2026-02-18T00:36:41.007 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1060: wait_for_quorum: date +%s 2026-02-18T00:36:41.007 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1060: wait_for_quorum: [[ 1771375001 -lt 1771375052 ]] 2026-02-18T00:36:41.007 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1061: wait_for_quorum: jqfilter='.quorum | length == 4' 2026-02-18T00:36:41.008 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2026-02-18T00:36:41.121 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: jqinput=' 2026-02-18T00:36:41.121 INFO:tasks.workunit.client.0.trial069.stderr:{"election_epoch":8,"quorum":[0,1,2,3,4],"quorum_names":["a","b","c","d","e"],"quorum_leader_name":"a","quorum_age":11,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"a9d6a614-446b-449b-9b9f-370c60593bc7","modified":"2026-02-18T00:36:23.427919Z","created":"2026-02-18T00:36:23.427919Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-18T00:36:41.122 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: echo '{"election_epoch":8,"quorum":[0,1,2,3,4],"quorum_names":["a","b","c","d","e"],"quorum_leader_name":"a","quorum_age":11,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"a9d6a614-446b-449b-9b9f-370c60593bc7","modified":"2026-02-18T00:36:23.427919Z","created":"2026-02-18T00:36:23.427919Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-18T00:36:41.122 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: jq '.quorum | length == 4' 2026-02-18T00:36:41.131 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: res=false 2026-02-18T00:36:41.131 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: wait_for_quorum: [[ false == \t\r\u\e ]] 2026-02-18T00:36:41.132 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1060: wait_for_quorum: date +%s 2026-02-18T00:36:41.133 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1060: wait_for_quorum: [[ 1771375001 -lt 1771375052 ]] 2026-02-18T00:36:41.133 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1061: wait_for_quorum: jqfilter='.quorum | length == 4' 2026-02-18T00:36:41.133 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2026-02-18T00:36:41.248 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: jqinput=' 2026-02-18T00:36:41.248 INFO:tasks.workunit.client.0.trial069.stderr:{"election_epoch":8,"quorum":[0,1,2,3,4],"quorum_names":["a","b","c","d","e"],"quorum_leader_name":"a","quorum_age":11,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"a9d6a614-446b-449b-9b9f-370c60593bc7","modified":"2026-02-18T00:36:23.427919Z","created":"2026-02-18T00:36:23.427919Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-18T00:36:41.248 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: echo '{"election_epoch":8,"quorum":[0,1,2,3,4],"quorum_names":["a","b","c","d","e"],"quorum_leader_name":"a","quorum_age":11,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"a9d6a614-446b-449b-9b9f-370c60593bc7","modified":"2026-02-18T00:36:23.427919Z","created":"2026-02-18T00:36:23.427919Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-18T00:36:41.249 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: jq '.quorum | length == 4' 2026-02-18T00:36:41.259 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: res=false 2026-02-18T00:36:41.259 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: wait_for_quorum: [[ false == \t\r\u\e ]] 2026-02-18T00:36:41.259 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1060: wait_for_quorum: date +%s 2026-02-18T00:36:41.260 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1060: wait_for_quorum: [[ 1771375001 -lt 1771375052 ]] 2026-02-18T00:36:41.260 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1061: wait_for_quorum: jqfilter='.quorum | length == 4' 2026-02-18T00:36:41.261 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2026-02-18T00:36:41.373 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: jqinput=' 2026-02-18T00:36:41.373 INFO:tasks.workunit.client.0.trial069.stderr:{"election_epoch":8,"quorum":[0,1,2,3,4],"quorum_names":["a","b","c","d","e"],"quorum_leader_name":"a","quorum_age":11,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"a9d6a614-446b-449b-9b9f-370c60593bc7","modified":"2026-02-18T00:36:23.427919Z","created":"2026-02-18T00:36:23.427919Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-18T00:36:41.373 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: jq '.quorum | length == 4' 2026-02-18T00:36:41.374 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: echo '{"election_epoch":8,"quorum":[0,1,2,3,4],"quorum_names":["a","b","c","d","e"],"quorum_leader_name":"a","quorum_age":11,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"a9d6a614-446b-449b-9b9f-370c60593bc7","modified":"2026-02-18T00:36:23.427919Z","created":"2026-02-18T00:36:23.427919Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-18T00:36:41.383 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: res=false 2026-02-18T00:36:41.383 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: wait_for_quorum: [[ false == \t\r\u\e ]] 2026-02-18T00:36:41.383 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1060: wait_for_quorum: date +%s 2026-02-18T00:36:41.384 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1060: wait_for_quorum: [[ 1771375001 -lt 1771375052 ]] 2026-02-18T00:36:41.384 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1061: wait_for_quorum: jqfilter='.quorum | length == 4' 2026-02-18T00:36:41.385 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2026-02-18T00:36:41.493 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: jqinput=' 2026-02-18T00:36:41.494 INFO:tasks.workunit.client.0.trial069.stderr:{"election_epoch":8,"quorum":[0,1,2,3,4],"quorum_names":["a","b","c","d","e"],"quorum_leader_name":"a","quorum_age":11,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"a9d6a614-446b-449b-9b9f-370c60593bc7","modified":"2026-02-18T00:36:23.427919Z","created":"2026-02-18T00:36:23.427919Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-18T00:36:41.494 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: jq '.quorum | length == 4' 2026-02-18T00:36:41.495 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: echo '{"election_epoch":8,"quorum":[0,1,2,3,4],"quorum_names":["a","b","c","d","e"],"quorum_leader_name":"a","quorum_age":11,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"a9d6a614-446b-449b-9b9f-370c60593bc7","modified":"2026-02-18T00:36:23.427919Z","created":"2026-02-18T00:36:23.427919Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-18T00:36:41.504 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: res=false 2026-02-18T00:36:41.504 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: wait_for_quorum: [[ false == \t\r\u\e ]] 2026-02-18T00:36:41.504 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1060: wait_for_quorum: date +%s 2026-02-18T00:36:41.505 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1060: wait_for_quorum: [[ 1771375001 -lt 1771375052 ]] 2026-02-18T00:36:41.505 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1061: wait_for_quorum: jqfilter='.quorum | length == 4' 2026-02-18T00:36:41.506 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2026-02-18T00:36:41.620 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: jqinput=' 2026-02-18T00:36:41.620 INFO:tasks.workunit.client.0.trial069.stderr:{"election_epoch":8,"quorum":[0,1,2,3,4],"quorum_names":["a","b","c","d","e"],"quorum_leader_name":"a","quorum_age":11,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"a9d6a614-446b-449b-9b9f-370c60593bc7","modified":"2026-02-18T00:36:23.427919Z","created":"2026-02-18T00:36:23.427919Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-18T00:36:41.621 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: echo '{"election_epoch":8,"quorum":[0,1,2,3,4],"quorum_names":["a","b","c","d","e"],"quorum_leader_name":"a","quorum_age":11,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"a9d6a614-446b-449b-9b9f-370c60593bc7","modified":"2026-02-18T00:36:23.427919Z","created":"2026-02-18T00:36:23.427919Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-18T00:36:41.621 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: jq '.quorum | length == 4' 2026-02-18T00:36:41.631 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: res=false 2026-02-18T00:36:41.631 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: wait_for_quorum: [[ false == \t\r\u\e ]] 2026-02-18T00:36:41.631 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1060: wait_for_quorum: date +%s 2026-02-18T00:36:41.633 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1060: wait_for_quorum: [[ 1771375001 -lt 1771375052 ]] 2026-02-18T00:36:41.633 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1061: wait_for_quorum: jqfilter='.quorum | length == 4' 2026-02-18T00:36:41.633 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2026-02-18T00:36:41.746 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: jqinput=' 2026-02-18T00:36:41.747 INFO:tasks.workunit.client.0.trial069.stderr:{"election_epoch":8,"quorum":[0,1,2,3,4],"quorum_names":["a","b","c","d","e"],"quorum_leader_name":"a","quorum_age":11,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"a9d6a614-446b-449b-9b9f-370c60593bc7","modified":"2026-02-18T00:36:23.427919Z","created":"2026-02-18T00:36:23.427919Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-18T00:36:41.747 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: jq '.quorum | length == 4' 2026-02-18T00:36:41.747 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: echo '{"election_epoch":8,"quorum":[0,1,2,3,4],"quorum_names":["a","b","c","d","e"],"quorum_leader_name":"a","quorum_age":11,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"a9d6a614-446b-449b-9b9f-370c60593bc7","modified":"2026-02-18T00:36:23.427919Z","created":"2026-02-18T00:36:23.427919Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-18T00:36:41.758 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: res=false 2026-02-18T00:36:41.758 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: wait_for_quorum: [[ false == \t\r\u\e ]] 2026-02-18T00:36:41.758 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1060: wait_for_quorum: date +%s 2026-02-18T00:36:41.759 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1060: wait_for_quorum: [[ 1771375001 -lt 1771375052 ]] 2026-02-18T00:36:41.759 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1061: wait_for_quorum: jqfilter='.quorum | length == 4' 2026-02-18T00:36:41.760 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2026-02-18T00:36:41.872 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: jqinput=' 2026-02-18T00:36:41.872 INFO:tasks.workunit.client.0.trial069.stderr:{"election_epoch":8,"quorum":[0,1,2,3,4],"quorum_names":["a","b","c","d","e"],"quorum_leader_name":"a","quorum_age":11,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"a9d6a614-446b-449b-9b9f-370c60593bc7","modified":"2026-02-18T00:36:23.427919Z","created":"2026-02-18T00:36:23.427919Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-18T00:36:41.873 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: echo '{"election_epoch":8,"quorum":[0,1,2,3,4],"quorum_names":["a","b","c","d","e"],"quorum_leader_name":"a","quorum_age":11,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"a9d6a614-446b-449b-9b9f-370c60593bc7","modified":"2026-02-18T00:36:23.427919Z","created":"2026-02-18T00:36:23.427919Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-18T00:36:41.873 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: jq '.quorum | length == 4' 2026-02-18T00:36:41.883 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: res=false 2026-02-18T00:36:41.883 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: wait_for_quorum: [[ false == \t\r\u\e ]] 2026-02-18T00:36:41.884 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1060: wait_for_quorum: date +%s 2026-02-18T00:36:41.884 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1060: wait_for_quorum: [[ 1771375001 -lt 1771375052 ]] 2026-02-18T00:36:41.885 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1061: wait_for_quorum: jqfilter='.quorum | length == 4' 2026-02-18T00:36:41.885 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2026-02-18T00:36:42.000 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: jqinput=' 2026-02-18T00:36:42.001 INFO:tasks.workunit.client.0.trial069.stderr:{"election_epoch":8,"quorum":[0,1,2,3,4],"quorum_names":["a","b","c","d","e"],"quorum_leader_name":"a","quorum_age":12,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"a9d6a614-446b-449b-9b9f-370c60593bc7","modified":"2026-02-18T00:36:23.427919Z","created":"2026-02-18T00:36:23.427919Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-18T00:36:42.001 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: jq '.quorum | length == 4' 2026-02-18T00:36:42.002 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: echo '{"election_epoch":8,"quorum":[0,1,2,3,4],"quorum_names":["a","b","c","d","e"],"quorum_leader_name":"a","quorum_age":12,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"a9d6a614-446b-449b-9b9f-370c60593bc7","modified":"2026-02-18T00:36:23.427919Z","created":"2026-02-18T00:36:23.427919Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-18T00:36:42.011 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: res=false 2026-02-18T00:36:42.011 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: wait_for_quorum: [[ false == \t\r\u\e ]] 2026-02-18T00:36:42.011 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1060: wait_for_quorum: date +%s 2026-02-18T00:36:42.012 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1060: wait_for_quorum: [[ 1771375002 -lt 1771375052 ]] 2026-02-18T00:36:42.013 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1061: wait_for_quorum: jqfilter='.quorum | length == 4' 2026-02-18T00:36:42.013 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2026-02-18T00:36:47.136 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: jqinput=' 2026-02-18T00:36:47.136 INFO:tasks.workunit.client.0.trial069.stderr:{"election_epoch":10,"quorum":[1,2,3,4],"quorum_names":["b","c","d","e"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"a9d6a614-446b-449b-9b9f-370c60593bc7","modified":"2026-02-18T00:36:23.427919Z","created":"2026-02-18T00:36:23.427919Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-18T00:36:47.136 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: jq '.quorum | length == 4' 2026-02-18T00:36:47.137 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: echo '{"election_epoch":10,"quorum":[1,2,3,4],"quorum_names":["b","c","d","e"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"a9d6a614-446b-449b-9b9f-370c60593bc7","modified":"2026-02-18T00:36:23.427919Z","created":"2026-02-18T00:36:23.427919Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-18T00:36:47.147 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: res=true 2026-02-18T00:36:47.147 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: wait_for_quorum: [[ true == \t\r\u\e ]] 2026-02-18T00:36:47.147 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: wait_for_quorum: no_quorum=0 2026-02-18T00:36:47.147 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1066: wait_for_quorum: break 2026-02-18T00:36:47.147 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1069: wait_for_quorum: return 0 2026-02-18T00:36:47.147 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:175: TEST_5_mons_checks: ceph mon ok-to-stop a 2026-02-18T00:36:50.273 INFO:tasks.workunit.client.0.trial069.stderr:quorum should be preserved (b,c,d,e) after stopping a 2026-02-18T00:36:50.281 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:176: TEST_5_mons_checks: ceph mon ok-to-stop b 2026-02-18T00:36:50.387 INFO:tasks.workunit.client.0.trial069.stderr:quorum should be preserved (c,d,e) after stopping b 2026-02-18T00:36:50.395 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:177: TEST_5_mons_checks: ceph mon ok-to-stop c 2026-02-18T00:36:50.499 INFO:tasks.workunit.client.0.trial069.stderr:quorum should be preserved (b,d,e) after stopping c 2026-02-18T00:36:50.506 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:178: TEST_5_mons_checks: ceph mon ok-to-stop d 2026-02-18T00:36:50.625 INFO:tasks.workunit.client.0.trial069.stderr:quorum should be preserved (b,c,e) after stopping d 2026-02-18T00:36:50.635 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:179: TEST_5_mons_checks: ceph mon ok-to-stop e 2026-02-18T00:36:50.738 INFO:tasks.workunit.client.0.trial069.stderr:quorum should be preserved (b,c,d) after stopping e 2026-02-18T00:36:50.748 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:181: TEST_5_mons_checks: ceph mon ok-to-add-offline 2026-02-18T00:36:53.856 INFO:tasks.workunit.client.0.trial069.stderr:adding another mon that is not yet online will not break quorum 2026-02-18T00:36:53.865 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:183: TEST_5_mons_checks: ceph mon ok-to-rm a 2026-02-18T00:36:53.970 INFO:tasks.workunit.client.0.trial069.stderr:safe to remove mon.a 2026-02-18T00:36:53.980 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:184: TEST_5_mons_checks: ceph mon ok-to-rm b 2026-02-18T00:36:54.084 INFO:tasks.workunit.client.0.trial069.stderr:safe to remove mon.b 2026-02-18T00:36:54.094 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:185: TEST_5_mons_checks: ceph mon ok-to-rm c 2026-02-18T00:36:54.199 INFO:tasks.workunit.client.0.trial069.stderr:safe to remove mon.c 2026-02-18T00:36:54.207 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:186: TEST_5_mons_checks: ceph mon ok-to-rm d 2026-02-18T00:36:54.326 INFO:tasks.workunit.client.0.trial069.stderr:safe to remove mon.d 2026-02-18T00:36:54.334 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:187: TEST_5_mons_checks: ceph mon ok-to-rm e 2026-02-18T00:36:57.457 INFO:tasks.workunit.client.0.trial069.stderr:safe to remove mon.e 2026-02-18T00:36:57.465 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:189: TEST_5_mons_checks: kill_daemons td/ok-to-stop KILL mon.e 2026-02-18T00:36:57.466 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:36:57.466 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:36:57.466 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:36:57.466 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:36:57.466 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:36:57.573 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:36:57.574 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:190: TEST_5_mons_checks: wait_for_quorum 60 3 2026-02-18T00:36:57.574 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1046: wait_for_quorum: local timeout=60 2026-02-18T00:36:57.574 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1047: wait_for_quorum: local quorumsize=3 2026-02-18T00:36:57.574 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1049: wait_for_quorum: [[ -z 60 ]] 2026-02-18T00:36:57.574 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1053: wait_for_quorum: [[ -z 3 ]] 2026-02-18T00:36:57.574 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1058: wait_for_quorum: no_quorum=1 2026-02-18T00:36:57.574 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1059: wait_for_quorum: date +%s 2026-02-18T00:36:57.575 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1059: wait_for_quorum: wait_until=1771375077 2026-02-18T00:36:57.575 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1060: wait_for_quorum: date +%s 2026-02-18T00:36:57.576 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1060: wait_for_quorum: [[ 1771375017 -lt 1771375077 ]] 2026-02-18T00:36:57.576 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1061: wait_for_quorum: jqfilter='.quorum | length == 3' 2026-02-18T00:36:57.576 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2026-02-18T00:36:57.684 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: jqinput=' 2026-02-18T00:36:57.684 INFO:tasks.workunit.client.0.trial069.stderr:{"election_epoch":10,"quorum":[1,2,3,4],"quorum_names":["b","c","d","e"],"quorum_leader_name":"b","quorum_age":10,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"a9d6a614-446b-449b-9b9f-370c60593bc7","modified":"2026-02-18T00:36:23.427919Z","created":"2026-02-18T00:36:23.427919Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-18T00:36:57.685 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: jq '.quorum | length == 3' 2026-02-18T00:36:57.685 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: echo '{"election_epoch":10,"quorum":[1,2,3,4],"quorum_names":["b","c","d","e"],"quorum_leader_name":"b","quorum_age":10,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"a9d6a614-446b-449b-9b9f-370c60593bc7","modified":"2026-02-18T00:36:23.427919Z","created":"2026-02-18T00:36:23.427919Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-18T00:36:57.695 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: res=false 2026-02-18T00:36:57.695 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: wait_for_quorum: [[ false == \t\r\u\e ]] 2026-02-18T00:36:57.696 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1060: wait_for_quorum: date +%s 2026-02-18T00:36:57.696 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1060: wait_for_quorum: [[ 1771375017 -lt 1771375077 ]] 2026-02-18T00:36:57.697 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1061: wait_for_quorum: jqfilter='.quorum | length == 3' 2026-02-18T00:36:57.697 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2026-02-18T00:36:57.811 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: jqinput=' 2026-02-18T00:36:57.811 INFO:tasks.workunit.client.0.trial069.stderr:{"election_epoch":10,"quorum":[1,2,3,4],"quorum_names":["b","c","d","e"],"quorum_leader_name":"b","quorum_age":10,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"a9d6a614-446b-449b-9b9f-370c60593bc7","modified":"2026-02-18T00:36:23.427919Z","created":"2026-02-18T00:36:23.427919Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-18T00:36:57.812 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: jq '.quorum | length == 3' 2026-02-18T00:36:57.812 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: echo '{"election_epoch":10,"quorum":[1,2,3,4],"quorum_names":["b","c","d","e"],"quorum_leader_name":"b","quorum_age":10,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"a9d6a614-446b-449b-9b9f-370c60593bc7","modified":"2026-02-18T00:36:23.427919Z","created":"2026-02-18T00:36:23.427919Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-18T00:36:57.823 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: res=false 2026-02-18T00:36:57.823 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: wait_for_quorum: [[ false == \t\r\u\e ]] 2026-02-18T00:36:57.823 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1060: wait_for_quorum: date +%s 2026-02-18T00:36:57.824 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1060: wait_for_quorum: [[ 1771375017 -lt 1771375077 ]] 2026-02-18T00:36:57.824 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1061: wait_for_quorum: jqfilter='.quorum | length == 3' 2026-02-18T00:36:57.824 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2026-02-18T00:36:57.940 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: jqinput=' 2026-02-18T00:36:57.940 INFO:tasks.workunit.client.0.trial069.stderr:{"election_epoch":10,"quorum":[1,2,3,4],"quorum_names":["b","c","d","e"],"quorum_leader_name":"b","quorum_age":10,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"a9d6a614-446b-449b-9b9f-370c60593bc7","modified":"2026-02-18T00:36:23.427919Z","created":"2026-02-18T00:36:23.427919Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-18T00:36:57.941 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: echo '{"election_epoch":10,"quorum":[1,2,3,4],"quorum_names":["b","c","d","e"],"quorum_leader_name":"b","quorum_age":10,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"a9d6a614-446b-449b-9b9f-370c60593bc7","modified":"2026-02-18T00:36:23.427919Z","created":"2026-02-18T00:36:23.427919Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-18T00:36:57.941 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: jq '.quorum | length == 3' 2026-02-18T00:36:57.950 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: res=false 2026-02-18T00:36:57.950 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: wait_for_quorum: [[ false == \t\r\u\e ]] 2026-02-18T00:36:57.951 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1060: wait_for_quorum: date +%s 2026-02-18T00:36:57.952 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1060: wait_for_quorum: [[ 1771375017 -lt 1771375077 ]] 2026-02-18T00:36:57.952 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1061: wait_for_quorum: jqfilter='.quorum | length == 3' 2026-02-18T00:36:57.952 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2026-02-18T00:36:58.061 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: jqinput=' 2026-02-18T00:36:58.061 INFO:tasks.workunit.client.0.trial069.stderr:{"election_epoch":10,"quorum":[1,2,3,4],"quorum_names":["b","c","d","e"],"quorum_leader_name":"b","quorum_age":10,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"a9d6a614-446b-449b-9b9f-370c60593bc7","modified":"2026-02-18T00:36:23.427919Z","created":"2026-02-18T00:36:23.427919Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-18T00:36:58.061 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: jq '.quorum | length == 3' 2026-02-18T00:36:58.061 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: echo '{"election_epoch":10,"quorum":[1,2,3,4],"quorum_names":["b","c","d","e"],"quorum_leader_name":"b","quorum_age":10,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"a9d6a614-446b-449b-9b9f-370c60593bc7","modified":"2026-02-18T00:36:23.427919Z","created":"2026-02-18T00:36:23.427919Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-18T00:36:58.071 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: res=false 2026-02-18T00:36:58.071 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: wait_for_quorum: [[ false == \t\r\u\e ]] 2026-02-18T00:36:58.072 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1060: wait_for_quorum: date +%s 2026-02-18T00:36:58.073 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1060: wait_for_quorum: [[ 1771375018 -lt 1771375077 ]] 2026-02-18T00:36:58.073 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1061: wait_for_quorum: jqfilter='.quorum | length == 3' 2026-02-18T00:36:58.073 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2026-02-18T00:36:58.187 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: jqinput=' 2026-02-18T00:36:58.188 INFO:tasks.workunit.client.0.trial069.stderr:{"election_epoch":10,"quorum":[1,2,3,4],"quorum_names":["b","c","d","e"],"quorum_leader_name":"b","quorum_age":11,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"a9d6a614-446b-449b-9b9f-370c60593bc7","modified":"2026-02-18T00:36:23.427919Z","created":"2026-02-18T00:36:23.427919Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-18T00:36:58.188 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: jq '.quorum | length == 3' 2026-02-18T00:36:58.188 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: echo '{"election_epoch":10,"quorum":[1,2,3,4],"quorum_names":["b","c","d","e"],"quorum_leader_name":"b","quorum_age":11,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"a9d6a614-446b-449b-9b9f-370c60593bc7","modified":"2026-02-18T00:36:23.427919Z","created":"2026-02-18T00:36:23.427919Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-18T00:36:58.198 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: res=false 2026-02-18T00:36:58.198 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: wait_for_quorum: [[ false == \t\r\u\e ]] 2026-02-18T00:36:58.199 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1060: wait_for_quorum: date +%s 2026-02-18T00:36:58.200 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1060: wait_for_quorum: [[ 1771375018 -lt 1771375077 ]] 2026-02-18T00:36:58.200 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1061: wait_for_quorum: jqfilter='.quorum | length == 3' 2026-02-18T00:36:58.200 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2026-02-18T00:36:58.311 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: jqinput=' 2026-02-18T00:36:58.311 INFO:tasks.workunit.client.0.trial069.stderr:{"election_epoch":10,"quorum":[1,2,3,4],"quorum_names":["b","c","d","e"],"quorum_leader_name":"b","quorum_age":11,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"a9d6a614-446b-449b-9b9f-370c60593bc7","modified":"2026-02-18T00:36:23.427919Z","created":"2026-02-18T00:36:23.427919Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-18T00:36:58.312 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: jq '.quorum | length == 3' 2026-02-18T00:36:58.312 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: echo '{"election_epoch":10,"quorum":[1,2,3,4],"quorum_names":["b","c","d","e"],"quorum_leader_name":"b","quorum_age":11,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"a9d6a614-446b-449b-9b9f-370c60593bc7","modified":"2026-02-18T00:36:23.427919Z","created":"2026-02-18T00:36:23.427919Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-18T00:36:58.322 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: res=false 2026-02-18T00:36:58.323 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: wait_for_quorum: [[ false == \t\r\u\e ]] 2026-02-18T00:36:58.323 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1060: wait_for_quorum: date +%s 2026-02-18T00:36:58.324 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1060: wait_for_quorum: [[ 1771375018 -lt 1771375077 ]] 2026-02-18T00:36:58.324 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1061: wait_for_quorum: jqfilter='.quorum | length == 3' 2026-02-18T00:36:58.324 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2026-02-18T00:37:01.442 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: jqinput=' 2026-02-18T00:37:01.442 INFO:tasks.workunit.client.0.trial069.stderr:{"election_epoch":10,"quorum":[1,2,3,4],"quorum_names":["b","c","d","e"],"quorum_leader_name":"b","quorum_age":14,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"a9d6a614-446b-449b-9b9f-370c60593bc7","modified":"2026-02-18T00:36:23.427919Z","created":"2026-02-18T00:36:23.427919Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-18T00:37:01.442 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: jq '.quorum | length == 3' 2026-02-18T00:37:01.442 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: echo '{"election_epoch":10,"quorum":[1,2,3,4],"quorum_names":["b","c","d","e"],"quorum_leader_name":"b","quorum_age":14,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"a9d6a614-446b-449b-9b9f-370c60593bc7","modified":"2026-02-18T00:36:23.427919Z","created":"2026-02-18T00:36:23.427919Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-18T00:37:01.451 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: res=false 2026-02-18T00:37:01.452 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: wait_for_quorum: [[ false == \t\r\u\e ]] 2026-02-18T00:37:01.452 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1060: wait_for_quorum: date +%s 2026-02-18T00:37:01.453 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1060: wait_for_quorum: [[ 1771375021 -lt 1771375077 ]] 2026-02-18T00:37:01.453 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1061: wait_for_quorum: jqfilter='.quorum | length == 3' 2026-02-18T00:37:01.453 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2026-02-18T00:37:01.564 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: jqinput=' 2026-02-18T00:37:01.564 INFO:tasks.workunit.client.0.trial069.stderr:{"election_epoch":10,"quorum":[1,2,3,4],"quorum_names":["b","c","d","e"],"quorum_leader_name":"b","quorum_age":14,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"a9d6a614-446b-449b-9b9f-370c60593bc7","modified":"2026-02-18T00:36:23.427919Z","created":"2026-02-18T00:36:23.427919Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-18T00:37:01.565 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: jq '.quorum | length == 3' 2026-02-18T00:37:01.565 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: echo '{"election_epoch":10,"quorum":[1,2,3,4],"quorum_names":["b","c","d","e"],"quorum_leader_name":"b","quorum_age":14,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"a9d6a614-446b-449b-9b9f-370c60593bc7","modified":"2026-02-18T00:36:23.427919Z","created":"2026-02-18T00:36:23.427919Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-18T00:37:01.575 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: res=false 2026-02-18T00:37:01.575 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: wait_for_quorum: [[ false == \t\r\u\e ]] 2026-02-18T00:37:01.575 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1060: wait_for_quorum: date +%s 2026-02-18T00:37:01.576 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1060: wait_for_quorum: [[ 1771375021 -lt 1771375077 ]] 2026-02-18T00:37:01.576 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1061: wait_for_quorum: jqfilter='.quorum | length == 3' 2026-02-18T00:37:01.576 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2026-02-18T00:37:01.689 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: jqinput=' 2026-02-18T00:37:01.689 INFO:tasks.workunit.client.0.trial069.stderr:{"election_epoch":10,"quorum":[1,2,3,4],"quorum_names":["b","c","d","e"],"quorum_leader_name":"b","quorum_age":14,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"a9d6a614-446b-449b-9b9f-370c60593bc7","modified":"2026-02-18T00:36:23.427919Z","created":"2026-02-18T00:36:23.427919Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-18T00:37:01.689 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: jq '.quorum | length == 3' 2026-02-18T00:37:01.689 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: echo '{"election_epoch":10,"quorum":[1,2,3,4],"quorum_names":["b","c","d","e"],"quorum_leader_name":"b","quorum_age":14,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"a9d6a614-446b-449b-9b9f-370c60593bc7","modified":"2026-02-18T00:36:23.427919Z","created":"2026-02-18T00:36:23.427919Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-18T00:37:01.699 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: res=false 2026-02-18T00:37:01.699 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: wait_for_quorum: [[ false == \t\r\u\e ]] 2026-02-18T00:37:01.699 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1060: wait_for_quorum: date +%s 2026-02-18T00:37:01.701 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1060: wait_for_quorum: [[ 1771375021 -lt 1771375077 ]] 2026-02-18T00:37:01.701 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1061: wait_for_quorum: jqfilter='.quorum | length == 3' 2026-02-18T00:37:01.701 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2026-02-18T00:37:01.810 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: jqinput=' 2026-02-18T00:37:01.810 INFO:tasks.workunit.client.0.trial069.stderr:{"election_epoch":10,"quorum":[1,2,3,4],"quorum_names":["b","c","d","e"],"quorum_leader_name":"b","quorum_age":14,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"a9d6a614-446b-449b-9b9f-370c60593bc7","modified":"2026-02-18T00:36:23.427919Z","created":"2026-02-18T00:36:23.427919Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-18T00:37:01.811 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: jq '.quorum | length == 3' 2026-02-18T00:37:01.811 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: echo '{"election_epoch":10,"quorum":[1,2,3,4],"quorum_names":["b","c","d","e"],"quorum_leader_name":"b","quorum_age":14,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"a9d6a614-446b-449b-9b9f-370c60593bc7","modified":"2026-02-18T00:36:23.427919Z","created":"2026-02-18T00:36:23.427919Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-18T00:37:01.819 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: res=false 2026-02-18T00:37:01.820 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: wait_for_quorum: [[ false == \t\r\u\e ]] 2026-02-18T00:37:01.820 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1060: wait_for_quorum: date +%s 2026-02-18T00:37:01.821 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1060: wait_for_quorum: [[ 1771375021 -lt 1771375077 ]] 2026-02-18T00:37:01.822 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1061: wait_for_quorum: jqfilter='.quorum | length == 3' 2026-02-18T00:37:01.822 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2026-02-18T00:37:01.934 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: jqinput=' 2026-02-18T00:37:01.934 INFO:tasks.workunit.client.0.trial069.stderr:{"election_epoch":10,"quorum":[1,2,3,4],"quorum_names":["b","c","d","e"],"quorum_leader_name":"b","quorum_age":14,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"a9d6a614-446b-449b-9b9f-370c60593bc7","modified":"2026-02-18T00:36:23.427919Z","created":"2026-02-18T00:36:23.427919Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-18T00:37:01.935 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: jq '.quorum | length == 3' 2026-02-18T00:37:01.935 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: echo '{"election_epoch":10,"quorum":[1,2,3,4],"quorum_names":["b","c","d","e"],"quorum_leader_name":"b","quorum_age":14,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"a9d6a614-446b-449b-9b9f-370c60593bc7","modified":"2026-02-18T00:36:23.427919Z","created":"2026-02-18T00:36:23.427919Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-18T00:37:01.944 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: res=false 2026-02-18T00:37:01.944 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: wait_for_quorum: [[ false == \t\r\u\e ]] 2026-02-18T00:37:01.944 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1060: wait_for_quorum: date +%s 2026-02-18T00:37:01.945 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1060: wait_for_quorum: [[ 1771375021 -lt 1771375077 ]] 2026-02-18T00:37:01.945 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1061: wait_for_quorum: jqfilter='.quorum | length == 3' 2026-02-18T00:37:01.946 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2026-02-18T00:37:02.062 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: jqinput=' 2026-02-18T00:37:02.062 INFO:tasks.workunit.client.0.trial069.stderr:{"election_epoch":10,"quorum":[1,2,3,4],"quorum_names":["b","c","d","e"],"quorum_leader_name":"b","quorum_age":14,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"a9d6a614-446b-449b-9b9f-370c60593bc7","modified":"2026-02-18T00:36:23.427919Z","created":"2026-02-18T00:36:23.427919Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-18T00:37:02.063 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: echo '{"election_epoch":10,"quorum":[1,2,3,4],"quorum_names":["b","c","d","e"],"quorum_leader_name":"b","quorum_age":14,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"a9d6a614-446b-449b-9b9f-370c60593bc7","modified":"2026-02-18T00:36:23.427919Z","created":"2026-02-18T00:36:23.427919Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-18T00:37:02.063 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: jq '.quorum | length == 3' 2026-02-18T00:37:02.072 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: res=false 2026-02-18T00:37:02.072 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: wait_for_quorum: [[ false == \t\r\u\e ]] 2026-02-18T00:37:02.072 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1060: wait_for_quorum: date +%s 2026-02-18T00:37:02.073 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1060: wait_for_quorum: [[ 1771375022 -lt 1771375077 ]] 2026-02-18T00:37:02.073 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1061: wait_for_quorum: jqfilter='.quorum | length == 3' 2026-02-18T00:37:02.074 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2026-02-18T00:37:02.183 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: jqinput=' 2026-02-18T00:37:02.184 INFO:tasks.workunit.client.0.trial069.stderr:{"election_epoch":10,"quorum":[1,2,3,4],"quorum_names":["b","c","d","e"],"quorum_leader_name":"b","quorum_age":15,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"a9d6a614-446b-449b-9b9f-370c60593bc7","modified":"2026-02-18T00:36:23.427919Z","created":"2026-02-18T00:36:23.427919Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-18T00:37:02.184 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: jq '.quorum | length == 3' 2026-02-18T00:37:02.184 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: echo '{"election_epoch":10,"quorum":[1,2,3,4],"quorum_names":["b","c","d","e"],"quorum_leader_name":"b","quorum_age":15,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"a9d6a614-446b-449b-9b9f-370c60593bc7","modified":"2026-02-18T00:36:23.427919Z","created":"2026-02-18T00:36:23.427919Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-18T00:37:02.194 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: res=false 2026-02-18T00:37:02.195 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: wait_for_quorum: [[ false == \t\r\u\e ]] 2026-02-18T00:37:02.195 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1060: wait_for_quorum: date +%s 2026-02-18T00:37:02.196 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1060: wait_for_quorum: [[ 1771375022 -lt 1771375077 ]] 2026-02-18T00:37:02.196 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1061: wait_for_quorum: jqfilter='.quorum | length == 3' 2026-02-18T00:37:02.196 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2026-02-18T00:37:05.314 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: jqinput=' 2026-02-18T00:37:05.314 INFO:tasks.workunit.client.0.trial069.stderr:{"election_epoch":10,"quorum":[1,2,3,4],"quorum_names":["b","c","d","e"],"quorum_leader_name":"b","quorum_age":18,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"a9d6a614-446b-449b-9b9f-370c60593bc7","modified":"2026-02-18T00:36:23.427919Z","created":"2026-02-18T00:36:23.427919Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-18T00:37:05.315 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: echo '{"election_epoch":10,"quorum":[1,2,3,4],"quorum_names":["b","c","d","e"],"quorum_leader_name":"b","quorum_age":18,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"a9d6a614-446b-449b-9b9f-370c60593bc7","modified":"2026-02-18T00:36:23.427919Z","created":"2026-02-18T00:36:23.427919Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-18T00:37:05.315 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: jq '.quorum | length == 3' 2026-02-18T00:37:05.323 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: res=false 2026-02-18T00:37:05.324 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: wait_for_quorum: [[ false == \t\r\u\e ]] 2026-02-18T00:37:05.324 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1060: wait_for_quorum: date +%s 2026-02-18T00:37:05.325 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1060: wait_for_quorum: [[ 1771375025 -lt 1771375077 ]] 2026-02-18T00:37:05.325 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1061: wait_for_quorum: jqfilter='.quorum | length == 3' 2026-02-18T00:37:05.325 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2026-02-18T00:37:05.440 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: jqinput=' 2026-02-18T00:37:05.440 INFO:tasks.workunit.client.0.trial069.stderr:{"election_epoch":10,"quorum":[1,2,3,4],"quorum_names":["b","c","d","e"],"quorum_leader_name":"b","quorum_age":18,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"a9d6a614-446b-449b-9b9f-370c60593bc7","modified":"2026-02-18T00:36:23.427919Z","created":"2026-02-18T00:36:23.427919Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-18T00:37:05.441 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: echo '{"election_epoch":10,"quorum":[1,2,3,4],"quorum_names":["b","c","d","e"],"quorum_leader_name":"b","quorum_age":18,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"a9d6a614-446b-449b-9b9f-370c60593bc7","modified":"2026-02-18T00:36:23.427919Z","created":"2026-02-18T00:36:23.427919Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-18T00:37:05.441 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: jq '.quorum | length == 3' 2026-02-18T00:37:05.451 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: res=false 2026-02-18T00:37:05.451 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: wait_for_quorum: [[ false == \t\r\u\e ]] 2026-02-18T00:37:05.452 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1060: wait_for_quorum: date +%s 2026-02-18T00:37:05.452 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1060: wait_for_quorum: [[ 1771375025 -lt 1771375077 ]] 2026-02-18T00:37:05.452 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1061: wait_for_quorum: jqfilter='.quorum | length == 3' 2026-02-18T00:37:05.453 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2026-02-18T00:37:05.566 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: jqinput=' 2026-02-18T00:37:05.566 INFO:tasks.workunit.client.0.trial069.stderr:{"election_epoch":10,"quorum":[1,2,3,4],"quorum_names":["b","c","d","e"],"quorum_leader_name":"b","quorum_age":18,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"a9d6a614-446b-449b-9b9f-370c60593bc7","modified":"2026-02-18T00:36:23.427919Z","created":"2026-02-18T00:36:23.427919Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-18T00:37:05.567 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: jq '.quorum | length == 3' 2026-02-18T00:37:05.567 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: echo '{"election_epoch":10,"quorum":[1,2,3,4],"quorum_names":["b","c","d","e"],"quorum_leader_name":"b","quorum_age":18,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"a9d6a614-446b-449b-9b9f-370c60593bc7","modified":"2026-02-18T00:36:23.427919Z","created":"2026-02-18T00:36:23.427919Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-18T00:37:05.576 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: res=false 2026-02-18T00:37:05.576 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: wait_for_quorum: [[ false == \t\r\u\e ]] 2026-02-18T00:37:05.576 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1060: wait_for_quorum: date +%s 2026-02-18T00:37:05.577 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1060: wait_for_quorum: [[ 1771375025 -lt 1771375077 ]] 2026-02-18T00:37:05.577 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1061: wait_for_quorum: jqfilter='.quorum | length == 3' 2026-02-18T00:37:05.578 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2026-02-18T00:37:05.693 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: jqinput=' 2026-02-18T00:37:05.693 INFO:tasks.workunit.client.0.trial069.stderr:{"election_epoch":10,"quorum":[1,2,3,4],"quorum_names":["b","c","d","e"],"quorum_leader_name":"b","quorum_age":18,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"a9d6a614-446b-449b-9b9f-370c60593bc7","modified":"2026-02-18T00:36:23.427919Z","created":"2026-02-18T00:36:23.427919Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-18T00:37:05.694 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: echo '{"election_epoch":10,"quorum":[1,2,3,4],"quorum_names":["b","c","d","e"],"quorum_leader_name":"b","quorum_age":18,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"a9d6a614-446b-449b-9b9f-370c60593bc7","modified":"2026-02-18T00:36:23.427919Z","created":"2026-02-18T00:36:23.427919Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-18T00:37:05.694 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: jq '.quorum | length == 3' 2026-02-18T00:37:05.703 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: res=false 2026-02-18T00:37:05.703 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: wait_for_quorum: [[ false == \t\r\u\e ]] 2026-02-18T00:37:05.703 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1060: wait_for_quorum: date +%s 2026-02-18T00:37:05.704 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1060: wait_for_quorum: [[ 1771375025 -lt 1771375077 ]] 2026-02-18T00:37:05.704 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1061: wait_for_quorum: jqfilter='.quorum | length == 3' 2026-02-18T00:37:05.705 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2026-02-18T00:37:13.233 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: jqinput=' 2026-02-18T00:37:13.233 INFO:tasks.workunit.client.0.trial069.stderr:{"election_epoch":14,"quorum":[1,2,3],"quorum_names":["b","c","d"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"a9d6a614-446b-449b-9b9f-370c60593bc7","modified":"2026-02-18T00:36:23.427919Z","created":"2026-02-18T00:36:23.427919Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-18T00:37:13.234 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: echo '{"election_epoch":14,"quorum":[1,2,3],"quorum_names":["b","c","d"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"a9d6a614-446b-449b-9b9f-370c60593bc7","modified":"2026-02-18T00:36:23.427919Z","created":"2026-02-18T00:36:23.427919Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-18T00:37:13.234 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: jq '.quorum | length == 3' 2026-02-18T00:37:13.244 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: res=true 2026-02-18T00:37:13.244 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: wait_for_quorum: [[ true == \t\r\u\e ]] 2026-02-18T00:37:13.244 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: wait_for_quorum: no_quorum=0 2026-02-18T00:37:13.244 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1066: wait_for_quorum: break 2026-02-18T00:37:13.244 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1069: wait_for_quorum: return 0 2026-02-18T00:37:13.244 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:192: TEST_5_mons_checks: ceph mon ok-to-stop a 2026-02-18T00:37:13.350 INFO:tasks.workunit.client.0.trial069.stderr:quorum should be preserved (b,c,d) after stopping a 2026-02-18T00:37:13.358 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:193: TEST_5_mons_checks: ceph mon ok-to-stop b 2026-02-18T00:37:16.448 INFO:tasks.workunit.client.0.trial069.stderr:Error EBUSY: not enough monitors would be available (c,d) after stopping mons b 2026-02-18T00:37:16.450 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:194: TEST_5_mons_checks: ceph mon ok-to-stop c 2026-02-18T00:37:16.544 INFO:tasks.workunit.client.0.trial069.stderr:Error EBUSY: not enough monitors would be available (b,d) after stopping mons c 2026-02-18T00:37:16.547 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:195: TEST_5_mons_checks: ceph mon ok-to-stop d 2026-02-18T00:37:16.635 INFO:tasks.workunit.client.0.trial069.stderr:Error EBUSY: not enough monitors would be available (b,c) after stopping mons d 2026-02-18T00:37:16.637 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:196: TEST_5_mons_checks: ceph mon ok-to-stop e 2026-02-18T00:37:16.742 INFO:tasks.workunit.client.0.trial069.stderr:quorum should be preserved (b,c,d) after stopping e 2026-02-18T00:37:16.752 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:198: TEST_5_mons_checks: ceph mon ok-to-add-offline 2026-02-18T00:37:19.841 INFO:tasks.workunit.client.0.trial069.stderr:Error EBUSY: adding a monitor may break quorum (until that monitor starts) 2026-02-18T00:37:19.843 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:200: TEST_5_mons_checks: ceph mon ok-to-rm a 2026-02-18T00:37:19.954 INFO:tasks.workunit.client.0.trial069.stderr:safe to remove mon.a 2026-02-18T00:37:19.962 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:201: TEST_5_mons_checks: ceph mon ok-to-rm b 2026-02-18T00:37:20.060 INFO:tasks.workunit.client.0.trial069.stderr:Error EBUSY: removing mon.b would break quorum 2026-02-18T00:37:20.063 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:202: TEST_5_mons_checks: ceph mon ok-to-rm c 2026-02-18T00:37:26.150 INFO:tasks.workunit.client.0.trial069.stderr:Error EBUSY: removing mon.c would break quorum 2026-02-18T00:37:26.152 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:203: TEST_5_mons_checks: ceph mon ok-to-rm d 2026-02-18T00:37:26.242 INFO:tasks.workunit.client.0.trial069.stderr:Error EBUSY: removing mon.d would break quorum 2026-02-18T00:37:26.245 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:204: TEST_5_mons_checks: ceph mon ok-to-rm e 2026-02-18T00:37:26.362 INFO:tasks.workunit.client.0.trial069.stderr:safe to remove mon.e 2026-02-18T00:37:26.369 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:22: run: kill_daemons td/ok-to-stop KILL 2026-02-18T00:37:26.370 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:37:26.370 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:37:26.371 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:37:26.371 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:37:26.371 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:37:26.480 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:37:26.480 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:23: run: teardown td/ok-to-stop 2026-02-18T00:37:26.480 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/ok-to-stop 2026-02-18T00:37:26.480 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T00:37:26.480 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/ok-to-stop KILL 2026-02-18T00:37:26.480 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:37:26.480 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:37:26.481 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:37:26.481 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:37:26.481 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:37:26.486 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:37:26.486 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T00:37:26.487 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T00:37:26.488 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T00:37:26.489 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T00:37:26.489 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T00:37:26.489 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T00:37:26.490 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:37:26.490 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T00:37:26.491 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T00:37:26.491 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:37:26.492 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T00:37:26.493 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T00:37:26.493 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/ok-to-stop 2026-02-18T00:37:26.508 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T00:37:26.509 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:37:26.509 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.35978 2026-02-18T00:37:26.509 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.35978 2026-02-18T00:37:26.511 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T00:37:26.511 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T00:37:26.511 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2401: main: code=0 2026-02-18T00:37:26.511 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2405: main: teardown td/ok-to-stop 0 2026-02-18T00:37:26.511 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/ok-to-stop 2026-02-18T00:37:26.511 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs=0 2026-02-18T00:37:26.511 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/ok-to-stop KILL 2026-02-18T00:37:26.512 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:37:26.512 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:37:26.512 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:37:26.512 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:37:26.512 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:37:26.513 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:37:26.513 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T00:37:26.514 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T00:37:26.514 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T00:37:26.515 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T00:37:26.516 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T00:37:26.516 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T00:37:26.517 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:37:26.517 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T00:37:26.517 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T00:37:26.518 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:37:26.518 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T00:37:26.519 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o 0 = 1 ']' 2026-02-18T00:37:26.520 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/ok-to-stop 2026-02-18T00:37:26.521 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T00:37:26.521 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:37:26.521 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.35978 2026-02-18T00:37:26.521 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.35978 2026-02-18T00:37:26.523 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T00:37:26.524 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T00:37:26.524 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2406: main: return 0 2026-02-18T00:37:26.524 INFO:teuthology.orchestra.run:Running command with timeout 3600 2026-02-18T00:37:26.524 DEBUG:teuthology.orchestra.run.trial069:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2026-02-18T00:37:26.576 INFO:tasks.workunit:Running workunit misc/rados-striper.sh... 2026-02-18T00:37:26.577 DEBUG:teuthology.orchestra.run.trial069:workunit test misc/rados-striper.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=adc1923395f2bcd6ae89b5d331d278364d1848ed TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/rados-striper.sh 2026-02-18T00:37:26.629 INFO:tasks.workunit.client.0.trial069.stderr:stty: 'standard input': Inappropriate ioctl for device 2026-02-18T00:37:26.632 INFO:tasks.workunit.client.0.trial069.stderr:+ PS4='${BASH_SOURCE[0]}:$LINENO: ${FUNCNAME[0]}: ' 2026-02-18T00:37:26.633 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2394: main: export PATH=.:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2026-02-18T00:37:26.633 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2394: main: PATH=.:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2026-02-18T00:37:26.633 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2395: main: export PYTHONWARNINGS=ignore 2026-02-18T00:37:26.633 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2395: main: PYTHONWARNINGS=ignore 2026-02-18T00:37:26.633 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2396: main: export CEPH_CONF=/dev/null 2026-02-18T00:37:26.633 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2396: main: CEPH_CONF=/dev/null 2026-02-18T00:37:26.633 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2397: main: unset CEPH_ARGS 2026-02-18T00:37:26.633 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2399: main: local code 2026-02-18T00:37:26.633 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2400: main: run td/rados-striper 2026-02-18T00:37:26.633 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/rados-striper.sh:20: run: local dir=td/rados-striper 2026-02-18T00:37:26.634 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/rados-striper.sh:21: run: shift 2026-02-18T00:37:26.634 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/rados-striper.sh:23: run: export CEPH_MON=127.0.0.1:7116 2026-02-18T00:37:26.634 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/rados-striper.sh:23: run: CEPH_MON=127.0.0.1:7116 2026-02-18T00:37:26.634 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/rados-striper.sh:24: run: export CEPH_ARGS 2026-02-18T00:37:26.634 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/rados-striper.sh:25: run: uuidgen 2026-02-18T00:37:26.635 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/rados-striper.sh:25: run: CEPH_ARGS+='--fsid=fc0fa2d5-f29d-42a8-bd8c-754201984e53 --auth-supported=none ' 2026-02-18T00:37:26.636 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/rados-striper.sh:26: run: CEPH_ARGS+='--mon-host=127.0.0.1:7116 ' 2026-02-18T00:37:26.636 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/rados-striper.sh:29: run: setup td/rados-striper 2026-02-18T00:37:26.636 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/rados-striper 2026-02-18T00:37:26.636 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/rados-striper 2026-02-18T00:37:26.636 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/rados-striper 2026-02-18T00:37:26.636 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T00:37:26.636 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/rados-striper KILL 2026-02-18T00:37:26.636 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:37:26.636 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:37:26.636 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:37:26.636 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:37:26.637 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:37:26.637 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:37:26.637 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T00:37:26.638 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T00:37:26.638 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T00:37:26.639 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T00:37:26.639 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T00:37:26.639 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T00:37:26.640 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:37:26.640 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T00:37:26.641 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T00:37:26.641 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:37:26.642 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T00:37:26.643 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T00:37:26.643 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/rados-striper 2026-02-18T00:37:26.645 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T00:37:26.645 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:37:26.645 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.51893 2026-02-18T00:37:26.645 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.51893 2026-02-18T00:37:26.646 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T00:37:26.646 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T00:37:26.646 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/rados-striper 2026-02-18T00:37:26.648 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-18T00:37:26.648 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:37:26.648 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.51893 2026-02-18T00:37:26.648 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.51893 2026-02-18T00:37:26.649 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-18T00:37:26.651 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 1024 -le 1024 ']' 2026-02-18T00:37:26.651 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:127: setup: ulimit -n 4096 2026-02-18T00:37:26.651 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-18T00:37:26.651 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/rados-striper 1' TERM HUP INT 2026-02-18T00:37:26.651 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/rados-striper.sh:32: run: run_mon td/rados-striper a 2026-02-18T00:37:26.651 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/rados-striper 2026-02-18T00:37:26.651 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-18T00:37:26.651 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-18T00:37:26.651 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-18T00:37:26.651 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/rados-striper/a 2026-02-18T00:37:26.651 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/rados-striper/a --run-dir=td/rados-striper 2026-02-18T00:37:26.672 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-18T00:37:26.672 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:37:26.672 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:37:26.672 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:37:26.672 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:37:26.672 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.51893 2026-02-18T00:37:26.672 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.51893/$cluster-$name.asok' 2026-02-18T00:37:26.672 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/rados-striper/a '--log-file=td/rados-striper/$name.log' '--admin-socket=/tmp/ceph-asok.51893/$cluster-$name.asok' --mon-cluster-log-file=td/rados-striper/log --run-dir=td/rados-striper '--pid-file=td/rados-striper/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-18T00:37:26.705 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-18T00:37:26.706 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-18T00:37:26.706 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T00:37:26.706 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-18T00:37:26.706 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-18T00:37:26.706 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-18T00:37:26.707 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-18T00:37:26.708 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:37:26.708 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:37:26.708 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:37:26.708 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:37:26.708 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.51893 2026-02-18T00:37:26.708 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.51893/ceph-mon.a.asok 2026-02-18T00:37:26.708 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T00:37:26.708 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.51893/ceph-mon.a.asok config get fsid 2026-02-18T00:37:26.763 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-18T00:37:26.763 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T00:37:26.763 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-18T00:37:26.763 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-18T00:37:26.763 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-18T00:37:26.764 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-18T00:37:26.764 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:37:26.765 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:37:26.765 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:37:26.765 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:37:26.765 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.51893 2026-02-18T00:37:26.765 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.51893/ceph-mon.a.asok 2026-02-18T00:37:26.765 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T00:37:26.765 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.51893/ceph-mon.a.asok config get mon_host 2026-02-18T00:37:26.821 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/rados-striper.sh:33: run: run_osd td/rados-striper 0 2026-02-18T00:37:26.821 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/rados-striper 2026-02-18T00:37:26.821 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T00:37:26.821 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-18T00:37:26.821 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T00:37:26.821 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/rados-striper/0 2026-02-18T00:37:26.821 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=fc0fa2d5-f29d-42a8-bd8c-754201984e53 --auth-supported=none --mon-host=127.0.0.1:7116 ' 2026-02-18T00:37:26.821 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T00:37:26.822 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T00:37:26.822 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T00:37:26.822 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/rados-striper/0' 2026-02-18T00:37:26.822 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/rados-striper/0/journal' 2026-02-18T00:37:26.822 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T00:37:26.822 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-18T00:37:26.822 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/rados-striper' 2026-02-18T00:37:26.822 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T00:37:26.822 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:37:26.822 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:37:26.822 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:37:26.822 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:37:26.823 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.51893 2026-02-18T00:37:26.823 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.51893/$cluster-$name.asok' 2026-02-18T00:37:26.823 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.51893/$cluster-$name.asok' 2026-02-18T00:37:26.823 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T00:37:26.823 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T00:37:26.823 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T00:37:26.823 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/rados-striper/$name.log' 2026-02-18T00:37:26.823 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/rados-striper/$name.pid' 2026-02-18T00:37:26.823 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T00:37:26.823 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T00:37:26.823 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T00:37:26.823 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T00:37:26.824 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T00:37:26.824 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-18T00:37:26.824 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/rados-striper/0 2026-02-18T00:37:26.824 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T00:37:26.824 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=32a74a18-da5b-4b8d-8287-9d7b1a7230c3 2026-02-18T00:37:26.825 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 32a74a18-da5b-4b8d-8287-9d7b1a7230c3' 2026-02-18T00:37:26.825 INFO:tasks.workunit.client.0.trial069.stdout:add osd0 32a74a18-da5b-4b8d-8287-9d7b1a7230c3 2026-02-18T00:37:26.825 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T00:37:26.834 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDGCZVpaU5uMRAAvTXWhSy5EEI/zUHjwsNZpQ== 2026-02-18T00:37:26.834 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDGCZVpaU5uMRAAvTXWhSy5EEI/zUHjwsNZpQ=="}' 2026-02-18T00:37:26.835 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 32a74a18-da5b-4b8d-8287-9d7b1a7230c3 -i td/rados-striper/0/new.json 2026-02-18T00:37:26.945 INFO:tasks.workunit.client.0.trial069.stdout:0 2026-02-18T00:37:26.952 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/rados-striper/0/new.json 2026-02-18T00:37:26.953 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=fc0fa2d5-f29d-42a8-bd8c-754201984e53 --auth-supported=none --mon-host=127.0.0.1:7116 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/rados-striper/0 --osd-journal=td/rados-striper/0/journal --chdir= --run-dir=td/rados-striper '--admin-socket=/tmp/ceph-asok.51893/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/rados-striper/$name.log' '--pid-file=td/rados-striper/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDGCZVpaU5uMRAAvTXWhSy5EEI/zUHjwsNZpQ== --osd-uuid 32a74a18-da5b-4b8d-8287-9d7b1a7230c3 2026-02-18T00:37:26.968 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:37:26.962+0000 7face41b2a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:37:26.970 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:37:26.962+0000 7face41b2a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:37:26.971 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:37:26.962+0000 7face41b2a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:37:26.971 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:37:26.962+0000 7face41b2a40 -1 bdev(0x55a30aa06c00 td/rados-striper/0/block) open stat got: (1) Operation not permitted 2026-02-18T00:37:26.971 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:37:26.962+0000 7face41b2a40 -1 bluestore(td/rados-striper/0) _read_fsid unparsable uuid 2026-02-18T00:37:27.608 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/rados-striper/0/keyring 2026-02-18T00:37:27.608 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T00:37:27.609 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-18T00:37:27.609 INFO:tasks.workunit.client.0.trial069.stdout:adding osd0 key to auth repository 2026-02-18T00:37:27.610 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/rados-striper/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T00:37:27.730 INFO:tasks.workunit.client.0.trial069.stdout:start osd.0 2026-02-18T00:37:27.731 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-18T00:37:27.732 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=fc0fa2d5-f29d-42a8-bd8c-754201984e53 --auth-supported=none --mon-host=127.0.0.1:7116 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/rados-striper/0 --osd-journal=td/rados-striper/0/journal --chdir= --run-dir=td/rados-striper '--admin-socket=/tmp/ceph-asok.51893/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/rados-striper/$name.log' '--pid-file=td/rados-striper/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T00:37:27.732 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T00:37:27.732 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T00:37:27.732 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T00:37:27.752 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:37:27.746+0000 7f5eac4a2a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:37:27.754 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:37:27.746+0000 7f5eac4a2a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:37:27.756 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:37:27.746+0000 7f5eac4a2a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:37:27.839 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-18T00:37:27.839 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:37:27.839 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-18T00:37:27.840 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:37:27.840 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:37:27.840 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:37:27.840 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:37:27.840 INFO:tasks.workunit.client.0.trial069.stdout:0 2026-02-18T00:37:27.841 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:37:27.841 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T00:37:27.950 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:37:28.130 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:37:28.122+0000 7f5eac4a2a40 -1 Falling back to public interface 2026-02-18T00:37:28.755 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:37:28.746+0000 7f5eac4a2a40 -1 osd.0 0 log_to_monitors true 2026-02-18T00:37:28.951 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:37:28.952 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:37:28.952 INFO:tasks.workunit.client.0.trial069.stdout:1 2026-02-18T00:37:28.952 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T00:37:28.953 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:37:28.953 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T00:37:29.060 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:37:30.062 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:37:30.062 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:37:30.062 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-18T00:37:30.062 INFO:tasks.workunit.client.0.trial069.stdout:2 2026-02-18T00:37:30.063 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:37:30.063 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T00:37:30.173 INFO:tasks.workunit.client.0.trial069.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/607838340,v1:127.0.0.1:6801/607838340] [v2:127.0.0.1:6802/607838340,v1:127.0.0.1:6803/607838340] exists,up 32a74a18-da5b-4b8d-8287-9d7b1a7230c3 2026-02-18T00:37:30.176 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:37:30.176 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:37:30.176 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:37:30.176 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/rados-striper.sh:34: run: run_osd td/rados-striper 1 2026-02-18T00:37:30.176 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/rados-striper 2026-02-18T00:37:30.176 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T00:37:30.176 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2026-02-18T00:37:30.176 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T00:37:30.177 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/rados-striper/1 2026-02-18T00:37:30.177 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=fc0fa2d5-f29d-42a8-bd8c-754201984e53 --auth-supported=none --mon-host=127.0.0.1:7116 ' 2026-02-18T00:37:30.177 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T00:37:30.177 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T00:37:30.177 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T00:37:30.177 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/rados-striper/1' 2026-02-18T00:37:30.177 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/rados-striper/1/journal' 2026-02-18T00:37:30.177 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T00:37:30.177 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-18T00:37:30.177 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/rados-striper' 2026-02-18T00:37:30.177 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T00:37:30.177 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:37:30.178 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:37:30.178 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:37:30.178 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:37:30.178 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.51893 2026-02-18T00:37:30.178 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.51893/$cluster-$name.asok' 2026-02-18T00:37:30.178 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.51893/$cluster-$name.asok' 2026-02-18T00:37:30.178 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T00:37:30.178 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T00:37:30.178 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T00:37:30.178 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/rados-striper/$name.log' 2026-02-18T00:37:30.178 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/rados-striper/$name.pid' 2026-02-18T00:37:30.178 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T00:37:30.178 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T00:37:30.179 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T00:37:30.179 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T00:37:30.179 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T00:37:30.179 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-18T00:37:30.179 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/rados-striper/1 2026-02-18T00:37:30.179 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T00:37:30.179 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=e4a0e467-a1a8-4509-a1f1-6b0e7c81b879 2026-02-18T00:37:30.180 INFO:tasks.workunit.client.0.trial069.stdout:add osd1 e4a0e467-a1a8-4509-a1f1-6b0e7c81b879 2026-02-18T00:37:30.180 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 e4a0e467-a1a8-4509-a1f1-6b0e7c81b879' 2026-02-18T00:37:30.180 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T00:37:30.189 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDKCZVp8xL3ChAAke2jIRDNiwlfv/UGBstrmA== 2026-02-18T00:37:30.189 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDKCZVp8xL3ChAAke2jIRDNiwlfv/UGBstrmA=="}' 2026-02-18T00:37:30.189 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new e4a0e467-a1a8-4509-a1f1-6b0e7c81b879 -i td/rados-striper/1/new.json 2026-02-18T00:37:30.307 INFO:tasks.workunit.client.0.trial069.stdout:1 2026-02-18T00:37:30.314 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/rados-striper/1/new.json 2026-02-18T00:37:30.315 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=fc0fa2d5-f29d-42a8-bd8c-754201984e53 --auth-supported=none --mon-host=127.0.0.1:7116 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/rados-striper/1 --osd-journal=td/rados-striper/1/journal --chdir= --run-dir=td/rados-striper '--admin-socket=/tmp/ceph-asok.51893/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/rados-striper/$name.log' '--pid-file=td/rados-striper/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDKCZVp8xL3ChAAke2jIRDNiwlfv/UGBstrmA== --osd-uuid e4a0e467-a1a8-4509-a1f1-6b0e7c81b879 2026-02-18T00:37:30.330 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:37:30.322+0000 7f8ee4211a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:37:30.332 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:37:30.326+0000 7f8ee4211a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:37:30.333 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:37:30.326+0000 7f8ee4211a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:37:30.333 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:37:30.326+0000 7f8ee4211a40 -1 bdev(0x5601fd440c00 td/rados-striper/1/block) open stat got: (1) Operation not permitted 2026-02-18T00:37:30.334 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:37:30.326+0000 7f8ee4211a40 -1 bluestore(td/rados-striper/1) _read_fsid unparsable uuid 2026-02-18T00:37:30.978 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/rados-striper/1/keyring 2026-02-18T00:37:30.978 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T00:37:30.979 INFO:tasks.workunit.client.0.trial069.stdout:adding osd1 key to auth repository 2026-02-18T00:37:30.979 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2026-02-18T00:37:30.980 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/rados-striper/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T00:37:31.090 INFO:tasks.workunit.client.0.trial069.stdout:start osd.1 2026-02-18T00:37:31.091 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2026-02-18T00:37:31.091 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=fc0fa2d5-f29d-42a8-bd8c-754201984e53 --auth-supported=none --mon-host=127.0.0.1:7116 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/rados-striper/1 --osd-journal=td/rados-striper/1/journal --chdir= --run-dir=td/rados-striper '--admin-socket=/tmp/ceph-asok.51893/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/rados-striper/$name.log' '--pid-file=td/rados-striper/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T00:37:31.091 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T00:37:31.091 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T00:37:31.091 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T00:37:31.112 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:37:31.102+0000 7f476525ca40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:37:31.113 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:37:31.106+0000 7f476525ca40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:37:31.115 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:37:31.106+0000 7f476525ca40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:37:31.199 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2026-02-18T00:37:31.199 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:37:31.199 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-18T00:37:31.199 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:37:31.199 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:37:31.199 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:37:31.200 INFO:tasks.workunit.client.0.trial069.stdout:0 2026-02-18T00:37:31.200 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:37:31.200 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:37:31.200 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-18T00:37:31.309 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:37:31.494 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:37:31.486+0000 7f476525ca40 -1 Falling back to public interface 2026-02-18T00:37:32.058 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:37:32.050+0000 7f476525ca40 -1 osd.1 0 log_to_monitors true 2026-02-18T00:37:32.310 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:37:32.311 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:37:32.311 INFO:tasks.workunit.client.0.trial069.stdout:1 2026-02-18T00:37:32.311 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T00:37:32.312 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:37:32.312 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-18T00:37:32.418 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:37:33.420 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:37:33.420 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:37:33.420 INFO:tasks.workunit.client.0.trial069.stdout:2 2026-02-18T00:37:33.421 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-18T00:37:33.421 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:37:33.421 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-18T00:37:33.530 INFO:tasks.workunit.client.0.trial069.stdout:osd.1 up in weight 1 up_from 10 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6808/3461184349,v1:127.0.0.1:6809/3461184349] [v2:127.0.0.1:6810/3461184349,v1:127.0.0.1:6811/3461184349] exists,up e4a0e467-a1a8-4509-a1f1-6b0e7c81b879 2026-02-18T00:37:33.533 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:37:33.533 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:37:33.533 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:37:33.534 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/rados-striper.sh:35: run: run_osd td/rados-striper 2 2026-02-18T00:37:33.534 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/rados-striper 2026-02-18T00:37:33.534 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T00:37:33.534 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2026-02-18T00:37:33.534 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T00:37:33.534 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/rados-striper/2 2026-02-18T00:37:33.534 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=fc0fa2d5-f29d-42a8-bd8c-754201984e53 --auth-supported=none --mon-host=127.0.0.1:7116 ' 2026-02-18T00:37:33.534 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T00:37:33.534 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T00:37:33.534 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T00:37:33.534 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/rados-striper/2' 2026-02-18T00:37:33.534 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/rados-striper/2/journal' 2026-02-18T00:37:33.535 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T00:37:33.535 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-18T00:37:33.535 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/rados-striper' 2026-02-18T00:37:33.535 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T00:37:33.535 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:37:33.535 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:37:33.535 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:37:33.535 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:37:33.535 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.51893 2026-02-18T00:37:33.535 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.51893/$cluster-$name.asok' 2026-02-18T00:37:33.535 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.51893/$cluster-$name.asok' 2026-02-18T00:37:33.535 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T00:37:33.536 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T00:37:33.536 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T00:37:33.536 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/rados-striper/$name.log' 2026-02-18T00:37:33.536 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/rados-striper/$name.pid' 2026-02-18T00:37:33.536 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T00:37:33.536 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T00:37:33.536 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T00:37:33.536 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T00:37:33.536 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T00:37:33.536 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-18T00:37:33.536 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/rados-striper/2 2026-02-18T00:37:33.537 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T00:37:33.537 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=4a9fe337-6e8c-4a4f-87ec-9fd62c871374 2026-02-18T00:37:33.537 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 4a9fe337-6e8c-4a4f-87ec-9fd62c871374' 2026-02-18T00:37:33.538 INFO:tasks.workunit.client.0.trial069.stdout:add osd2 4a9fe337-6e8c-4a4f-87ec-9fd62c871374 2026-02-18T00:37:33.538 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T00:37:33.546 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDNCZVpgKo8IBAA0z6hcKtvPIrk45crbQHauw== 2026-02-18T00:37:33.546 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDNCZVpgKo8IBAA0z6hcKtvPIrk45crbQHauw=="}' 2026-02-18T00:37:33.546 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 4a9fe337-6e8c-4a4f-87ec-9fd62c871374 -i td/rados-striper/2/new.json 2026-02-18T00:37:33.664 INFO:tasks.workunit.client.0.trial069.stdout:2 2026-02-18T00:37:33.671 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/rados-striper/2/new.json 2026-02-18T00:37:33.672 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --fsid=fc0fa2d5-f29d-42a8-bd8c-754201984e53 --auth-supported=none --mon-host=127.0.0.1:7116 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/rados-striper/2 --osd-journal=td/rados-striper/2/journal --chdir= --run-dir=td/rados-striper '--admin-socket=/tmp/ceph-asok.51893/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/rados-striper/$name.log' '--pid-file=td/rados-striper/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDNCZVpgKo8IBAA0z6hcKtvPIrk45crbQHauw== --osd-uuid 4a9fe337-6e8c-4a4f-87ec-9fd62c871374 2026-02-18T00:37:33.688 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:37:33.678+0000 7fc2eb442a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:37:33.689 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:37:33.682+0000 7fc2eb442a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:37:33.690 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:37:33.682+0000 7fc2eb442a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:37:33.691 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:37:33.682+0000 7fc2eb442a40 -1 bdev(0x55ddca6e4c00 td/rados-striper/2/block) open stat got: (1) Operation not permitted 2026-02-18T00:37:33.691 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:37:33.682+0000 7fc2eb442a40 -1 bluestore(td/rados-striper/2) _read_fsid unparsable uuid 2026-02-18T00:37:34.299 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/rados-striper/2/keyring 2026-02-18T00:37:34.299 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T00:37:34.300 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2026-02-18T00:37:34.300 INFO:tasks.workunit.client.0.trial069.stdout:adding osd2 key to auth repository 2026-02-18T00:37:34.301 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/rados-striper/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T00:37:34.412 INFO:tasks.workunit.client.0.trial069.stdout:start osd.2 2026-02-18T00:37:34.413 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2026-02-18T00:37:34.413 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --fsid=fc0fa2d5-f29d-42a8-bd8c-754201984e53 --auth-supported=none --mon-host=127.0.0.1:7116 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/rados-striper/2 --osd-journal=td/rados-striper/2/journal --chdir= --run-dir=td/rados-striper '--admin-socket=/tmp/ceph-asok.51893/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/rados-striper/$name.log' '--pid-file=td/rados-striper/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T00:37:34.413 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T00:37:34.413 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T00:37:34.413 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T00:37:34.427 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:37:34.418+0000 7f0c7b9daa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:37:34.428 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:37:34.422+0000 7f0c7b9daa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:37:34.429 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:37:34.422+0000 7f0c7b9daa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:37:34.523 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2026-02-18T00:37:34.523 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:37:34.524 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-18T00:37:34.524 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:37:34.524 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:37:34.524 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:37:34.524 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:37:34.524 INFO:tasks.workunit.client.0.trial069.stdout:0 2026-02-18T00:37:34.525 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:37:34.525 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-18T00:37:34.635 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:37:34.862 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:37:34.854+0000 7f0c7b9daa40 -1 Falling back to public interface 2026-02-18T00:37:35.509 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:37:35.502+0000 7f0c7b9daa40 -1 osd.2 0 log_to_monitors true 2026-02-18T00:37:35.637 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:37:35.637 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:37:35.637 INFO:tasks.workunit.client.0.trial069.stdout:1 2026-02-18T00:37:35.638 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T00:37:35.638 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:37:35.638 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-18T00:37:35.746 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:37:36.748 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:37:36.748 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:37:36.748 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-18T00:37:36.748 INFO:tasks.workunit.client.0.trial069.stdout:2 2026-02-18T00:37:36.749 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:37:36.749 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-18T00:37:36.855 INFO:tasks.workunit.client.0.trial069.stdout:osd.2 up in weight 1 up_from 15 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6816/1789605455,v1:127.0.0.1:6817/1789605455] [v2:127.0.0.1:6818/1789605455,v1:127.0.0.1:6819/1789605455] exists,up 4a9fe337-6e8c-4a4f-87ec-9fd62c871374 2026-02-18T00:37:36.856 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:37:36.856 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:37:36.856 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:37:36.856 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/rados-striper.sh:36: run: create_rbd_pool 2026-02-18T00:37:36.856 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:526: create_rbd_pool: ceph osd pool delete rbd rbd --yes-i-really-really-mean-it 2026-02-18T00:37:36.955 INFO:tasks.workunit.client.0.trial069.stderr:pool 'rbd' does not exist 2026-02-18T00:37:36.962 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:527: create_rbd_pool: create_pool rbd 4 2026-02-18T00:37:36.963 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create rbd 4 2026-02-18T00:37:37.101 INFO:tasks.workunit.client.0.trial069.stderr:pool 'rbd' already exists 2026-02-18T00:37:37.109 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-18T00:37:38.111 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:528: create_rbd_pool: rbd pool init rbd 2026-02-18T00:37:38.389 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/rados-striper.sh:39: run: dd if=/dev/urandom of=td/rados-striper/toyfile bs=1234 count=1 2026-02-18T00:37:38.390 INFO:tasks.workunit.client.0.trial069.stderr:1+0 records in 2026-02-18T00:37:38.390 INFO:tasks.workunit.client.0.trial069.stderr:1+0 records out 2026-02-18T00:37:38.390 INFO:tasks.workunit.client.0.trial069.stderr:1234 bytes (1.2 kB, 1.2 KiB) copied, 5.8068e-05 s, 21.3 MB/s 2026-02-18T00:37:38.390 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/rados-striper.sh:42: run: rados --pool rbd --striper put toyfile td/rados-striper/toyfile 2026-02-18T00:37:38.419 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/rados-striper.sh:45: run: rados --pool rbd --striper stat toyfile 2026-02-18T00:37:38.419 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/rados-striper.sh:45: run: cut -d , -f 2 2026-02-18T00:37:38.441 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/rados-striper.sh:46: run: rados --pool rbd stat toyfile.0000000000000000 2026-02-18T00:37:38.441 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/rados-striper.sh:46: run: cut -d , -f 2 2026-02-18T00:37:38.464 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/rados-striper.sh:47: run: echo ' size 1234' 2026-02-18T00:37:38.464 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/rados-striper.sh:48: run: diff -w td/rados-striper/stripedStat td/rados-striper/refstat 2026-02-18T00:37:38.466 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/rados-striper.sh:49: run: diff -w td/rados-striper/stat td/rados-striper/refstat 2026-02-18T00:37:38.467 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/rados-striper.sh:50: run: rados --pool rbd stat toyfile 2026-02-18T00:37:38.486 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/rados-striper.sh:51: run: grep -q 'No such file or directory' td/rados-striper/staterror 2026-02-18T00:37:38.487 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/rados-striper.sh:54: run: rados --pool rbd --striper get toyfile td/rados-striper/stripedGroup 2026-02-18T00:37:38.508 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/rados-striper.sh:55: run: diff -w td/rados-striper/toyfile td/rados-striper/stripedGroup 2026-02-18T00:37:38.509 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/rados-striper.sh:56: run: rados --pool rbd get toyfile.0000000000000000 td/rados-striper/nonSTripedGroup 2026-02-18T00:37:38.531 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/rados-striper.sh:57: run: diff -w td/rados-striper/toyfile td/rados-striper/nonSTripedGroup 2026-02-18T00:37:38.532 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/rados-striper.sh:60: run: rados --pool rbd --striper truncate toyfile 12 2026-02-18T00:37:38.559 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/rados-striper.sh:61: run: rados --pool rbd --striper stat toyfile 2026-02-18T00:37:38.559 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/rados-striper.sh:61: run: cut -d , -f 2 2026-02-18T00:37:38.581 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/rados-striper.sh:62: run: rados --pool rbd stat toyfile.0000000000000000 2026-02-18T00:37:38.582 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/rados-striper.sh:62: run: cut -d , -f 2 2026-02-18T00:37:38.604 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/rados-striper.sh:63: run: echo ' size 12' 2026-02-18T00:37:38.604 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/rados-striper.sh:64: run: diff -w td/rados-striper/stripedStat td/rados-striper/reftrunc 2026-02-18T00:37:38.605 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/rados-striper.sh:65: run: diff -w td/rados-striper/stat td/rados-striper/reftrunc 2026-02-18T00:37:38.605 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/rados-striper.sh:69: run: rados --pool rbd --striper setxattr toyfile somexattr somevalue 2026-02-18T00:37:38.630 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/rados-striper.sh:70: run: rados --pool rbd --striper getxattr toyfile somexattr 2026-02-18T00:37:38.647 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/rados-striper.sh:71: run: rados --pool rbd getxattr toyfile.0000000000000000 somexattr 2026-02-18T00:37:38.669 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/rados-striper.sh:72: run: echo somevalue 2026-02-18T00:37:38.669 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/rados-striper.sh:73: run: diff -w td/rados-striper/xattrvalue td/rados-striper/refvalue 2026-02-18T00:37:38.670 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/rados-striper.sh:74: run: diff -w td/rados-striper/xattrvalue2 td/rados-striper/refvalue 2026-02-18T00:37:38.671 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/rados-striper.sh:75: run: rados --pool rbd --striper listxattr toyfile 2026-02-18T00:37:38.695 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/rados-striper.sh:76: run: echo somexattr 2026-02-18T00:37:38.695 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/rados-striper.sh:77: run: diff -w td/rados-striper/xattrlist td/rados-striper/reflist 2026-02-18T00:37:38.696 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/rados-striper.sh:78: run: rados --pool rbd listxattr toyfile.0000000000000000 2026-02-18T00:37:38.696 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/rados-striper.sh:78: run: grep -v striper 2026-02-18T00:37:38.717 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/rados-striper.sh:79: run: diff -w td/rados-striper/xattrlist2 td/rados-striper/reflist 2026-02-18T00:37:38.718 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/rados-striper.sh:80: run: rados --pool rbd --striper rmxattr toyfile somexattr 2026-02-18T00:37:38.741 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/rados-striper.sh:82: run: local 'attr_not_found_str=No data available' 2026-02-18T00:37:38.742 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/rados-striper.sh:83: run: uname 2026-02-18T00:37:38.743 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/rados-striper.sh:83: run: '[' Linux = FreeBSD ']' 2026-02-18T00:37:38.743 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/rados-striper.sh:85: run: expect_failure td/rados-striper 'No data available' rados --pool rbd --striper getxattr toyfile somexattr 2026-02-18T00:37:38.743 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2016: expect_failure: local dir=td/rados-striper 2026-02-18T00:37:38.744 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2017: expect_failure: shift 2026-02-18T00:37:38.744 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2018: expect_failure: local 'expected=No data available' 2026-02-18T00:37:38.744 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2019: expect_failure: shift 2026-02-18T00:37:38.744 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2020: expect_failure: local success 2026-02-18T00:37:38.744 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2022: expect_failure: rados --pool rbd --striper getxattr toyfile somexattr 2026-02-18T00:37:38.761 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2025: expect_failure: success=false 2026-02-18T00:37:38.761 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2028: expect_failure: false 2026-02-18T00:37:38.761 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2028: expect_failure: grep --quiet 'No data available' td/rados-striper/out 2026-02-18T00:37:38.762 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2032: expect_failure: return 0 2026-02-18T00:37:38.762 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/rados-striper.sh:87: run: expect_failure td/rados-striper 'No data available' rados --pool rbd getxattr toyfile.0000000000000000 somexattr 2026-02-18T00:37:38.762 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2016: expect_failure: local dir=td/rados-striper 2026-02-18T00:37:38.762 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2017: expect_failure: shift 2026-02-18T00:37:38.762 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2018: expect_failure: local 'expected=No data available' 2026-02-18T00:37:38.762 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2019: expect_failure: shift 2026-02-18T00:37:38.762 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2020: expect_failure: local success 2026-02-18T00:37:38.763 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2022: expect_failure: rados --pool rbd getxattr toyfile.0000000000000000 somexattr 2026-02-18T00:37:38.780 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2025: expect_failure: success=false 2026-02-18T00:37:38.780 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2028: expect_failure: false 2026-02-18T00:37:38.780 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2028: expect_failure: grep --quiet 'No data available' td/rados-striper/out 2026-02-18T00:37:38.780 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2032: expect_failure: return 0 2026-02-18T00:37:38.780 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/rados-striper.sh:91: run: rados --pool rbd --striper rm toyfile 2026-02-18T00:37:38.797 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/rados-striper.sh:92: run: expect_failure td/rados-striper 'No such file or directory' rados --pool rbd --striper stat toyfile 2026-02-18T00:37:38.797 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2016: expect_failure: local dir=td/rados-striper 2026-02-18T00:37:38.797 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2017: expect_failure: shift 2026-02-18T00:37:38.797 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2018: expect_failure: local 'expected=No such file or directory' 2026-02-18T00:37:38.798 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2019: expect_failure: shift 2026-02-18T00:37:38.798 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2020: expect_failure: local success 2026-02-18T00:37:38.798 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2022: expect_failure: rados --pool rbd --striper stat toyfile 2026-02-18T00:37:38.820 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2025: expect_failure: success=false 2026-02-18T00:37:38.820 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2028: expect_failure: false 2026-02-18T00:37:38.820 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2028: expect_failure: grep --quiet 'No such file or directory' td/rados-striper/out 2026-02-18T00:37:38.822 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2032: expect_failure: return 0 2026-02-18T00:37:38.822 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/rados-striper.sh:94: run: expect_failure td/rados-striper 'No such file or directory' rados --pool rbd stat toyfile.0000000000000000 2026-02-18T00:37:38.822 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2016: expect_failure: local dir=td/rados-striper 2026-02-18T00:37:38.822 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2017: expect_failure: shift 2026-02-18T00:37:38.822 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2018: expect_failure: local 'expected=No such file or directory' 2026-02-18T00:37:38.822 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2019: expect_failure: shift 2026-02-18T00:37:38.822 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2020: expect_failure: local success 2026-02-18T00:37:38.822 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2022: expect_failure: rados --pool rbd stat toyfile.0000000000000000 2026-02-18T00:37:38.843 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2025: expect_failure: success=false 2026-02-18T00:37:38.843 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2028: expect_failure: false 2026-02-18T00:37:38.844 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2028: expect_failure: grep --quiet 'No such file or directory' td/rados-striper/out 2026-02-18T00:37:38.845 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2032: expect_failure: return 0 2026-02-18T00:37:38.845 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/rados-striper.sh:98: run: teardown td/rados-striper 2026-02-18T00:37:38.845 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/rados-striper 2026-02-18T00:37:38.845 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T00:37:38.845 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/rados-striper KILL 2026-02-18T00:37:38.846 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:37:38.846 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:37:38.846 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:37:38.846 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:37:38.846 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:37:38.955 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:37:38.955 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T00:37:38.956 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T00:37:38.956 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T00:37:38.957 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T00:37:38.957 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T00:37:38.957 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T00:37:38.958 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:37:38.958 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T00:37:38.959 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T00:37:38.959 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:37:38.960 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T00:37:38.961 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T00:37:38.961 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/rados-striper 2026-02-18T00:37:38.969 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T00:37:38.969 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:37:38.969 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.51893 2026-02-18T00:37:38.969 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.51893 2026-02-18T00:37:38.971 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T00:37:38.971 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T00:37:38.971 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2401: main: code=0 2026-02-18T00:37:38.971 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2405: main: teardown td/rados-striper 0 2026-02-18T00:37:38.972 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/rados-striper 2026-02-18T00:37:38.972 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs=0 2026-02-18T00:37:38.972 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/rados-striper KILL 2026-02-18T00:37:38.972 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:37:38.972 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:37:38.972 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:37:38.972 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:37:38.972 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:37:38.973 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:37:38.974 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T00:37:38.974 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T00:37:38.975 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T00:37:38.976 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T00:37:38.976 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T00:37:38.977 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T00:37:38.978 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:37:38.978 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T00:37:38.978 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T00:37:38.979 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:37:38.979 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T00:37:38.981 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o 0 = 1 ']' 2026-02-18T00:37:38.981 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/rados-striper 2026-02-18T00:37:38.982 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T00:37:38.982 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:37:38.982 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.51893 2026-02-18T00:37:38.982 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.51893 2026-02-18T00:37:38.983 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T00:37:38.983 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T00:37:38.983 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2406: main: return 0 2026-02-18T00:37:38.984 INFO:teuthology.orchestra.run:Running command with timeout 3600 2026-02-18T00:37:38.984 DEBUG:teuthology.orchestra.run.trial069:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2026-02-18T00:37:39.036 INFO:tasks.workunit:Running workunit misc/test-ceph-helpers.sh... 2026-02-18T00:37:39.036 DEBUG:teuthology.orchestra.run.trial069:workunit test misc/test-ceph-helpers.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=adc1923395f2bcd6ae89b5d331d278364d1848ed TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-ceph-helpers.sh 2026-02-18T00:37:39.087 INFO:tasks.workunit.client.0.trial069.stderr:stty: 'standard input': Inappropriate ioctl for device 2026-02-18T00:37:39.089 INFO:tasks.workunit.client.0.trial069.stderr:+ PS4='${BASH_SOURCE[0]}:$LINENO: ${FUNCNAME[0]}: ' 2026-02-18T00:37:39.089 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2415: run_tests: export PATH=./bin:.:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2026-02-18T00:37:39.089 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2415: run_tests: PATH=./bin:.:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2026-02-18T00:37:39.089 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2417: run_tests: export CEPH_MON=127.0.0.1:7109 2026-02-18T00:37:39.090 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2417: run_tests: CEPH_MON=127.0.0.1:7109 2026-02-18T00:37:39.090 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2418: run_tests: export CEPH_ARGS 2026-02-18T00:37:39.090 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2419: run_tests: uuidgen 2026-02-18T00:37:39.090 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2419: run_tests: CEPH_ARGS+=' --fsid=863c4e35-ceb0-4172-b7b2-c3ff099e05a2 --auth-supported=none ' 2026-02-18T00:37:39.091 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2420: run_tests: CEPH_ARGS+='--mon-host=127.0.0.1:7109 ' 2026-02-18T00:37:39.091 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2421: run_tests: export CEPH_CONF=/dev/null 2026-02-18T00:37:39.091 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2421: run_tests: CEPH_CONF=/dev/null 2026-02-18T00:37:39.091 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2423: run_tests: set 2026-02-18T00:37:39.091 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2423: run_tests: sed -n -e 's/^\(test_[0-9a-z_]*\) .*/\1/p' 2026-02-18T00:37:39.094 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2423: run_tests: local 'funcs=test_activate_osd 2026-02-18T00:37:39.094 INFO:tasks.workunit.client.0.trial069.stderr:test_activate_osd_after_mark_down 2026-02-18T00:37:39.094 INFO:tasks.workunit.client.0.trial069.stderr:test_activate_osd_skip_benchmark 2026-02-18T00:37:39.094 INFO:tasks.workunit.client.0.trial069.stderr:test_destroy_osd 2026-02-18T00:37:39.094 INFO:tasks.workunit.client.0.trial069.stderr:test_display_logs 2026-02-18T00:37:39.094 INFO:tasks.workunit.client.0.trial069.stderr:test_erasure_code_plugin_exists 2026-02-18T00:37:39.094 INFO:tasks.workunit.client.0.trial069.stderr:test_expect_failure 2026-02-18T00:37:39.094 INFO:tasks.workunit.client.0.trial069.stderr:test_file_with_random_data 2026-02-18T00:37:39.095 INFO:tasks.workunit.client.0.trial069.stderr:test_flush_pg_stats 2026-02-18T00:37:39.095 INFO:tasks.workunit.client.0.trial069.stderr:test_get_config 2026-02-18T00:37:39.095 INFO:tasks.workunit.client.0.trial069.stderr:test_get_is_making_recovery_progress 2026-02-18T00:37:39.095 INFO:tasks.workunit.client.0.trial069.stderr:test_get_last_scrub_stamp 2026-02-18T00:37:39.095 INFO:tasks.workunit.client.0.trial069.stderr:test_get_not_primary 2026-02-18T00:37:39.095 INFO:tasks.workunit.client.0.trial069.stderr:test_get_num_active_clean 2026-02-18T00:37:39.095 INFO:tasks.workunit.client.0.trial069.stderr:test_get_num_active_or_peered 2026-02-18T00:37:39.095 INFO:tasks.workunit.client.0.trial069.stderr:test_get_num_pgs 2026-02-18T00:37:39.095 INFO:tasks.workunit.client.0.trial069.stderr:test_get_op_scheduler 2026-02-18T00:37:39.095 INFO:tasks.workunit.client.0.trial069.stderr:test_get_osd_id_used_by_pgs 2026-02-18T00:37:39.095 INFO:tasks.workunit.client.0.trial069.stderr:test_get_osds 2026-02-18T00:37:39.095 INFO:tasks.workunit.client.0.trial069.stderr:test_get_pg 2026-02-18T00:37:39.096 INFO:tasks.workunit.client.0.trial069.stderr:test_get_primary 2026-02-18T00:37:39.096 INFO:tasks.workunit.client.0.trial069.stderr:test_get_timeout_delays 2026-02-18T00:37:39.096 INFO:tasks.workunit.client.0.trial069.stderr:test_is_clean 2026-02-18T00:37:39.096 INFO:tasks.workunit.client.0.trial069.stderr:test_kill_daemon 2026-02-18T00:37:39.096 INFO:tasks.workunit.client.0.trial069.stderr:test_kill_daemons 2026-02-18T00:37:39.096 INFO:tasks.workunit.client.0.trial069.stderr:test_objectstore_tool 2026-02-18T00:37:39.096 INFO:tasks.workunit.client.0.trial069.stderr:test_pg_schedule_scrub 2026-02-18T00:37:39.096 INFO:tasks.workunit.client.0.trial069.stderr:test_pg_scrub 2026-02-18T00:37:39.096 INFO:tasks.workunit.client.0.trial069.stderr:test_repair 2026-02-18T00:37:39.096 INFO:tasks.workunit.client.0.trial069.stderr:test_run_in_background 2026-02-18T00:37:39.096 INFO:tasks.workunit.client.0.trial069.stderr:test_run_mon 2026-02-18T00:37:39.096 INFO:tasks.workunit.client.0.trial069.stderr:test_run_osd 2026-02-18T00:37:39.096 INFO:tasks.workunit.client.0.trial069.stderr:test_set_config 2026-02-18T00:37:39.097 INFO:tasks.workunit.client.0.trial069.stderr:test_setup 2026-02-18T00:37:39.097 INFO:tasks.workunit.client.0.trial069.stderr:test_teardown 2026-02-18T00:37:39.097 INFO:tasks.workunit.client.0.trial069.stderr:test_wait_background 2026-02-18T00:37:39.097 INFO:tasks.workunit.client.0.trial069.stderr:test_wait_for_clean 2026-02-18T00:37:39.097 INFO:tasks.workunit.client.0.trial069.stderr:test_wait_for_health_ok 2026-02-18T00:37:39.097 INFO:tasks.workunit.client.0.trial069.stderr:test_wait_for_osd 2026-02-18T00:37:39.097 INFO:tasks.workunit.client.0.trial069.stderr:test_wait_for_peered 2026-02-18T00:37:39.097 INFO:tasks.workunit.client.0.trial069.stderr:test_wait_for_scrub 2026-02-18T00:37:39.097 INFO:tasks.workunit.client.0.trial069.stderr:test_wait_osd_id_used_by_pgs' 2026-02-18T00:37:39.097 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2424: run_tests: local dir=td/ceph-helpers 2026-02-18T00:37:39.097 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2426: run_tests: for func in $funcs 2026-02-18T00:37:39.097 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2427: run_tests: test_activate_osd td/ceph-helpers 2026-02-18T00:37:39.098 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:877: test_activate_osd: local dir=td/ceph-helpers 2026-02-18T00:37:39.098 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: test_activate_osd: setup td/ceph-helpers 2026-02-18T00:37:39.098 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/ceph-helpers 2026-02-18T00:37:39.098 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/ceph-helpers 2026-02-18T00:37:39.098 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/ceph-helpers 2026-02-18T00:37:39.098 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T00:37:39.098 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/ceph-helpers KILL 2026-02-18T00:37:39.098 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:37:39.098 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:37:39.098 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:37:39.098 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:37:39.098 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:37:39.100 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:37:39.100 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T00:37:39.100 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T00:37:39.100 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T00:37:39.100 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T00:37:39.100 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T00:37:39.100 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T00:37:39.100 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:37:39.100 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T00:37:39.101 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T00:37:39.101 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:37:39.101 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T00:37:39.102 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T00:37:39.102 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/ceph-helpers 2026-02-18T00:37:39.103 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T00:37:39.104 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:37:39.104 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:37:39.104 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.57427 2026-02-18T00:37:39.105 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T00:37:39.105 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T00:37:39.106 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/ceph-helpers 2026-02-18T00:37:39.107 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-18T00:37:39.107 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:37:39.107 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:37:39.107 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.57427 2026-02-18T00:37:39.108 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-18T00:37:39.110 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 1024 -le 1024 ']' 2026-02-18T00:37:39.110 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:127: setup: ulimit -n 4096 2026-02-18T00:37:39.110 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-18T00:37:39.110 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/ceph-helpers 1' TERM HUP INT 2026-02-18T00:37:39.110 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:881: test_activate_osd: run_mon td/ceph-helpers a 2026-02-18T00:37:39.110 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/ceph-helpers 2026-02-18T00:37:39.110 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-18T00:37:39.111 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-18T00:37:39.111 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-18T00:37:39.111 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/ceph-helpers/a 2026-02-18T00:37:39.111 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/ceph-helpers/a --run-dir=td/ceph-helpers 2026-02-18T00:37:39.132 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-18T00:37:39.132 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:37:39.132 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:37:39.132 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:37:39.132 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:37:39.132 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:37:39.132 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.57427/$cluster-$name.asok' 2026-02-18T00:37:39.133 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/ceph-helpers/a '--log-file=td/ceph-helpers/$name.log' '--admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' --mon-cluster-log-file=td/ceph-helpers/log --run-dir=td/ceph-helpers '--pid-file=td/ceph-helpers/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-18T00:37:39.159 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-18T00:37:39.160 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-18T00:37:39.161 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T00:37:39.161 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-18T00:37:39.161 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-18T00:37:39.161 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-18T00:37:39.162 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-18T00:37:39.162 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:37:39.162 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:37:39.162 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:37:39.162 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:37:39.162 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:37:39.163 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.57427/ceph-mon.a.asok 2026-02-18T00:37:39.163 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T00:37:39.163 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.57427/ceph-mon.a.asok config get fsid 2026-02-18T00:37:39.217 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-18T00:37:39.218 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T00:37:39.218 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-18T00:37:39.218 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-18T00:37:39.218 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-18T00:37:39.219 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-18T00:37:39.219 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:37:39.219 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:37:39.219 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:37:39.220 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:37:39.220 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:37:39.220 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.57427/ceph-mon.a.asok 2026-02-18T00:37:39.220 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T00:37:39.220 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.57427/ceph-mon.a.asok config get mon_host 2026-02-18T00:37:39.274 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:882: test_activate_osd: run_mgr td/ceph-helpers x 2026-02-18T00:37:39.274 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/ceph-helpers 2026-02-18T00:37:39.274 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-18T00:37:39.274 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-18T00:37:39.274 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-18T00:37:39.274 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/ceph-helpers/x 2026-02-18T00:37:39.274 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-18T00:37:39.388 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-18T00:37:39.388 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:37:39.389 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:37:39.389 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:37:39.389 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:37:39.389 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:37:39.389 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.57427/$cluster-$name.asok' 2026-02-18T00:37:39.389 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-18T00:37:39.390 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/ceph-helpers/x '--log-file=td/ceph-helpers/$name.log' '--admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' --run-dir=td/ceph-helpers '--pid-file=td/ceph-helpers/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-18T00:37:39.409 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:884: test_activate_osd: run_osd td/ceph-helpers 0 2026-02-18T00:37:39.409 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/ceph-helpers 2026-02-18T00:37:39.410 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T00:37:39.410 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-18T00:37:39.410 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T00:37:39.410 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/ceph-helpers/0 2026-02-18T00:37:39.410 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--cluster ceph --fsid=863c4e35-ceb0-4172-b7b2-c3ff099e05a2 --auth-supported=none --mon-host=127.0.0.1:7109 ' 2026-02-18T00:37:39.410 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T00:37:39.410 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T00:37:39.410 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T00:37:39.410 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/ceph-helpers/0' 2026-02-18T00:37:39.410 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/ceph-helpers/0/journal' 2026-02-18T00:37:39.410 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T00:37:39.411 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-18T00:37:39.411 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/ceph-helpers' 2026-02-18T00:37:39.411 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T00:37:39.411 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:37:39.411 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:37:39.411 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:37:39.411 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:37:39.411 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:37:39.411 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.57427/$cluster-$name.asok' 2026-02-18T00:37:39.411 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' 2026-02-18T00:37:39.411 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T00:37:39.411 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T00:37:39.411 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T00:37:39.412 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/ceph-helpers/$name.log' 2026-02-18T00:37:39.412 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/ceph-helpers/$name.pid' 2026-02-18T00:37:39.412 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T00:37:39.412 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T00:37:39.412 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T00:37:39.412 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T00:37:39.412 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T00:37:39.412 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-18T00:37:39.412 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/ceph-helpers/0 2026-02-18T00:37:39.412 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T00:37:39.413 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=6e63bc55-1db8-439c-bf15-e28b4c46f913 2026-02-18T00:37:39.413 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 6e63bc55-1db8-439c-bf15-e28b4c46f913' 2026-02-18T00:37:39.413 INFO:tasks.workunit.client.0.trial069.stdout:add osd0 6e63bc55-1db8-439c-bf15-e28b4c46f913 2026-02-18T00:37:39.414 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T00:37:39.421 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDTCZVp1o3VGBAAqcqlrqCVwgiMjNCBnaimeQ== 2026-02-18T00:37:39.422 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDTCZVp1o3VGBAAqcqlrqCVwgiMjNCBnaimeQ=="}' 2026-02-18T00:37:39.422 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 6e63bc55-1db8-439c-bf15-e28b4c46f913 -i td/ceph-helpers/0/new.json 2026-02-18T00:37:39.531 INFO:tasks.workunit.client.0.trial069.stdout:0 2026-02-18T00:37:39.539 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/ceph-helpers/0/new.json 2026-02-18T00:37:39.541 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --cluster ceph --fsid=863c4e35-ceb0-4172-b7b2-c3ff099e05a2 --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/0 --osd-journal=td/ceph-helpers/0/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDTCZVp1o3VGBAAqcqlrqCVwgiMjNCBnaimeQ== --osd-uuid 6e63bc55-1db8-439c-bf15-e28b4c46f913 2026-02-18T00:37:39.557 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:37:39.550+0000 7f278a112a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:37:39.558 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:37:39.550+0000 7f278a112a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:37:39.559 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:37:39.550+0000 7f278a112a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:37:39.560 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:37:39.550+0000 7f278a112a40 -1 bdev(0x5620d6be8c00 td/ceph-helpers/0/block) open stat got: (1) Operation not permitted 2026-02-18T00:37:39.560 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:37:39.550+0000 7f278a112a40 -1 bluestore(td/ceph-helpers/0) _read_fsid unparsable uuid 2026-02-18T00:37:40.247 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/ceph-helpers/0/keyring 2026-02-18T00:37:40.247 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T00:37:40.248 INFO:tasks.workunit.client.0.trial069.stdout:adding osd0 key to auth repository 2026-02-18T00:37:40.248 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-18T00:37:40.249 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/ceph-helpers/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T00:37:40.371 INFO:tasks.workunit.client.0.trial069.stdout:start osd.0 2026-02-18T00:37:40.371 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-18T00:37:40.372 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --cluster ceph --fsid=863c4e35-ceb0-4172-b7b2-c3ff099e05a2 --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/0 --osd-journal=td/ceph-helpers/0/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T00:37:40.372 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T00:37:40.372 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T00:37:40.372 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T00:37:40.396 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:37:40.386+0000 7f771288da40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:37:40.398 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:37:40.390+0000 7f771288da40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:37:40.399 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:37:40.390+0000 7f771288da40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:37:40.482 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-18T00:37:40.482 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:37:40.482 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-18T00:37:40.483 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:37:40.483 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:37:40.483 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:37:40.483 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:37:40.483 INFO:tasks.workunit.client.0.trial069.stdout:0 2026-02-18T00:37:40.484 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:37:40.484 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T00:37:40.590 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:37:40.922 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:37:40.914+0000 7f771288da40 -1 Falling back to public interface 2026-02-18T00:37:41.592 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:37:41.592 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:37:41.592 INFO:tasks.workunit.client.0.trial069.stdout:1 2026-02-18T00:37:41.592 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T00:37:41.592 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:37:41.592 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T00:37:41.702 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:37:41.932 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:37:41.922+0000 7f771288da40 -1 osd.0 0 log_to_monitors true 2026-02-18T00:37:42.703 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:37:42.703 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:37:42.703 INFO:tasks.workunit.client.0.trial069.stdout:2 2026-02-18T00:37:42.703 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-18T00:37:42.703 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:37:42.704 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T00:37:42.919 INFO:tasks.workunit.client.0.trial069.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/2983521230,v1:127.0.0.1:6801/2983521230] [v2:127.0.0.1:6802/2983521230,v1:127.0.0.1:6803/2983521230] exists,up 6e63bc55-1db8-439c-bf15-e28b4c46f913 2026-02-18T00:37:42.920 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:37:42.920 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:37:42.920 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:37:42.920 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:886: test_activate_osd: get_asok_path osd.0 2026-02-18T00:37:42.920 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-18T00:37:42.921 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-18T00:37:42.921 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:37:42.921 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:37:42.921 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:37:42.921 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.57427/ceph-osd.0.asok 2026-02-18T00:37:42.921 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:886: test_activate_osd: CEPH_ARGS= 2026-02-18T00:37:42.921 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:886: test_activate_osd: ceph --format=json daemon /tmp/ceph-asok.57427/ceph-osd.0.asok config get osd_max_backfills 2026-02-18T00:37:42.979 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:886: test_activate_osd: local 'backfills={"osd_max_backfills":"1"}' 2026-02-18T00:37:42.980 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:887: test_activate_osd: echo '{"osd_max_backfills":"1"}' 2026-02-18T00:37:42.980 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:887: test_activate_osd: grep --quiet osd_max_backfills 2026-02-18T00:37:42.980 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:889: test_activate_osd: kill_daemons td/ceph-helpers TERM osd 2026-02-18T00:37:42.981 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:37:42.981 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:37:42.982 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:37:42.982 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:37:42.982 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:37:43.291 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:37:43.291 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:891: test_activate_osd: activate_osd td/ceph-helpers 0 --osd-max-backfills 20 2026-02-18T00:37:43.291 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/ceph-helpers 2026-02-18T00:37:43.291 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-18T00:37:43.291 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-18T00:37:43.291 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-18T00:37:43.291 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/ceph-helpers/0 2026-02-18T00:37:43.291 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--cluster ceph --fsid=863c4e35-ceb0-4172-b7b2-c3ff099e05a2 --auth-supported=none --mon-host=127.0.0.1:7109 ' 2026-02-18T00:37:43.291 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T00:37:43.291 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T00:37:43.291 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T00:37:43.291 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/ceph-helpers/0' 2026-02-18T00:37:43.291 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/ceph-helpers/0/journal' 2026-02-18T00:37:43.291 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-18T00:37:43.291 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-18T00:37:43.291 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/ceph-helpers' 2026-02-18T00:37:43.291 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-18T00:37:43.291 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:37:43.291 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:37:43.291 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:37:43.291 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:37:43.291 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:37:43.292 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.57427/$cluster-$name.asok' 2026-02-18T00:37:43.292 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' 2026-02-18T00:37:43.292 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-18T00:37:43.292 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/ceph-helpers/$name.log' 2026-02-18T00:37:43.292 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/ceph-helpers/$name.pid' 2026-02-18T00:37:43.292 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T00:37:43.292 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T00:37:43.292 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T00:37:43.292 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T00:37:43.292 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-18T00:37:43.292 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+='--osd-max-backfills 20' 2026-02-18T00:37:43.292 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/ceph-helpers/0 2026-02-18T00:37:43.293 INFO:tasks.workunit.client.0.trial069.stdout:start osd.0 2026-02-18T00:37:43.294 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-18T00:37:43.294 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --cluster ceph --fsid=863c4e35-ceb0-4172-b7b2-c3ff099e05a2 --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/0 --osd-journal=td/ceph-helpers/0/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' --debug-osd=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd-max-backfills 20 2026-02-18T00:37:43.294 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/ceph-helpers/0/whoami 2026-02-18T00:37:43.295 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-18T00:37:43.296 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-18T00:37:43.296 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-18T00:37:43.296 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-18T00:37:43.313 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:37:43.306+0000 7fa0b1db0a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:37:43.315 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:37:43.306+0000 7fa0b1db0a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:37:43.315 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:37:43.306+0000 7fa0b1db0a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:37:43.507 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-18T00:37:43.508 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:37:43.508 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-18T00:37:43.508 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:37:43.508 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:37:43.508 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:37:43.508 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:37:43.508 INFO:tasks.workunit.client.0.trial069.stdout:0 2026-02-18T00:37:43.509 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:37:43.509 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T00:37:43.741 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:37:43.798 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:37:43.790+0000 7fa0b1db0a40 -1 Falling back to public interface 2026-02-18T00:37:44.404 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:37:44.394+0000 7fa0b1db0a40 -1 osd.0 5 log_to_monitors true 2026-02-18T00:37:44.742 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:37:44.742 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:37:44.743 INFO:tasks.workunit.client.0.trial069.stdout:1 2026-02-18T00:37:44.743 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T00:37:44.743 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:37:44.744 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T00:37:44.959 INFO:tasks.workunit.client.0.trial069.stdout:osd.0 up in weight 1 up_from 8 up_thru 0 down_at 6 last_clean_interval [0,0) [v2:127.0.0.1:6800/3202557935,v1:127.0.0.1:6801/3202557935] [v2:127.0.0.1:6802/3202557935,v1:127.0.0.1:6803/3202557935] exists,up 6e63bc55-1db8-439c-bf15-e28b4c46f913 2026-02-18T00:37:44.961 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:37:44.961 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:37:44.961 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:37:44.961 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:893: test_activate_osd: get_asok_path osd.0 2026-02-18T00:37:44.961 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-18T00:37:44.961 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-18T00:37:44.961 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:37:44.961 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:37:44.961 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:37:44.962 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.57427/ceph-osd.0.asok 2026-02-18T00:37:44.962 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:893: test_activate_osd: CEPH_ARGS= 2026-02-18T00:37:44.962 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:893: test_activate_osd: ceph --format=json daemon /tmp/ceph-asok.57427/ceph-osd.0.asok config get osd_max_backfills 2026-02-18T00:37:45.021 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:893: test_activate_osd: local 'backfills={"osd_max_backfills":"20"}' 2026-02-18T00:37:45.021 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:894: test_activate_osd: test '{"osd_max_backfills":"20"}' = '{"osd_max_backfills":"20"}' 2026-02-18T00:37:45.021 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:896: test_activate_osd: teardown td/ceph-helpers 2026-02-18T00:37:45.022 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/ceph-helpers 2026-02-18T00:37:45.022 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T00:37:45.022 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/ceph-helpers KILL 2026-02-18T00:37:45.022 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:37:45.022 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:37:45.022 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:37:45.022 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:37:45.022 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:37:45.129 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:37:45.129 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T00:37:45.130 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T00:37:45.130 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T00:37:45.132 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T00:37:45.132 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T00:37:45.132 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T00:37:45.133 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:37:45.133 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T00:37:45.134 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T00:37:45.134 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:37:45.135 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T00:37:45.136 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T00:37:45.136 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/ceph-helpers 2026-02-18T00:37:45.141 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T00:37:45.141 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:37:45.141 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:37:45.141 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.57427 2026-02-18T00:37:45.144 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T00:37:45.144 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T00:37:45.144 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2426: run_tests: for func in $funcs 2026-02-18T00:37:45.144 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2427: run_tests: test_activate_osd_after_mark_down td/ceph-helpers 2026-02-18T00:37:45.144 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:900: test_activate_osd_after_mark_down: local dir=td/ceph-helpers 2026-02-18T00:37:45.144 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:902: test_activate_osd_after_mark_down: setup td/ceph-helpers 2026-02-18T00:37:45.144 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/ceph-helpers 2026-02-18T00:37:45.144 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/ceph-helpers 2026-02-18T00:37:45.144 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/ceph-helpers 2026-02-18T00:37:45.144 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T00:37:45.144 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/ceph-helpers KILL 2026-02-18T00:37:45.144 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:37:45.145 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:37:45.145 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:37:45.145 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:37:45.145 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:37:45.145 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:37:45.145 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T00:37:45.146 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T00:37:45.146 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T00:37:45.147 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T00:37:45.147 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T00:37:45.148 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T00:37:45.149 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:37:45.149 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T00:37:45.149 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T00:37:45.149 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:37:45.150 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T00:37:45.151 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T00:37:45.151 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/ceph-helpers 2026-02-18T00:37:45.152 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T00:37:45.153 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:37:45.153 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:37:45.153 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.57427 2026-02-18T00:37:45.154 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T00:37:45.154 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T00:37:45.154 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/ceph-helpers 2026-02-18T00:37:45.155 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-18T00:37:45.155 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:37:45.156 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:37:45.156 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.57427 2026-02-18T00:37:45.157 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-18T00:37:45.158 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-18T00:37:45.158 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-18T00:37:45.158 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/ceph-helpers 1' TERM HUP INT 2026-02-18T00:37:45.158 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:904: test_activate_osd_after_mark_down: run_mon td/ceph-helpers a 2026-02-18T00:37:45.159 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/ceph-helpers 2026-02-18T00:37:45.159 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-18T00:37:45.159 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-18T00:37:45.159 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-18T00:37:45.159 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/ceph-helpers/a 2026-02-18T00:37:45.159 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/ceph-helpers/a --run-dir=td/ceph-helpers 2026-02-18T00:37:45.179 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-18T00:37:45.179 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:37:45.180 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:37:45.180 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:37:45.180 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:37:45.180 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:37:45.180 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.57427/$cluster-$name.asok' 2026-02-18T00:37:45.181 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/ceph-helpers/a '--log-file=td/ceph-helpers/$name.log' '--admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' --mon-cluster-log-file=td/ceph-helpers/log --run-dir=td/ceph-helpers '--pid-file=td/ceph-helpers/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-18T00:37:45.208 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-18T00:37:45.209 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-18T00:37:45.209 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T00:37:45.209 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-18T00:37:45.209 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-18T00:37:45.210 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-18T00:37:45.210 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-18T00:37:45.210 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:37:45.211 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:37:45.211 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:37:45.211 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:37:45.211 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:37:45.211 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.57427/ceph-mon.a.asok 2026-02-18T00:37:45.211 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T00:37:45.211 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.57427/ceph-mon.a.asok config get fsid 2026-02-18T00:37:45.273 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-18T00:37:45.273 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T00:37:45.273 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-18T00:37:45.273 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-18T00:37:45.273 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-18T00:37:45.274 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-18T00:37:45.274 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:37:45.274 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:37:45.275 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:37:45.275 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:37:45.275 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:37:45.275 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.57427/ceph-mon.a.asok 2026-02-18T00:37:45.275 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T00:37:45.275 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.57427/ceph-mon.a.asok config get mon_host 2026-02-18T00:37:45.328 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:905: test_activate_osd_after_mark_down: run_mgr td/ceph-helpers x 2026-02-18T00:37:45.328 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/ceph-helpers 2026-02-18T00:37:45.329 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-18T00:37:45.329 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-18T00:37:45.329 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-18T00:37:45.329 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/ceph-helpers/x 2026-02-18T00:37:45.329 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-18T00:37:45.438 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-18T00:37:45.439 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:37:45.439 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:37:45.439 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:37:45.439 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:37:45.439 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:37:45.439 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.57427/$cluster-$name.asok' 2026-02-18T00:37:45.439 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-18T00:37:45.440 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/ceph-helpers/x '--log-file=td/ceph-helpers/$name.log' '--admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' --run-dir=td/ceph-helpers '--pid-file=td/ceph-helpers/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-18T00:37:45.463 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:907: test_activate_osd_after_mark_down: run_osd td/ceph-helpers 0 2026-02-18T00:37:45.463 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/ceph-helpers 2026-02-18T00:37:45.463 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T00:37:45.463 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-18T00:37:45.463 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T00:37:45.463 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/ceph-helpers/0 2026-02-18T00:37:45.463 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--cluster ceph --fsid=863c4e35-ceb0-4172-b7b2-c3ff099e05a2 --auth-supported=none --mon-host=127.0.0.1:7109 ' 2026-02-18T00:37:45.463 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T00:37:45.463 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T00:37:45.464 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T00:37:45.464 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/ceph-helpers/0' 2026-02-18T00:37:45.464 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/ceph-helpers/0/journal' 2026-02-18T00:37:45.464 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T00:37:45.464 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-18T00:37:45.464 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/ceph-helpers' 2026-02-18T00:37:45.464 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T00:37:45.464 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:37:45.464 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:37:45.464 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:37:45.464 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:37:45.464 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:37:45.465 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.57427/$cluster-$name.asok' 2026-02-18T00:37:45.465 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' 2026-02-18T00:37:45.465 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T00:37:45.465 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T00:37:45.465 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T00:37:45.465 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/ceph-helpers/$name.log' 2026-02-18T00:37:45.465 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/ceph-helpers/$name.pid' 2026-02-18T00:37:45.465 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T00:37:45.465 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T00:37:45.465 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T00:37:45.465 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T00:37:45.465 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T00:37:45.465 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-18T00:37:45.466 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/ceph-helpers/0 2026-02-18T00:37:45.466 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T00:37:45.466 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=cc5e44c0-c1b1-4f77-950e-bef486f895b9 2026-02-18T00:37:45.466 INFO:tasks.workunit.client.0.trial069.stdout:add osd0 cc5e44c0-c1b1-4f77-950e-bef486f895b9 2026-02-18T00:37:45.467 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 cc5e44c0-c1b1-4f77-950e-bef486f895b9' 2026-02-18T00:37:45.467 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T00:37:45.478 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDZCZVpbMktHBAA8t6jYPPes5N80Krk9OhW1Q== 2026-02-18T00:37:45.478 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDZCZVpbMktHBAA8t6jYPPes5N80Krk9OhW1Q=="}' 2026-02-18T00:37:45.478 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new cc5e44c0-c1b1-4f77-950e-bef486f895b9 -i td/ceph-helpers/0/new.json 2026-02-18T00:37:45.594 INFO:tasks.workunit.client.0.trial069.stdout:0 2026-02-18T00:37:45.602 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/ceph-helpers/0/new.json 2026-02-18T00:37:45.603 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --cluster ceph --fsid=863c4e35-ceb0-4172-b7b2-c3ff099e05a2 --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/0 --osd-journal=td/ceph-helpers/0/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDZCZVpbMktHBAA8t6jYPPes5N80Krk9OhW1Q== --osd-uuid cc5e44c0-c1b1-4f77-950e-bef486f895b9 2026-02-18T00:37:45.619 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:37:45.610+0000 7fc88def0a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:37:45.620 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:37:45.610+0000 7fc88def0a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:37:45.621 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:37:45.614+0000 7fc88def0a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:37:45.621 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:37:45.614+0000 7fc88def0a40 -1 bdev(0x5616fe3ccc00 td/ceph-helpers/0/block) open stat got: (1) Operation not permitted 2026-02-18T00:37:45.622 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:37:45.614+0000 7fc88def0a40 -1 bluestore(td/ceph-helpers/0) _read_fsid unparsable uuid 2026-02-18T00:37:46.368 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/ceph-helpers/0/keyring 2026-02-18T00:37:46.369 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T00:37:46.369 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-18T00:37:46.370 INFO:tasks.workunit.client.0.trial069.stdout:adding osd0 key to auth repository 2026-02-18T00:37:46.370 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/ceph-helpers/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T00:37:46.494 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-18T00:37:46.494 INFO:tasks.workunit.client.0.trial069.stdout:start osd.0 2026-02-18T00:37:46.495 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --cluster ceph --fsid=863c4e35-ceb0-4172-b7b2-c3ff099e05a2 --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/0 --osd-journal=td/ceph-helpers/0/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T00:37:46.495 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T00:37:46.495 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T00:37:46.495 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T00:37:46.517 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:37:46.510+0000 7f452a988a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:37:46.520 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:37:46.510+0000 7f452a988a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:37:46.521 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:37:46.514+0000 7f452a988a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:37:46.602 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-18T00:37:46.602 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:37:46.602 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-18T00:37:46.602 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:37:46.602 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:37:46.602 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:37:46.602 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:37:46.603 INFO:tasks.workunit.client.0.trial069.stdout:0 2026-02-18T00:37:46.603 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:37:46.603 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T00:37:46.708 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:37:46.950 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:37:46.942+0000 7f452a988a40 -1 Falling back to public interface 2026-02-18T00:37:47.709 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:37:47.709 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:37:47.710 INFO:tasks.workunit.client.0.trial069.stdout:1 2026-02-18T00:37:47.710 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T00:37:47.711 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:37:47.711 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T00:37:47.816 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:37:47.952 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:37:47.941+0000 7f452a988a40 -1 osd.0 0 log_to_monitors true 2026-02-18T00:37:48.817 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:37:48.817 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:37:48.818 INFO:tasks.workunit.client.0.trial069.stdout:2 2026-02-18T00:37:48.818 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-18T00:37:48.818 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:37:48.819 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T00:37:49.027 INFO:tasks.workunit.client.0.trial069.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/1781445215,v1:127.0.0.1:6801/1781445215] [v2:127.0.0.1:6802/1781445215,v1:127.0.0.1:6803/1781445215] exists,up cc5e44c0-c1b1-4f77-950e-bef486f895b9 2026-02-18T00:37:49.027 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:37:49.027 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:37:49.028 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:37:49.029 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:909: test_activate_osd_after_mark_down: get_asok_path osd.0 2026-02-18T00:37:49.029 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-18T00:37:49.029 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-18T00:37:49.029 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:37:49.029 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:37:49.029 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:37:49.029 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.57427/ceph-osd.0.asok 2026-02-18T00:37:49.029 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:909: test_activate_osd_after_mark_down: CEPH_ARGS= 2026-02-18T00:37:49.029 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:909: test_activate_osd_after_mark_down: ceph --format=json daemon /tmp/ceph-asok.57427/ceph-osd.0.asok config get osd_max_backfills 2026-02-18T00:37:49.086 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:909: test_activate_osd_after_mark_down: local 'backfills={"osd_max_backfills":"1"}' 2026-02-18T00:37:49.087 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:910: test_activate_osd_after_mark_down: echo '{"osd_max_backfills":"1"}' 2026-02-18T00:37:49.087 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:910: test_activate_osd_after_mark_down: grep --quiet osd_max_backfills 2026-02-18T00:37:49.088 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:912: test_activate_osd_after_mark_down: kill_daemons td/ceph-helpers TERM osd 2026-02-18T00:37:49.089 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:37:49.089 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:37:49.089 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:37:49.089 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:37:49.090 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:37:49.398 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:37:49.398 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:913: test_activate_osd_after_mark_down: ceph osd down 0 2026-02-18T00:37:49.609 INFO:tasks.workunit.client.0.trial069.stderr:osd.0 is already down. 2026-02-18T00:37:49.621 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:914: test_activate_osd_after_mark_down: wait_for_osd down 0 2026-02-18T00:37:49.621 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=down 2026-02-18T00:37:49.621 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-18T00:37:49.621 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:37:49.621 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:37:49.621 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:37:49.621 INFO:tasks.workunit.client.0.trial069.stdout:0 2026-02-18T00:37:49.622 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:37:49.622 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:37:49.622 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 down' 2026-02-18T00:37:49.833 INFO:tasks.workunit.client.0.trial069.stdout:osd.0 down in weight 1 up_from 5 up_thru 0 down_at 7 last_clean_interval [0,0) [v2:127.0.0.1:6800/1781445215,v1:127.0.0.1:6801/1781445215] [v2:127.0.0.1:6802/1781445215,v1:127.0.0.1:6803/1781445215] exists cc5e44c0-c1b1-4f77-950e-bef486f895b9 2026-02-18T00:37:49.837 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:37:49.838 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:37:49.838 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:37:49.838 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: test_activate_osd_after_mark_down: activate_osd td/ceph-helpers 0 --osd-max-backfills 20 2026-02-18T00:37:49.838 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/ceph-helpers 2026-02-18T00:37:49.838 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-18T00:37:49.838 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-18T00:37:49.838 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-18T00:37:49.838 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/ceph-helpers/0 2026-02-18T00:37:49.838 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--cluster ceph --fsid=863c4e35-ceb0-4172-b7b2-c3ff099e05a2 --auth-supported=none --mon-host=127.0.0.1:7109 ' 2026-02-18T00:37:49.838 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T00:37:49.839 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T00:37:49.839 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T00:37:49.839 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/ceph-helpers/0' 2026-02-18T00:37:49.839 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/ceph-helpers/0/journal' 2026-02-18T00:37:49.839 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-18T00:37:49.839 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-18T00:37:49.839 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/ceph-helpers' 2026-02-18T00:37:49.839 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-18T00:37:49.839 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:37:49.839 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:37:49.839 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:37:49.840 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:37:49.840 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:37:49.840 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.57427/$cluster-$name.asok' 2026-02-18T00:37:49.840 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' 2026-02-18T00:37:49.840 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-18T00:37:49.840 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/ceph-helpers/$name.log' 2026-02-18T00:37:49.840 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/ceph-helpers/$name.pid' 2026-02-18T00:37:49.840 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T00:37:49.840 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T00:37:49.840 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T00:37:49.841 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T00:37:49.841 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-18T00:37:49.841 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+='--osd-max-backfills 20' 2026-02-18T00:37:49.841 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/ceph-helpers/0 2026-02-18T00:37:49.841 INFO:tasks.workunit.client.0.trial069.stdout:start osd.0 2026-02-18T00:37:49.842 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-18T00:37:49.842 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --cluster ceph --fsid=863c4e35-ceb0-4172-b7b2-c3ff099e05a2 --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/0 --osd-journal=td/ceph-helpers/0/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' --debug-osd=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd-max-backfills 20 2026-02-18T00:37:49.843 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/ceph-helpers/0/whoami 2026-02-18T00:37:49.843 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-18T00:37:49.843 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-18T00:37:49.843 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-18T00:37:49.843 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-18T00:37:49.853 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:37:49.845+0000 7f54ab58ba40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:37:49.854 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:37:49.845+0000 7f54ab58ba40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:37:49.855 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:37:49.845+0000 7f54ab58ba40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:37:50.051 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-18T00:37:50.051 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:37:50.052 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-18T00:37:50.052 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:37:50.052 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:37:50.052 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:37:50.052 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:37:50.052 INFO:tasks.workunit.client.0.trial069.stdout:0 2026-02-18T00:37:50.053 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:37:50.053 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T00:37:50.259 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:37:50.346 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:37:50.337+0000 7f54ab58ba40 -1 Falling back to public interface 2026-02-18T00:37:50.974 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:37:50.965+0000 7f54ab58ba40 -1 osd.0 6 log_to_monitors true 2026-02-18T00:37:51.261 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:37:51.261 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:37:51.261 INFO:tasks.workunit.client.0.trial069.stdout:1 2026-02-18T00:37:51.262 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T00:37:51.262 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:37:51.262 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T00:37:51.470 INFO:tasks.workunit.client.0.trial069.stdout:osd.0 up in weight 1 up_from 9 up_thru 0 down_at 7 last_clean_interval [5,6) [v2:127.0.0.1:6800/874835072,v1:127.0.0.1:6801/874835072] [v2:127.0.0.1:6802/874835072,v1:127.0.0.1:6803/874835072] exists,up cc5e44c0-c1b1-4f77-950e-bef486f895b9 2026-02-18T00:37:51.471 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:37:51.471 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:37:51.471 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:37:51.471 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:918: test_activate_osd_after_mark_down: get_asok_path osd.0 2026-02-18T00:37:51.471 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-18T00:37:51.471 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-18T00:37:51.472 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:37:51.472 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:37:51.472 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:37:51.472 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.57427/ceph-osd.0.asok 2026-02-18T00:37:51.472 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:918: test_activate_osd_after_mark_down: CEPH_ARGS= 2026-02-18T00:37:51.472 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:918: test_activate_osd_after_mark_down: ceph --format=json daemon /tmp/ceph-asok.57427/ceph-osd.0.asok config get osd_max_backfills 2026-02-18T00:37:51.530 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:918: test_activate_osd_after_mark_down: local 'backfills={"osd_max_backfills":"20"}' 2026-02-18T00:37:51.530 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: test_activate_osd_after_mark_down: test '{"osd_max_backfills":"20"}' = '{"osd_max_backfills":"20"}' 2026-02-18T00:37:51.530 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: test_activate_osd_after_mark_down: teardown td/ceph-helpers 2026-02-18T00:37:51.530 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/ceph-helpers 2026-02-18T00:37:51.530 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T00:37:51.530 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/ceph-helpers KILL 2026-02-18T00:37:51.531 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:37:51.531 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:37:51.531 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:37:51.531 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:37:51.531 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:37:51.639 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:37:51.639 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T00:37:51.640 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T00:37:51.640 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T00:37:51.641 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T00:37:51.641 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T00:37:51.642 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T00:37:51.643 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:37:51.643 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T00:37:51.643 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T00:37:51.643 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:37:51.644 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T00:37:51.645 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T00:37:51.646 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/ceph-helpers 2026-02-18T00:37:51.651 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T00:37:51.651 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:37:51.651 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:37:51.651 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.57427 2026-02-18T00:37:51.653 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T00:37:51.653 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T00:37:51.653 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2426: run_tests: for func in $funcs 2026-02-18T00:37:51.654 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2427: run_tests: test_activate_osd_skip_benchmark td/ceph-helpers 2026-02-18T00:37:51.654 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: test_activate_osd_skip_benchmark: local dir=td/ceph-helpers 2026-02-18T00:37:51.654 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:927: test_activate_osd_skip_benchmark: setup td/ceph-helpers 2026-02-18T00:37:51.654 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/ceph-helpers 2026-02-18T00:37:51.654 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/ceph-helpers 2026-02-18T00:37:51.654 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/ceph-helpers 2026-02-18T00:37:51.654 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T00:37:51.654 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/ceph-helpers KILL 2026-02-18T00:37:51.654 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:37:51.654 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:37:51.654 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:37:51.655 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:37:51.655 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:37:51.655 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:37:51.656 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T00:37:51.656 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T00:37:51.657 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T00:37:51.658 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T00:37:51.658 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T00:37:51.658 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T00:37:51.659 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:37:51.659 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T00:37:51.660 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T00:37:51.660 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:37:51.661 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T00:37:51.662 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T00:37:51.662 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/ceph-helpers 2026-02-18T00:37:51.663 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T00:37:51.664 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:37:51.664 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:37:51.664 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.57427 2026-02-18T00:37:51.665 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T00:37:51.665 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T00:37:51.665 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/ceph-helpers 2026-02-18T00:37:51.666 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-18T00:37:51.666 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:37:51.666 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:37:51.666 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.57427 2026-02-18T00:37:51.668 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-18T00:37:51.669 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-18T00:37:51.669 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-18T00:37:51.669 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/ceph-helpers 1' TERM HUP INT 2026-02-18T00:37:51.669 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: test_activate_osd_skip_benchmark: run_mon td/ceph-helpers a 2026-02-18T00:37:51.669 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/ceph-helpers 2026-02-18T00:37:51.669 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-18T00:37:51.669 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-18T00:37:51.670 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-18T00:37:51.670 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/ceph-helpers/a 2026-02-18T00:37:51.670 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/ceph-helpers/a --run-dir=td/ceph-helpers 2026-02-18T00:37:51.691 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-18T00:37:51.691 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:37:51.691 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:37:51.691 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:37:51.691 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:37:51.691 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:37:51.691 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.57427/$cluster-$name.asok' 2026-02-18T00:37:51.692 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/ceph-helpers/a '--log-file=td/ceph-helpers/$name.log' '--admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' --mon-cluster-log-file=td/ceph-helpers/log --run-dir=td/ceph-helpers '--pid-file=td/ceph-helpers/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-18T00:37:51.720 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-18T00:37:51.720 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-18T00:37:51.721 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T00:37:51.721 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-18T00:37:51.721 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-18T00:37:51.721 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-18T00:37:51.722 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-18T00:37:51.722 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:37:51.722 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:37:51.722 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:37:51.722 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:37:51.722 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:37:51.723 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.57427/ceph-mon.a.asok 2026-02-18T00:37:51.723 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T00:37:51.723 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.57427/ceph-mon.a.asok config get fsid 2026-02-18T00:37:51.777 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-18T00:37:51.777 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T00:37:51.777 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-18T00:37:51.778 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-18T00:37:51.778 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-18T00:37:51.778 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-18T00:37:51.778 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:37:51.778 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:37:51.778 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:37:51.778 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:37:51.778 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:37:51.778 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.57427/ceph-mon.a.asok 2026-02-18T00:37:51.779 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T00:37:51.779 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.57427/ceph-mon.a.asok config get mon_host 2026-02-18T00:37:51.831 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:930: test_activate_osd_skip_benchmark: run_mgr td/ceph-helpers x 2026-02-18T00:37:51.831 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/ceph-helpers 2026-02-18T00:37:51.831 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-18T00:37:51.832 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-18T00:37:51.832 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-18T00:37:51.832 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/ceph-helpers/x 2026-02-18T00:37:51.832 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-18T00:37:51.943 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-18T00:37:51.943 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:37:51.944 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:37:51.944 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:37:51.944 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:37:51.944 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:37:51.944 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.57427/$cluster-$name.asok' 2026-02-18T00:37:51.944 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-18T00:37:51.945 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/ceph-helpers/x '--log-file=td/ceph-helpers/$name.log' '--admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' --run-dir=td/ceph-helpers '--pid-file=td/ceph-helpers/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-18T00:37:51.965 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:933: test_activate_osd_skip_benchmark: run_osd td/ceph-helpers 0 --osd-op-queue=mclock_scheduler --osd-mclock-skip-benchmark=true 2026-02-18T00:37:51.965 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/ceph-helpers 2026-02-18T00:37:51.965 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T00:37:51.965 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-18T00:37:51.965 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T00:37:51.965 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/ceph-helpers/0 2026-02-18T00:37:51.966 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--cluster ceph --fsid=863c4e35-ceb0-4172-b7b2-c3ff099e05a2 --auth-supported=none --mon-host=127.0.0.1:7109 ' 2026-02-18T00:37:51.966 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T00:37:51.966 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T00:37:51.966 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T00:37:51.966 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/ceph-helpers/0' 2026-02-18T00:37:51.966 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/ceph-helpers/0/journal' 2026-02-18T00:37:51.966 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T00:37:51.966 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-18T00:37:51.966 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/ceph-helpers' 2026-02-18T00:37:51.966 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T00:37:51.966 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:37:51.967 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:37:51.967 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:37:51.967 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:37:51.967 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:37:51.967 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.57427/$cluster-$name.asok' 2026-02-18T00:37:51.967 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' 2026-02-18T00:37:51.967 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T00:37:51.967 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T00:37:51.967 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T00:37:51.967 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/ceph-helpers/$name.log' 2026-02-18T00:37:51.967 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/ceph-helpers/$name.pid' 2026-02-18T00:37:51.967 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T00:37:51.967 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T00:37:51.968 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T00:37:51.968 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T00:37:51.968 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T00:37:51.968 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+='--osd-op-queue=mclock_scheduler --osd-mclock-skip-benchmark=true' 2026-02-18T00:37:51.968 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/ceph-helpers/0 2026-02-18T00:37:51.969 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T00:37:51.969 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=be7f6ca8-9113-4207-b1db-6377ecfb59ee 2026-02-18T00:37:51.969 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 be7f6ca8-9113-4207-b1db-6377ecfb59ee' 2026-02-18T00:37:51.969 INFO:tasks.workunit.client.0.trial069.stdout:add osd0 be7f6ca8-9113-4207-b1db-6377ecfb59ee 2026-02-18T00:37:51.969 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T00:37:51.977 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDfCZVpiJzmORAAwEUSCFT7QFIs+MdPG4ujtQ== 2026-02-18T00:37:51.977 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDfCZVpiJzmORAAwEUSCFT7QFIs+MdPG4ujtQ=="}' 2026-02-18T00:37:51.977 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new be7f6ca8-9113-4207-b1db-6377ecfb59ee -i td/ceph-helpers/0/new.json 2026-02-18T00:37:52.089 INFO:tasks.workunit.client.0.trial069.stdout:0 2026-02-18T00:37:52.097 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/ceph-helpers/0/new.json 2026-02-18T00:37:52.098 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --cluster ceph --fsid=863c4e35-ceb0-4172-b7b2-c3ff099e05a2 --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/0 --osd-journal=td/ceph-helpers/0/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd-op-queue=mclock_scheduler --osd-mclock-skip-benchmark=true --mkfs --key AQDfCZVpiJzmORAAwEUSCFT7QFIs+MdPG4ujtQ== --osd-uuid be7f6ca8-9113-4207-b1db-6377ecfb59ee 2026-02-18T00:37:52.114 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:37:52.105+0000 7f87f09d1a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:37:52.115 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:37:52.105+0000 7f87f09d1a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:37:52.116 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:37:52.105+0000 7f87f09d1a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:37:52.116 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:37:52.105+0000 7f87f09d1a40 -1 bdev(0x5624f126ec00 td/ceph-helpers/0/block) open stat got: (1) Operation not permitted 2026-02-18T00:37:52.116 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:37:52.109+0000 7f87f09d1a40 -1 bluestore(td/ceph-helpers/0) _read_fsid unparsable uuid 2026-02-18T00:37:52.772 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/ceph-helpers/0/keyring 2026-02-18T00:37:52.772 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T00:37:52.773 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-18T00:37:52.773 INFO:tasks.workunit.client.0.trial069.stdout:adding osd0 key to auth repository 2026-02-18T00:37:52.773 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/ceph-helpers/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T00:37:52.888 INFO:tasks.workunit.client.0.trial069.stdout:start osd.0 2026-02-18T00:37:52.889 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-18T00:37:52.889 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --cluster ceph --fsid=863c4e35-ceb0-4172-b7b2-c3ff099e05a2 --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/0 --osd-journal=td/ceph-helpers/0/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd-op-queue=mclock_scheduler --osd-mclock-skip-benchmark=true 2026-02-18T00:37:52.889 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T00:37:52.889 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T00:37:52.889 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T00:37:52.903 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:37:52.893+0000 7fbee734ca40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:37:52.905 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:37:52.897+0000 7fbee734ca40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:37:52.906 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:37:52.897+0000 7fbee734ca40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:37:53.000 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-18T00:37:53.000 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:37:53.000 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-18T00:37:53.000 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:37:53.000 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:37:53.000 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:37:53.000 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:37:53.001 INFO:tasks.workunit.client.0.trial069.stdout:0 2026-02-18T00:37:53.001 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:37:53.001 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T00:37:53.110 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:37:53.330 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:37:53.321+0000 7fbee734ca40 -1 Falling back to public interface 2026-02-18T00:37:53.965 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:37:53.957+0000 7fbee734ca40 -1 osd.0 0 log_to_monitors true 2026-02-18T00:37:54.111 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:37:54.112 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:37:54.112 INFO:tasks.workunit.client.0.trial069.stdout:1 2026-02-18T00:37:54.112 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T00:37:54.114 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T00:37:54.114 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:37:54.220 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:37:55.222 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:37:55.222 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:37:55.222 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-18T00:37:55.222 INFO:tasks.workunit.client.0.trial069.stdout:2 2026-02-18T00:37:55.222 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:37:55.222 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T00:37:55.428 INFO:tasks.workunit.client.0.trial069.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/1392792959,v1:127.0.0.1:6801/1392792959] [v2:127.0.0.1:6802/1392792959,v1:127.0.0.1:6803/1392792959] exists,up be7f6ca8-9113-4207-b1db-6377ecfb59ee 2026-02-18T00:37:55.428 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:37:55.429 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:37:55.429 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:37:55.429 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:936: test_activate_osd_skip_benchmark: get_asok_path osd.0 2026-02-18T00:37:55.429 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-18T00:37:55.429 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-18T00:37:55.430 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:37:55.430 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:37:55.430 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:37:55.430 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.57427/ceph-osd.0.asok 2026-02-18T00:37:55.430 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:936: test_activate_osd_skip_benchmark: CEPH_ARGS= 2026-02-18T00:37:55.430 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:936: test_activate_osd_skip_benchmark: ceph --format=json daemon /tmp/ceph-asok.57427/ceph-osd.0.asok config get osd_mclock_max_capacity_iops_hdd 2026-02-18T00:37:55.488 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:936: test_activate_osd_skip_benchmark: local 'max_iops_hdd_def={"osd_mclock_max_capacity_iops_hdd":"315.000000"}' 2026-02-18T00:37:55.489 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:938: test_activate_osd_skip_benchmark: get_asok_path osd.0 2026-02-18T00:37:55.489 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-18T00:37:55.489 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-18T00:37:55.490 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:37:55.490 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:37:55.490 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:37:55.490 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.57427/ceph-osd.0.asok 2026-02-18T00:37:55.490 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:938: test_activate_osd_skip_benchmark: CEPH_ARGS= 2026-02-18T00:37:55.490 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:938: test_activate_osd_skip_benchmark: ceph --format=json daemon /tmp/ceph-asok.57427/ceph-osd.0.asok config get osd_mclock_max_capacity_iops_ssd 2026-02-18T00:37:55.551 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:938: test_activate_osd_skip_benchmark: local 'max_iops_ssd_def={"osd_mclock_max_capacity_iops_ssd":"21500.000000"}' 2026-02-18T00:37:55.551 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:940: test_activate_osd_skip_benchmark: kill_daemons td/ceph-helpers TERM osd 2026-02-18T00:37:55.552 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:37:55.552 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:37:55.552 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:37:55.553 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:37:55.553 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:37:55.860 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:37:55.860 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:941: test_activate_osd_skip_benchmark: ceph osd down 0 2026-02-18T00:37:56.072 INFO:tasks.workunit.client.0.trial069.stderr:osd.0 is already down. 2026-02-18T00:37:56.083 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:942: test_activate_osd_skip_benchmark: wait_for_osd down 0 2026-02-18T00:37:56.083 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=down 2026-02-18T00:37:56.084 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-18T00:37:56.084 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:37:56.084 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:37:56.084 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:37:56.084 INFO:tasks.workunit.client.0.trial069.stdout:0 2026-02-18T00:37:56.085 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:37:56.085 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:37:56.085 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 down' 2026-02-18T00:37:56.302 INFO:tasks.workunit.client.0.trial069.stdout:osd.0 down in weight 1 up_from 5 up_thru 0 down_at 6 last_clean_interval [0,0) [v2:127.0.0.1:6800/1392792959,v1:127.0.0.1:6801/1392792959] [v2:127.0.0.1:6802/1392792959,v1:127.0.0.1:6803/1392792959] exists be7f6ca8-9113-4207-b1db-6377ecfb59ee 2026-02-18T00:37:56.305 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:37:56.305 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:37:56.305 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:37:56.305 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:946: test_activate_osd_skip_benchmark: activate_osd td/ceph-helpers 0 --osd-op-queue=mclock_scheduler --osd-mclock-skip-benchmark=true 2026-02-18T00:37:56.305 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/ceph-helpers 2026-02-18T00:37:56.306 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-18T00:37:56.306 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-18T00:37:56.306 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-18T00:37:56.306 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/ceph-helpers/0 2026-02-18T00:37:56.306 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--cluster ceph --fsid=863c4e35-ceb0-4172-b7b2-c3ff099e05a2 --auth-supported=none --mon-host=127.0.0.1:7109 ' 2026-02-18T00:37:56.306 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T00:37:56.306 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T00:37:56.306 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T00:37:56.306 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/ceph-helpers/0' 2026-02-18T00:37:56.306 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/ceph-helpers/0/journal' 2026-02-18T00:37:56.306 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-18T00:37:56.306 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-18T00:37:56.307 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/ceph-helpers' 2026-02-18T00:37:56.307 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-18T00:37:56.307 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:37:56.307 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:37:56.307 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:37:56.307 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:37:56.307 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:37:56.307 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.57427/$cluster-$name.asok' 2026-02-18T00:37:56.307 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' 2026-02-18T00:37:56.307 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-18T00:37:56.307 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/ceph-helpers/$name.log' 2026-02-18T00:37:56.307 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/ceph-helpers/$name.pid' 2026-02-18T00:37:56.308 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T00:37:56.308 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T00:37:56.308 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T00:37:56.308 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T00:37:56.308 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-18T00:37:56.308 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+='--osd-op-queue=mclock_scheduler --osd-mclock-skip-benchmark=true' 2026-02-18T00:37:56.308 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/ceph-helpers/0 2026-02-18T00:37:56.308 INFO:tasks.workunit.client.0.trial069.stdout:start osd.0 2026-02-18T00:37:56.309 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-18T00:37:56.309 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --cluster ceph --fsid=863c4e35-ceb0-4172-b7b2-c3ff099e05a2 --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/0 --osd-journal=td/ceph-helpers/0/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' --debug-osd=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd-op-queue=mclock_scheduler --osd-mclock-skip-benchmark=true 2026-02-18T00:37:56.309 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/ceph-helpers/0/whoami 2026-02-18T00:37:56.310 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-18T00:37:56.310 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-18T00:37:56.310 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-18T00:37:56.310 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-18T00:37:56.325 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:37:56.317+0000 7fd0a62faa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:37:56.326 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:37:56.317+0000 7fd0a62faa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:37:56.327 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:37:56.317+0000 7fd0a62faa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:37:56.524 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-18T00:37:56.525 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:37:56.525 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-18T00:37:56.525 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:37:56.525 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:37:56.525 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:37:56.525 INFO:tasks.workunit.client.0.trial069.stdout:0 2026-02-18T00:37:56.526 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:37:56.526 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:37:56.526 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T00:37:56.650 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:37:56.641+0000 7fd0a62faa40 -1 Falling back to public interface 2026-02-18T00:37:56.740 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:37:57.257 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:37:57.245+0000 7fd0a62faa40 -1 osd.0 6 log_to_monitors true 2026-02-18T00:37:57.741 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:37:57.741 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:37:57.741 INFO:tasks.workunit.client.0.trial069.stdout:1 2026-02-18T00:37:57.742 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T00:37:57.742 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:37:57.742 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T00:37:57.949 INFO:tasks.workunit.client.0.trial069.stdout:osd.0 up in weight 1 up_from 9 up_thru 0 down_at 6 last_clean_interval [5,6) [v2:127.0.0.1:6800/441844280,v1:127.0.0.1:6801/441844280] [v2:127.0.0.1:6802/441844280,v1:127.0.0.1:6803/441844280] exists,up be7f6ca8-9113-4207-b1db-6377ecfb59ee 2026-02-18T00:37:57.950 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:37:57.950 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:37:57.950 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:37:57.952 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:949: test_activate_osd_skip_benchmark: get_asok_path osd.0 2026-02-18T00:37:57.952 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-18T00:37:57.952 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-18T00:37:57.952 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:37:57.952 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:37:57.952 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:37:57.952 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.57427/ceph-osd.0.asok 2026-02-18T00:37:57.952 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:949: test_activate_osd_skip_benchmark: CEPH_ARGS= 2026-02-18T00:37:57.952 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:949: test_activate_osd_skip_benchmark: ceph --format=json daemon /tmp/ceph-asok.57427/ceph-osd.0.asok config get osd_mclock_max_capacity_iops_hdd 2026-02-18T00:37:58.009 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:949: test_activate_osd_skip_benchmark: local 'max_iops_hdd_after_boot={"osd_mclock_max_capacity_iops_hdd":"315.000000"}' 2026-02-18T00:37:58.010 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:951: test_activate_osd_skip_benchmark: get_asok_path osd.0 2026-02-18T00:37:58.010 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-18T00:37:58.010 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-18T00:37:58.011 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:37:58.011 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:37:58.011 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:37:58.011 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.57427/ceph-osd.0.asok 2026-02-18T00:37:58.011 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:951: test_activate_osd_skip_benchmark: CEPH_ARGS= 2026-02-18T00:37:58.011 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:951: test_activate_osd_skip_benchmark: ceph --format=json daemon /tmp/ceph-asok.57427/ceph-osd.0.asok config get osd_mclock_max_capacity_iops_ssd 2026-02-18T00:37:58.073 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:951: test_activate_osd_skip_benchmark: local 'max_iops_ssd_after_boot={"osd_mclock_max_capacity_iops_ssd":"21500.000000"}' 2026-02-18T00:37:58.073 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:953: test_activate_osd_skip_benchmark: test '{"osd_mclock_max_capacity_iops_hdd":"315.000000"}' = '{"osd_mclock_max_capacity_iops_hdd":"315.000000"}' 2026-02-18T00:37:58.073 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:954: test_activate_osd_skip_benchmark: test '{"osd_mclock_max_capacity_iops_ssd":"21500.000000"}' = '{"osd_mclock_max_capacity_iops_ssd":"21500.000000"}' 2026-02-18T00:37:58.073 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:956: test_activate_osd_skip_benchmark: teardown td/ceph-helpers 2026-02-18T00:37:58.073 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/ceph-helpers 2026-02-18T00:37:58.073 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T00:37:58.073 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/ceph-helpers KILL 2026-02-18T00:37:58.073 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:37:58.073 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:37:58.073 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:37:58.074 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:37:58.074 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:37:58.181 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:37:58.181 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T00:37:58.182 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T00:37:58.182 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T00:37:58.183 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T00:37:58.184 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T00:37:58.184 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T00:37:58.185 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:37:58.185 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T00:37:58.186 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T00:37:58.186 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:37:58.187 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T00:37:58.188 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T00:37:58.188 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/ceph-helpers 2026-02-18T00:37:58.192 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T00:37:58.192 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:37:58.192 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:37:58.193 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.57427 2026-02-18T00:37:58.195 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T00:37:58.195 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T00:37:58.195 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2426: run_tests: for func in $funcs 2026-02-18T00:37:58.195 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2427: run_tests: test_destroy_osd td/ceph-helpers 2026-02-18T00:37:58.195 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:787: test_destroy_osd: local dir=td/ceph-helpers 2026-02-18T00:37:58.195 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:789: test_destroy_osd: setup td/ceph-helpers 2026-02-18T00:37:58.195 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/ceph-helpers 2026-02-18T00:37:58.195 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/ceph-helpers 2026-02-18T00:37:58.196 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/ceph-helpers 2026-02-18T00:37:58.196 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T00:37:58.196 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/ceph-helpers KILL 2026-02-18T00:37:58.196 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:37:58.196 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:37:58.196 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:37:58.196 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:37:58.196 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:37:58.197 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:37:58.197 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T00:37:58.198 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T00:37:58.198 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T00:37:58.199 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T00:37:58.199 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T00:37:58.200 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T00:37:58.201 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:37:58.201 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T00:37:58.201 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T00:37:58.201 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:37:58.202 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T00:37:58.203 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T00:37:58.203 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/ceph-helpers 2026-02-18T00:37:58.204 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T00:37:58.205 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:37:58.205 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:37:58.205 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.57427 2026-02-18T00:37:58.206 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T00:37:58.206 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T00:37:58.206 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/ceph-helpers 2026-02-18T00:37:58.207 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-18T00:37:58.207 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:37:58.208 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:37:58.208 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.57427 2026-02-18T00:37:58.209 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-18T00:37:58.210 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-18T00:37:58.210 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-18T00:37:58.210 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/ceph-helpers 1' TERM HUP INT 2026-02-18T00:37:58.210 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:790: test_destroy_osd: run_mon td/ceph-helpers a 2026-02-18T00:37:58.211 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/ceph-helpers 2026-02-18T00:37:58.211 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-18T00:37:58.211 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-18T00:37:58.211 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-18T00:37:58.211 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/ceph-helpers/a 2026-02-18T00:37:58.211 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/ceph-helpers/a --run-dir=td/ceph-helpers 2026-02-18T00:37:58.231 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-18T00:37:58.231 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:37:58.231 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:37:58.232 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:37:58.232 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:37:58.232 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:37:58.232 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.57427/$cluster-$name.asok' 2026-02-18T00:37:58.232 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/ceph-helpers/a '--log-file=td/ceph-helpers/$name.log' '--admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' --mon-cluster-log-file=td/ceph-helpers/log --run-dir=td/ceph-helpers '--pid-file=td/ceph-helpers/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-18T00:37:58.259 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-18T00:37:58.260 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-18T00:37:58.260 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T00:37:58.260 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-18T00:37:58.260 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-18T00:37:58.262 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-18T00:37:58.262 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-18T00:37:58.262 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:37:58.262 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:37:58.262 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:37:58.262 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:37:58.262 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:37:58.262 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.57427/ceph-mon.a.asok 2026-02-18T00:37:58.262 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T00:37:58.262 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.57427/ceph-mon.a.asok config get fsid 2026-02-18T00:37:58.317 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-18T00:37:58.317 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T00:37:58.318 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-18T00:37:58.318 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-18T00:37:58.318 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-18T00:37:58.318 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-18T00:37:58.318 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:37:58.318 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:37:58.318 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:37:58.318 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:37:58.318 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:37:58.319 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.57427/ceph-mon.a.asok 2026-02-18T00:37:58.319 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T00:37:58.319 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.57427/ceph-mon.a.asok config get mon_host 2026-02-18T00:37:58.373 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:791: test_destroy_osd: run_mgr td/ceph-helpers x 2026-02-18T00:37:58.373 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/ceph-helpers 2026-02-18T00:37:58.373 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-18T00:37:58.373 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-18T00:37:58.374 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-18T00:37:58.374 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/ceph-helpers/x 2026-02-18T00:37:58.374 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-18T00:37:58.490 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-18T00:37:58.491 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:37:58.491 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:37:58.491 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:37:58.491 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:37:58.491 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:37:58.491 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.57427/$cluster-$name.asok' 2026-02-18T00:37:58.492 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-18T00:37:58.492 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/ceph-helpers/x '--log-file=td/ceph-helpers/$name.log' '--admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' --run-dir=td/ceph-helpers '--pid-file=td/ceph-helpers/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-18T00:37:58.511 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:792: test_destroy_osd: run_osd td/ceph-helpers 0 2026-02-18T00:37:58.511 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/ceph-helpers 2026-02-18T00:37:58.511 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T00:37:58.511 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-18T00:37:58.511 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T00:37:58.511 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/ceph-helpers/0 2026-02-18T00:37:58.512 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--cluster ceph --fsid=863c4e35-ceb0-4172-b7b2-c3ff099e05a2 --auth-supported=none --mon-host=127.0.0.1:7109 ' 2026-02-18T00:37:58.512 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T00:37:58.512 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T00:37:58.512 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T00:37:58.512 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/ceph-helpers/0' 2026-02-18T00:37:58.512 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/ceph-helpers/0/journal' 2026-02-18T00:37:58.512 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T00:37:58.512 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-18T00:37:58.512 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/ceph-helpers' 2026-02-18T00:37:58.512 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T00:37:58.512 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:37:58.512 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:37:58.513 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:37:58.513 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:37:58.513 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:37:58.513 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.57427/$cluster-$name.asok' 2026-02-18T00:37:58.513 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' 2026-02-18T00:37:58.513 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T00:37:58.513 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T00:37:58.513 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T00:37:58.513 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/ceph-helpers/$name.log' 2026-02-18T00:37:58.513 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/ceph-helpers/$name.pid' 2026-02-18T00:37:58.513 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T00:37:58.513 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T00:37:58.513 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T00:37:58.514 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T00:37:58.514 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T00:37:58.514 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-18T00:37:58.514 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/ceph-helpers/0 2026-02-18T00:37:58.514 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T00:37:58.514 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=8c157ba2-842c-40d2-a400-9b7321d6a83c 2026-02-18T00:37:58.515 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 8c157ba2-842c-40d2-a400-9b7321d6a83c' 2026-02-18T00:37:58.515 INFO:tasks.workunit.client.0.trial069.stdout:add osd0 8c157ba2-842c-40d2-a400-9b7321d6a83c 2026-02-18T00:37:58.515 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T00:37:58.523 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDmCZVpzWLVHhAASZlneKVvjsd3DtjIZgWLQA== 2026-02-18T00:37:58.523 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDmCZVpzWLVHhAASZlneKVvjsd3DtjIZgWLQA=="}' 2026-02-18T00:37:58.523 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 8c157ba2-842c-40d2-a400-9b7321d6a83c -i td/ceph-helpers/0/new.json 2026-02-18T00:37:58.639 INFO:tasks.workunit.client.0.trial069.stdout:0 2026-02-18T00:37:58.646 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/ceph-helpers/0/new.json 2026-02-18T00:37:58.647 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --cluster ceph --fsid=863c4e35-ceb0-4172-b7b2-c3ff099e05a2 --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/0 --osd-journal=td/ceph-helpers/0/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDmCZVpzWLVHhAASZlneKVvjsd3DtjIZgWLQA== --osd-uuid 8c157ba2-842c-40d2-a400-9b7321d6a83c 2026-02-18T00:37:58.663 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:37:58.653+0000 7f10f7800a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:37:58.665 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:37:58.657+0000 7f10f7800a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:37:58.666 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:37:58.657+0000 7f10f7800a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:37:58.667 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:37:58.657+0000 7f10f7800a40 -1 bdev(0x55a7fa45cc00 td/ceph-helpers/0/block) open stat got: (1) Operation not permitted 2026-02-18T00:37:58.667 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:37:58.657+0000 7f10f7800a40 -1 bluestore(td/ceph-helpers/0) _read_fsid unparsable uuid 2026-02-18T00:37:59.413 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/ceph-helpers/0/keyring 2026-02-18T00:37:59.413 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T00:37:59.414 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-18T00:37:59.414 INFO:tasks.workunit.client.0.trial069.stdout:adding osd0 key to auth repository 2026-02-18T00:37:59.415 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/ceph-helpers/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T00:37:59.533 INFO:tasks.workunit.client.0.trial069.stdout:start osd.0 2026-02-18T00:37:59.534 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-18T00:37:59.535 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --cluster ceph --fsid=863c4e35-ceb0-4172-b7b2-c3ff099e05a2 --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/0 --osd-journal=td/ceph-helpers/0/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T00:37:59.535 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T00:37:59.535 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T00:37:59.535 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T00:37:59.557 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:37:59.545+0000 7f70733dba40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:37:59.558 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:37:59.549+0000 7f70733dba40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:37:59.559 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:37:59.549+0000 7f70733dba40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:37:59.643 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-18T00:37:59.644 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:37:59.644 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-18T00:37:59.644 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:37:59.644 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:37:59.644 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:37:59.644 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:37:59.645 INFO:tasks.workunit.client.0.trial069.stdout:0 2026-02-18T00:37:59.645 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:37:59.645 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T00:37:59.759 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:38:00.134 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:38:00.125+0000 7f70733dba40 -1 Falling back to public interface 2026-02-18T00:38:00.760 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:38:00.760 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:38:00.760 INFO:tasks.workunit.client.0.trial069.stdout:1 2026-02-18T00:38:00.760 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T00:38:00.760 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:38:00.760 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T00:38:00.866 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:38:01.083 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:38:01.073+0000 7f70733dba40 -1 osd.0 0 log_to_monitors true 2026-02-18T00:38:01.868 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:38:01.868 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:38:01.869 INFO:tasks.workunit.client.0.trial069.stdout:2 2026-02-18T00:38:01.869 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-18T00:38:01.869 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:38:01.869 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T00:38:02.080 INFO:tasks.workunit.client.0.trial069.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/2653317587,v1:127.0.0.1:6801/2653317587] [v2:127.0.0.1:6802/2653317587,v1:127.0.0.1:6803/2653317587] exists,up 8c157ba2-842c-40d2-a400-9b7321d6a83c 2026-02-18T00:38:02.081 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:38:02.082 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:38:02.082 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:38:02.082 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:793: test_destroy_osd: destroy_osd td/ceph-helpers 0 2026-02-18T00:38:02.082 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:775: destroy_osd: local dir=td/ceph-helpers 2026-02-18T00:38:02.082 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:776: destroy_osd: local id=0 2026-02-18T00:38:02.082 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:778: destroy_osd: ceph osd out osd.0 2026-02-18T00:38:02.328 INFO:tasks.workunit.client.0.trial069.stderr:osd.0 is already out. 2026-02-18T00:38:02.338 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:779: destroy_osd: kill_daemons td/ceph-helpers TERM osd.0 2026-02-18T00:38:02.339 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:38:02.339 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:38:02.339 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:38:02.339 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:38:02.339 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:38:02.647 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:38:02.647 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:780: destroy_osd: ceph osd down osd.0 2026-02-18T00:38:02.861 INFO:tasks.workunit.client.0.trial069.stderr:osd.0 is already down. 2026-02-18T00:38:02.870 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:781: destroy_osd: ceph osd purge osd.0 --yes-i-really-mean-it 2026-02-18T00:38:03.089 INFO:tasks.workunit.client.0.trial069.stderr:osd.0 does not exist 2026-02-18T00:38:03.100 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:782: destroy_osd: teardown td/ceph-helpers/0 2026-02-18T00:38:03.100 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/ceph-helpers/0 2026-02-18T00:38:03.100 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T00:38:03.100 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/ceph-helpers/0 KILL 2026-02-18T00:38:03.100 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:38:03.100 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:38:03.100 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:38:03.100 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:38:03.100 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:38:03.102 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:38:03.102 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T00:38:03.103 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T00:38:03.103 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T00:38:03.104 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T00:38:03.104 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T00:38:03.105 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T00:38:03.106 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:38:03.106 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T00:38:03.106 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T00:38:03.106 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:38:03.107 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T00:38:03.108 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T00:38:03.108 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/ceph-helpers/0 2026-02-18T00:38:03.111 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T00:38:03.111 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:38:03.111 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:38:03.111 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.57427 2026-02-18T00:38:03.112 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T00:38:03.112 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T00:38:03.112 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:783: destroy_osd: rm -fr td/ceph-helpers/0 2026-02-18T00:38:03.113 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:794: test_destroy_osd: ceph osd dump 2026-02-18T00:38:03.113 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:794: test_destroy_osd: grep 'osd. ' 2026-02-18T00:38:03.329 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:795: test_destroy_osd: teardown td/ceph-helpers 2026-02-18T00:38:03.329 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/ceph-helpers 2026-02-18T00:38:03.329 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T00:38:03.329 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/ceph-helpers KILL 2026-02-18T00:38:03.330 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:38:03.330 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:38:03.330 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:38:03.330 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:38:03.330 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:38:03.437 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:38:03.437 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T00:38:03.438 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T00:38:03.438 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T00:38:03.440 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T00:38:03.440 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T00:38:03.440 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T00:38:03.441 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:38:03.441 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T00:38:03.442 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T00:38:03.442 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:38:03.443 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T00:38:03.444 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T00:38:03.444 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/ceph-helpers 2026-02-18T00:38:03.448 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T00:38:03.448 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:38:03.448 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:38:03.448 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.57427 2026-02-18T00:38:03.450 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T00:38:03.450 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T00:38:03.450 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2426: run_tests: for func in $funcs 2026-02-18T00:38:03.451 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2427: run_tests: test_display_logs td/ceph-helpers 2026-02-18T00:38:03.451 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2158: test_display_logs: local dir=td/ceph-helpers 2026-02-18T00:38:03.451 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2160: test_display_logs: setup td/ceph-helpers 2026-02-18T00:38:03.451 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/ceph-helpers 2026-02-18T00:38:03.451 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/ceph-helpers 2026-02-18T00:38:03.451 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/ceph-helpers 2026-02-18T00:38:03.451 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T00:38:03.451 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/ceph-helpers KILL 2026-02-18T00:38:03.451 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:38:03.451 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:38:03.451 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:38:03.451 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:38:03.452 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:38:03.452 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:38:03.453 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T00:38:03.453 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T00:38:03.454 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T00:38:03.455 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T00:38:03.455 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T00:38:03.455 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T00:38:03.456 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:38:03.456 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T00:38:03.457 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T00:38:03.457 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:38:03.458 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T00:38:03.458 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T00:38:03.459 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/ceph-helpers 2026-02-18T00:38:03.460 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T00:38:03.460 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:38:03.460 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:38:03.460 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.57427 2026-02-18T00:38:03.461 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T00:38:03.461 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T00:38:03.461 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/ceph-helpers 2026-02-18T00:38:03.462 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-18T00:38:03.463 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:38:03.463 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:38:03.463 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.57427 2026-02-18T00:38:03.464 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-18T00:38:03.465 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-18T00:38:03.465 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-18T00:38:03.466 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/ceph-helpers 1' TERM HUP INT 2026-02-18T00:38:03.466 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2161: test_display_logs: run_mon td/ceph-helpers a 2026-02-18T00:38:03.466 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/ceph-helpers 2026-02-18T00:38:03.466 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-18T00:38:03.466 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-18T00:38:03.466 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-18T00:38:03.466 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/ceph-helpers/a 2026-02-18T00:38:03.466 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/ceph-helpers/a --run-dir=td/ceph-helpers 2026-02-18T00:38:03.487 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-18T00:38:03.487 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:38:03.487 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:38:03.488 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:38:03.488 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:38:03.488 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:38:03.488 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.57427/$cluster-$name.asok' 2026-02-18T00:38:03.489 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/ceph-helpers/a '--log-file=td/ceph-helpers/$name.log' '--admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' --mon-cluster-log-file=td/ceph-helpers/log --run-dir=td/ceph-helpers '--pid-file=td/ceph-helpers/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-18T00:38:03.519 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-18T00:38:03.520 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-18T00:38:03.520 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T00:38:03.520 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-18T00:38:03.520 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-18T00:38:03.520 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-18T00:38:03.522 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-18T00:38:03.522 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:38:03.522 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:38:03.522 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:38:03.522 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:38:03.522 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:38:03.522 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.57427/ceph-mon.a.asok 2026-02-18T00:38:03.522 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T00:38:03.522 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.57427/ceph-mon.a.asok config get fsid 2026-02-18T00:38:03.577 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-18T00:38:03.577 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T00:38:03.577 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-18T00:38:03.577 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-18T00:38:03.578 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-18T00:38:03.579 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-18T00:38:03.579 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:38:03.579 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:38:03.579 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:38:03.579 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:38:03.579 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:38:03.579 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.57427/ceph-mon.a.asok 2026-02-18T00:38:03.579 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T00:38:03.579 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.57427/ceph-mon.a.asok config get mon_host 2026-02-18T00:38:03.635 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2162: test_display_logs: kill_daemons td/ceph-helpers 2026-02-18T00:38:03.636 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:38:03.636 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:38:03.636 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:38:03.637 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:38:03.637 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:38:03.743 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:38:03.743 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2163: test_display_logs: display_logs td/ceph-helpers 2026-02-18T00:38:03.743 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2148: display_logs: local dir=td/ceph-helpers 2026-02-18T00:38:03.743 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2150: display_logs: find td/ceph-helpers -maxdepth 1 -name '*.log' 2026-02-18T00:38:03.743 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2151: display_logs: read file 2026-02-18T00:38:03.744 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2152: display_logs: echo '======================= td/ceph-helpers/mon.a.log' 2026-02-18T00:38:03.744 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2153: display_logs: cat td/ceph-helpers/mon.a.log 2026-02-18T00:38:03.745 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2151: display_logs: read file 2026-02-18T00:38:03.746 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2164: test_display_logs: grep --quiet mon.a.log td/ceph-helpers/log.out 2026-02-18T00:38:03.747 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2165: test_display_logs: teardown td/ceph-helpers 2026-02-18T00:38:03.747 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/ceph-helpers 2026-02-18T00:38:03.747 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T00:38:03.748 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/ceph-helpers KILL 2026-02-18T00:38:03.748 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:38:03.748 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:38:03.748 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:38:03.748 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:38:03.748 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:38:03.750 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:38:03.750 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T00:38:03.750 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T00:38:03.751 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T00:38:03.752 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T00:38:03.752 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T00:38:03.752 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T00:38:03.753 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:38:03.753 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T00:38:03.754 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T00:38:03.754 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:38:03.755 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T00:38:03.756 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T00:38:03.756 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/ceph-helpers 2026-02-18T00:38:03.758 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T00:38:03.758 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:38:03.758 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:38:03.758 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.57427 2026-02-18T00:38:03.760 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T00:38:03.760 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T00:38:03.760 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2426: run_tests: for func in $funcs 2026-02-18T00:38:03.761 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2427: run_tests: test_erasure_code_plugin_exists td/ceph-helpers 2026-02-18T00:38:03.761 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2129: test_erasure_code_plugin_exists: local dir=td/ceph-helpers 2026-02-18T00:38:03.761 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2131: test_erasure_code_plugin_exists: setup td/ceph-helpers 2026-02-18T00:38:03.761 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/ceph-helpers 2026-02-18T00:38:03.761 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/ceph-helpers 2026-02-18T00:38:03.761 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/ceph-helpers 2026-02-18T00:38:03.761 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T00:38:03.761 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/ceph-helpers KILL 2026-02-18T00:38:03.761 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:38:03.761 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:38:03.761 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:38:03.761 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:38:03.762 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:38:03.762 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:38:03.762 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T00:38:03.763 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T00:38:03.763 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T00:38:03.765 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T00:38:03.765 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T00:38:03.765 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T00:38:03.766 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:38:03.766 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T00:38:03.767 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T00:38:03.767 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:38:03.768 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T00:38:03.769 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T00:38:03.769 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/ceph-helpers 2026-02-18T00:38:03.770 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T00:38:03.770 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:38:03.770 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:38:03.770 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.57427 2026-02-18T00:38:03.772 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T00:38:03.772 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T00:38:03.772 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/ceph-helpers 2026-02-18T00:38:03.773 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-18T00:38:03.773 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:38:03.773 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:38:03.773 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.57427 2026-02-18T00:38:03.775 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-18T00:38:03.776 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-18T00:38:03.776 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-18T00:38:03.776 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/ceph-helpers 1' TERM HUP INT 2026-02-18T00:38:03.776 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2132: test_erasure_code_plugin_exists: run_mon td/ceph-helpers a 2026-02-18T00:38:03.776 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/ceph-helpers 2026-02-18T00:38:03.776 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-18T00:38:03.776 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-18T00:38:03.776 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-18T00:38:03.777 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/ceph-helpers/a 2026-02-18T00:38:03.777 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/ceph-helpers/a --run-dir=td/ceph-helpers 2026-02-18T00:38:03.798 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-18T00:38:03.798 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:38:03.798 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:38:03.798 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:38:03.798 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:38:03.798 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:38:03.798 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.57427/$cluster-$name.asok' 2026-02-18T00:38:03.799 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/ceph-helpers/a '--log-file=td/ceph-helpers/$name.log' '--admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' --mon-cluster-log-file=td/ceph-helpers/log --run-dir=td/ceph-helpers '--pid-file=td/ceph-helpers/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-18T00:38:03.828 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-18T00:38:03.830 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-18T00:38:03.830 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T00:38:03.830 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-18T00:38:03.830 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-18T00:38:03.830 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-18T00:38:03.830 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-18T00:38:03.831 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:38:03.831 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:38:03.832 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:38:03.832 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:38:03.832 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:38:03.832 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.57427/ceph-mon.a.asok 2026-02-18T00:38:03.832 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T00:38:03.832 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.57427/ceph-mon.a.asok config get fsid 2026-02-18T00:38:03.887 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-18T00:38:03.887 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T00:38:03.888 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-18T00:38:03.888 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-18T00:38:03.888 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-18T00:38:03.888 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-18T00:38:03.888 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:38:03.888 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:38:03.888 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:38:03.888 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:38:03.888 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:38:03.888 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.57427/ceph-mon.a.asok 2026-02-18T00:38:03.889 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T00:38:03.889 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.57427/ceph-mon.a.asok config get mon_host 2026-02-18T00:38:03.942 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2133: test_erasure_code_plugin_exists: run_mgr td/ceph-helpers x 2026-02-18T00:38:03.942 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/ceph-helpers 2026-02-18T00:38:03.942 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-18T00:38:03.942 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-18T00:38:03.943 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-18T00:38:03.943 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/ceph-helpers/x 2026-02-18T00:38:03.943 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-18T00:38:04.056 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-18T00:38:04.056 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:38:04.056 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:38:04.056 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:38:04.056 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:38:04.057 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:38:04.057 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.57427/$cluster-$name.asok' 2026-02-18T00:38:04.057 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-18T00:38:04.058 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/ceph-helpers/x '--log-file=td/ceph-helpers/$name.log' '--admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' --run-dir=td/ceph-helpers '--pid-file=td/ceph-helpers/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-18T00:38:04.077 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2134: test_erasure_code_plugin_exists: erasure_code_plugin_exists jerasure 2026-02-18T00:38:04.077 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2104: erasure_code_plugin_exists: local plugin=jerasure 2026-02-18T00:38:04.077 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2105: erasure_code_plugin_exists: local status 2026-02-18T00:38:04.077 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2106: erasure_code_plugin_exists: local grepstr 2026-02-18T00:38:04.077 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2107: erasure_code_plugin_exists: local s 2026-02-18T00:38:04.077 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2108: erasure_code_plugin_exists: case `uname` in 2026-02-18T00:38:04.078 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2108: erasure_code_plugin_exists: uname 2026-02-18T00:38:04.078 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2110: erasure_code_plugin_exists: grepstr='jerasure.*No such file' 2026-02-18T00:38:04.078 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2113: erasure_code_plugin_exists: ceph osd erasure-code-profile set TESTPROFILE plugin=jerasure 2026-02-18T00:38:04.200 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2113: erasure_code_plugin_exists: s= 2026-02-18T00:38:04.200 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2114: erasure_code_plugin_exists: local status=0 2026-02-18T00:38:04.200 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2115: erasure_code_plugin_exists: '[' 0 -eq 0 ']' 2026-02-18T00:38:04.200 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2116: erasure_code_plugin_exists: ceph osd erasure-code-profile rm TESTPROFILE 2026-02-18T00:38:04.354 INFO:tasks.workunit.client.0.trial069.stderr:erasure-code-profile TESTPROFILE does not exist 2026-02-18T00:38:04.363 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2125: erasure_code_plugin_exists: return 0 2026-02-18T00:38:04.363 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2135: test_erasure_code_plugin_exists: erasure_code_plugin_exists FAKE 2026-02-18T00:38:04.363 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2104: erasure_code_plugin_exists: local plugin=FAKE 2026-02-18T00:38:04.363 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2105: erasure_code_plugin_exists: local status 2026-02-18T00:38:04.363 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2106: erasure_code_plugin_exists: local grepstr 2026-02-18T00:38:04.363 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2107: erasure_code_plugin_exists: local s 2026-02-18T00:38:04.364 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2108: erasure_code_plugin_exists: case `uname` in 2026-02-18T00:38:04.364 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2108: erasure_code_plugin_exists: uname 2026-02-18T00:38:04.364 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2110: erasure_code_plugin_exists: grepstr='FAKE.*No such file' 2026-02-18T00:38:04.364 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2113: erasure_code_plugin_exists: ceph osd erasure-code-profile set TESTPROFILE plugin=FAKE 2026-02-18T00:38:04.459 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2113: erasure_code_plugin_exists: s='Error EIO: load dlopen(/usr/lib/ceph/erasure-code/libec_FAKE.so): /usr/lib/ceph/erasure-code/libec_FAKE.so: cannot open shared object file: No such file or directory' 2026-02-18T00:38:04.459 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2114: erasure_code_plugin_exists: local status=5 2026-02-18T00:38:04.459 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2115: erasure_code_plugin_exists: '[' 5 -eq 0 ']' 2026-02-18T00:38:04.459 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2117: erasure_code_plugin_exists: echo Error EIO: load 'dlopen(/usr/lib/ceph/erasure-code/libec_FAKE.so):' /usr/lib/ceph/erasure-code/libec_FAKE.so: cannot open shared object file: No such file or directory 2026-02-18T00:38:04.460 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2117: erasure_code_plugin_exists: grep --quiet 'FAKE.*No such file' 2026-02-18T00:38:04.461 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2119: erasure_code_plugin_exists: status=1 2026-02-18T00:38:04.461 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2125: erasure_code_plugin_exists: return 1 2026-02-18T00:38:04.461 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2136: test_erasure_code_plugin_exists: teardown td/ceph-helpers 2026-02-18T00:38:04.461 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/ceph-helpers 2026-02-18T00:38:04.462 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T00:38:04.462 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/ceph-helpers KILL 2026-02-18T00:38:04.462 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:38:04.462 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:38:04.462 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:38:04.462 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:38:04.462 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:38:04.568 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:38:04.569 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T00:38:04.569 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T00:38:04.570 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T00:38:04.571 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T00:38:04.571 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T00:38:04.572 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T00:38:04.573 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:38:04.573 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T00:38:04.573 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T00:38:04.574 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:38:04.574 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T00:38:04.575 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T00:38:04.576 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/ceph-helpers 2026-02-18T00:38:04.578 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T00:38:04.578 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:38:04.578 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:38:04.578 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.57427 2026-02-18T00:38:04.580 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T00:38:04.580 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T00:38:04.580 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2426: run_tests: for func in $funcs 2026-02-18T00:38:04.580 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2427: run_tests: test_expect_failure td/ceph-helpers 2026-02-18T00:38:04.580 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2037: test_expect_failure: local dir=td/ceph-helpers 2026-02-18T00:38:04.581 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2039: test_expect_failure: setup td/ceph-helpers 2026-02-18T00:38:04.581 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/ceph-helpers 2026-02-18T00:38:04.581 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/ceph-helpers 2026-02-18T00:38:04.581 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/ceph-helpers 2026-02-18T00:38:04.581 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T00:38:04.581 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/ceph-helpers KILL 2026-02-18T00:38:04.581 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:38:04.581 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:38:04.581 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:38:04.581 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:38:04.581 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:38:04.582 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:38:04.582 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T00:38:04.583 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T00:38:04.583 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T00:38:04.585 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T00:38:04.585 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T00:38:04.585 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T00:38:04.586 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:38:04.586 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T00:38:04.587 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T00:38:04.587 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:38:04.588 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T00:38:04.589 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T00:38:04.589 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/ceph-helpers 2026-02-18T00:38:04.591 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T00:38:04.591 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:38:04.591 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:38:04.591 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.57427 2026-02-18T00:38:04.592 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T00:38:04.592 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T00:38:04.592 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/ceph-helpers 2026-02-18T00:38:04.594 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-18T00:38:04.594 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:38:04.594 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:38:04.594 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.57427 2026-02-18T00:38:04.595 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-18T00:38:04.596 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-18T00:38:04.597 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-18T00:38:04.597 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/ceph-helpers 1' TERM HUP INT 2026-02-18T00:38:04.597 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2040: test_expect_failure: expect_failure td/ceph-helpers FAIL bash -c 'echo FAIL ; exit 1' 2026-02-18T00:38:04.597 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2016: expect_failure: local dir=td/ceph-helpers 2026-02-18T00:38:04.597 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2017: expect_failure: shift 2026-02-18T00:38:04.597 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2018: expect_failure: local expected=FAIL 2026-02-18T00:38:04.597 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2019: expect_failure: shift 2026-02-18T00:38:04.597 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2020: expect_failure: local success 2026-02-18T00:38:04.597 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2022: expect_failure: bash -c 'echo FAIL ; exit 1' 2026-02-18T00:38:04.598 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2025: expect_failure: success=false 2026-02-18T00:38:04.598 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2028: expect_failure: false 2026-02-18T00:38:04.598 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2028: expect_failure: grep --quiet FAIL td/ceph-helpers/out 2026-02-18T00:38:04.599 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2032: expect_failure: return 0 2026-02-18T00:38:04.599 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2042: test_expect_failure: expect_failure td/ceph-helpers FAIL bash -c 'echo FAIL ; exit 0' 2026-02-18T00:38:04.599 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2016: expect_failure: local dir=td/ceph-helpers 2026-02-18T00:38:04.599 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2017: expect_failure: shift 2026-02-18T00:38:04.599 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2018: expect_failure: local expected=FAIL 2026-02-18T00:38:04.600 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2019: expect_failure: shift 2026-02-18T00:38:04.600 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2020: expect_failure: local success 2026-02-18T00:38:04.600 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2022: expect_failure: bash -c 'echo FAIL ; exit 0' 2026-02-18T00:38:04.600 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2023: expect_failure: success=true 2026-02-18T00:38:04.601 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2028: expect_failure: true 2026-02-18T00:38:04.601 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2029: expect_failure: cat td/ceph-helpers/out 2026-02-18T00:38:04.601 INFO:tasks.workunit.client.0.trial069.stderr:FAIL 2026-02-18T00:38:04.601 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2030: expect_failure: return 1 2026-02-18T00:38:04.602 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2043: test_expect_failure: grep --quiet FAIL td/ceph-helpers/out 2026-02-18T00:38:04.603 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2045: test_expect_failure: expect_failure td/ceph-helpers FAIL bash -c 'echo UNEXPECTED ; exit 1' 2026-02-18T00:38:04.603 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2016: expect_failure: local dir=td/ceph-helpers 2026-02-18T00:38:04.603 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2017: expect_failure: shift 2026-02-18T00:38:04.603 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2018: expect_failure: local expected=FAIL 2026-02-18T00:38:04.604 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2019: expect_failure: shift 2026-02-18T00:38:04.604 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2020: expect_failure: local success 2026-02-18T00:38:04.604 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2022: expect_failure: bash -c 'echo UNEXPECTED ; exit 1' 2026-02-18T00:38:04.605 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2025: expect_failure: success=false 2026-02-18T00:38:04.605 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2028: expect_failure: false 2026-02-18T00:38:04.605 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2028: expect_failure: grep --quiet FAIL td/ceph-helpers/out 2026-02-18T00:38:04.605 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2029: expect_failure: cat td/ceph-helpers/out 2026-02-18T00:38:04.607 INFO:tasks.workunit.client.0.trial069.stderr:UNEXPECTED 2026-02-18T00:38:04.607 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2030: expect_failure: return 1 2026-02-18T00:38:04.607 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2046: test_expect_failure: grep --quiet FAIL td/ceph-helpers/out 2026-02-18T00:38:04.608 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2047: test_expect_failure: teardown td/ceph-helpers 2026-02-18T00:38:04.609 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/ceph-helpers 2026-02-18T00:38:04.609 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T00:38:04.609 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/ceph-helpers KILL 2026-02-18T00:38:04.609 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:38:04.609 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:38:04.610 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:38:04.610 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:38:04.610 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:38:04.611 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:38:04.612 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T00:38:04.612 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T00:38:04.613 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T00:38:04.613 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T00:38:04.614 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T00:38:04.614 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T00:38:04.615 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:38:04.615 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T00:38:04.616 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T00:38:04.616 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:38:04.617 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T00:38:04.618 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T00:38:04.618 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/ceph-helpers 2026-02-18T00:38:04.619 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T00:38:04.619 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:38:04.619 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:38:04.620 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.57427 2026-02-18T00:38:04.622 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T00:38:04.622 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T00:38:04.622 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2426: run_tests: for func in $funcs 2026-02-18T00:38:04.622 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2427: run_tests: test_file_with_random_data td/ceph-helpers 2026-02-18T00:38:04.622 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2351: test_file_with_random_data: local dir=td/ceph-helpers 2026-02-18T00:38:04.622 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2353: test_file_with_random_data: setup td/ceph-helpers 2026-02-18T00:38:04.622 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/ceph-helpers 2026-02-18T00:38:04.622 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/ceph-helpers 2026-02-18T00:38:04.622 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/ceph-helpers 2026-02-18T00:38:04.623 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T00:38:04.623 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/ceph-helpers KILL 2026-02-18T00:38:04.623 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:38:04.623 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:38:04.623 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:38:04.623 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:38:04.623 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:38:04.624 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:38:04.624 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T00:38:04.624 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T00:38:04.625 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T00:38:04.626 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T00:38:04.626 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T00:38:04.626 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T00:38:04.627 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:38:04.627 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T00:38:04.628 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T00:38:04.628 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:38:04.629 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T00:38:04.630 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T00:38:04.630 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/ceph-helpers 2026-02-18T00:38:04.631 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T00:38:04.632 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:38:04.632 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:38:04.632 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.57427 2026-02-18T00:38:04.633 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T00:38:04.633 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T00:38:04.633 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/ceph-helpers 2026-02-18T00:38:04.634 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-18T00:38:04.634 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:38:04.634 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:38:04.634 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.57427 2026-02-18T00:38:04.636 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-18T00:38:04.636 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-18T00:38:04.636 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-18T00:38:04.636 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/ceph-helpers 1' TERM HUP INT 2026-02-18T00:38:04.637 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2354: test_file_with_random_data: file_with_random_data 4000 2026-02-18T00:38:04.637 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2344: file_with_random_data: local size_bytes=4000 2026-02-18T00:38:04.637 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2345: file_with_random_data: mktemp 2026-02-18T00:38:04.638 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2345: file_with_random_data: local file=/tmp/tmp.CzKSunoxhL 2026-02-18T00:38:04.638 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2346: file_with_random_data: dd if=/dev/urandom of=/tmp/tmp.CzKSunoxhL bs=4000 count=1 2026-02-18T00:38:04.639 INFO:tasks.workunit.client.0.trial069.stderr:1+0 records in 2026-02-18T00:38:04.639 INFO:tasks.workunit.client.0.trial069.stderr:1+0 records out 2026-02-18T00:38:04.639 INFO:tasks.workunit.client.0.trial069.stderr:4000 bytes (4.0 kB, 3.9 KiB) copied, 5.956e-05 s, 67.2 MB/s 2026-02-18T00:38:04.639 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2347: file_with_random_data: printf %s /tmp/tmp.CzKSunoxhL 2026-02-18T00:38:04.640 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2354: test_file_with_random_data: local file=/tmp/tmp.CzKSunoxhL 2026-02-18T00:38:04.640 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2355: test_file_with_random_data: test -f /tmp/tmp.CzKSunoxhL 2026-02-18T00:38:04.640 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2356: test_file_with_random_data: stat -c %s /tmp/tmp.CzKSunoxhL 2026-02-18T00:38:04.641 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2356: test_file_with_random_data: test 4000 = 4000 2026-02-18T00:38:04.641 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2357: test_file_with_random_data: rm /tmp/tmp.CzKSunoxhL 2026-02-18T00:38:04.642 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2358: test_file_with_random_data: teardown td/ceph-helpers 2026-02-18T00:38:04.642 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/ceph-helpers 2026-02-18T00:38:04.642 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T00:38:04.643 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/ceph-helpers KILL 2026-02-18T00:38:04.643 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:38:04.643 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:38:04.643 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:38:04.643 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:38:04.643 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:38:04.645 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:38:04.645 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T00:38:04.646 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T00:38:04.646 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T00:38:04.647 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T00:38:04.647 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T00:38:04.647 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T00:38:04.648 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:38:04.648 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T00:38:04.649 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T00:38:04.649 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:38:04.650 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T00:38:04.651 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T00:38:04.651 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/ceph-helpers 2026-02-18T00:38:04.653 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T00:38:04.653 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:38:04.653 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:38:04.653 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.57427 2026-02-18T00:38:04.655 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T00:38:04.655 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T00:38:04.655 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2426: run_tests: for func in $funcs 2026-02-18T00:38:04.655 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2427: run_tests: test_flush_pg_stats td/ceph-helpers 2026-02-18T00:38:04.655 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2281: test_flush_pg_stats: local dir=td/ceph-helpers 2026-02-18T00:38:04.655 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2283: test_flush_pg_stats: setup td/ceph-helpers 2026-02-18T00:38:04.655 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/ceph-helpers 2026-02-18T00:38:04.655 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/ceph-helpers 2026-02-18T00:38:04.656 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/ceph-helpers 2026-02-18T00:38:04.656 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T00:38:04.656 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/ceph-helpers KILL 2026-02-18T00:38:04.656 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:38:04.656 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:38:04.656 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:38:04.656 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:38:04.656 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:38:04.657 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:38:04.657 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T00:38:04.658 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T00:38:04.658 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T00:38:04.659 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T00:38:04.660 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T00:38:04.660 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T00:38:04.661 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:38:04.661 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T00:38:04.662 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T00:38:04.662 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:38:04.663 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T00:38:04.664 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T00:38:04.664 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/ceph-helpers 2026-02-18T00:38:04.665 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T00:38:04.665 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:38:04.665 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:38:04.665 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.57427 2026-02-18T00:38:04.666 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T00:38:04.666 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T00:38:04.666 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/ceph-helpers 2026-02-18T00:38:04.668 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-18T00:38:04.668 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:38:04.668 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:38:04.668 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.57427 2026-02-18T00:38:04.669 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-18T00:38:04.670 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-18T00:38:04.671 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-18T00:38:04.671 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/ceph-helpers 1' TERM HUP INT 2026-02-18T00:38:04.671 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2284: test_flush_pg_stats: run_mon td/ceph-helpers a --osd_pool_default_size=1 --mon_allow_pool_size_one=true 2026-02-18T00:38:04.671 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/ceph-helpers 2026-02-18T00:38:04.671 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-18T00:38:04.671 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-18T00:38:04.671 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-18T00:38:04.671 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/ceph-helpers/a 2026-02-18T00:38:04.671 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/ceph-helpers/a --run-dir=td/ceph-helpers --osd_pool_default_size=1 --mon_allow_pool_size_one=true 2026-02-18T00:38:04.692 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-18T00:38:04.692 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:38:04.693 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:38:04.693 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:38:04.693 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:38:04.693 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:38:04.693 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.57427/$cluster-$name.asok' 2026-02-18T00:38:04.693 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/ceph-helpers/a '--log-file=td/ceph-helpers/$name.log' '--admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' --mon-cluster-log-file=td/ceph-helpers/log --run-dir=td/ceph-helpers '--pid-file=td/ceph-helpers/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --osd_pool_default_size=1 --mon_allow_pool_size_one=true 2026-02-18T00:38:04.721 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-18T00:38:04.722 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-18T00:38:04.723 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T00:38:04.723 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-18T00:38:04.723 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-18T00:38:04.723 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-18T00:38:04.724 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-18T00:38:04.724 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:38:04.724 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:38:04.724 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:38:04.724 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:38:04.724 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:38:04.725 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.57427/ceph-mon.a.asok 2026-02-18T00:38:04.725 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T00:38:04.725 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.57427/ceph-mon.a.asok config get fsid 2026-02-18T00:38:04.779 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-18T00:38:04.779 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T00:38:04.779 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-18T00:38:04.779 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-18T00:38:04.779 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-18T00:38:04.780 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-18T00:38:04.781 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:38:04.781 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:38:04.781 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:38:04.781 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:38:04.781 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:38:04.781 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.57427/ceph-mon.a.asok 2026-02-18T00:38:04.781 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T00:38:04.781 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.57427/ceph-mon.a.asok config get mon_host 2026-02-18T00:38:04.834 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2285: test_flush_pg_stats: run_mgr td/ceph-helpers x 2026-02-18T00:38:04.834 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/ceph-helpers 2026-02-18T00:38:04.834 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-18T00:38:04.834 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-18T00:38:04.834 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-18T00:38:04.835 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/ceph-helpers/x 2026-02-18T00:38:04.835 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-18T00:38:04.945 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-18T00:38:04.945 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:38:04.946 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:38:04.946 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:38:04.946 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:38:04.946 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:38:04.946 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.57427/$cluster-$name.asok' 2026-02-18T00:38:04.946 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-18T00:38:04.947 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/ceph-helpers/x '--log-file=td/ceph-helpers/$name.log' '--admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' --run-dir=td/ceph-helpers '--pid-file=td/ceph-helpers/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-18T00:38:04.968 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2286: test_flush_pg_stats: run_osd td/ceph-helpers 0 2026-02-18T00:38:04.968 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/ceph-helpers 2026-02-18T00:38:04.968 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T00:38:04.968 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-18T00:38:04.968 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T00:38:04.968 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/ceph-helpers/0 2026-02-18T00:38:04.969 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--cluster ceph --fsid=863c4e35-ceb0-4172-b7b2-c3ff099e05a2 --auth-supported=none --mon-host=127.0.0.1:7109 ' 2026-02-18T00:38:04.969 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T00:38:04.969 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T00:38:04.969 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T00:38:04.969 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/ceph-helpers/0' 2026-02-18T00:38:04.969 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/ceph-helpers/0/journal' 2026-02-18T00:38:04.969 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T00:38:04.969 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-18T00:38:04.969 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/ceph-helpers' 2026-02-18T00:38:04.969 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T00:38:04.969 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:38:04.969 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:38:04.970 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:38:04.970 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:38:04.970 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:38:04.970 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.57427/$cluster-$name.asok' 2026-02-18T00:38:04.970 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' 2026-02-18T00:38:04.970 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T00:38:04.970 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T00:38:04.970 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T00:38:04.970 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/ceph-helpers/$name.log' 2026-02-18T00:38:04.970 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/ceph-helpers/$name.pid' 2026-02-18T00:38:04.970 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T00:38:04.970 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T00:38:04.970 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T00:38:04.971 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T00:38:04.971 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T00:38:04.971 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-18T00:38:04.971 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/ceph-helpers/0 2026-02-18T00:38:04.971 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T00:38:04.972 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=2802983a-5b2f-488f-9796-278b02cdff7f 2026-02-18T00:38:04.972 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 2802983a-5b2f-488f-9796-278b02cdff7f' 2026-02-18T00:38:04.972 INFO:tasks.workunit.client.0.trial069.stdout:add osd0 2802983a-5b2f-488f-9796-278b02cdff7f 2026-02-18T00:38:04.972 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T00:38:04.982 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDsCZVpi6QzOhAAtJdEDJR1ivJDkpWhVHul4g== 2026-02-18T00:38:04.983 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDsCZVpi6QzOhAAtJdEDJR1ivJDkpWhVHul4g=="}' 2026-02-18T00:38:04.983 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 2802983a-5b2f-488f-9796-278b02cdff7f -i td/ceph-helpers/0/new.json 2026-02-18T00:38:05.096 INFO:tasks.workunit.client.0.trial069.stdout:0 2026-02-18T00:38:05.104 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/ceph-helpers/0/new.json 2026-02-18T00:38:05.105 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --cluster ceph --fsid=863c4e35-ceb0-4172-b7b2-c3ff099e05a2 --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/0 --osd-journal=td/ceph-helpers/0/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDsCZVpi6QzOhAAtJdEDJR1ivJDkpWhVHul4g== --osd-uuid 2802983a-5b2f-488f-9796-278b02cdff7f 2026-02-18T00:38:05.122 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:38:05.113+0000 7f8c707d0a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:38:05.123 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:38:05.113+0000 7f8c707d0a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:38:05.124 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:38:05.113+0000 7f8c707d0a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:38:05.125 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:38:05.117+0000 7f8c707d0a40 -1 bdev(0x5595ebfd6c00 td/ceph-helpers/0/block) open stat got: (1) Operation not permitted 2026-02-18T00:38:05.125 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:38:05.117+0000 7f8c707d0a40 -1 bluestore(td/ceph-helpers/0) _read_fsid unparsable uuid 2026-02-18T00:38:05.853 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/ceph-helpers/0/keyring 2026-02-18T00:38:05.853 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T00:38:05.854 INFO:tasks.workunit.client.0.trial069.stdout:adding osd0 key to auth repository 2026-02-18T00:38:05.854 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-18T00:38:05.854 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/ceph-helpers/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T00:38:05.979 INFO:tasks.workunit.client.0.trial069.stdout:start osd.0 2026-02-18T00:38:05.980 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-18T00:38:05.980 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --cluster ceph --fsid=863c4e35-ceb0-4172-b7b2-c3ff099e05a2 --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/0 --osd-journal=td/ceph-helpers/0/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T00:38:05.980 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T00:38:05.980 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T00:38:05.980 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T00:38:05.994 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:38:05.985+0000 7f99a4fdaa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:38:05.996 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:38:05.985+0000 7f99a4fdaa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:38:05.997 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:38:05.989+0000 7f99a4fdaa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:38:06.086 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-18T00:38:06.086 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:38:06.086 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-18T00:38:06.086 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:38:06.086 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:38:06.087 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:38:06.087 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:38:06.087 INFO:tasks.workunit.client.0.trial069.stdout:0 2026-02-18T00:38:06.087 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:38:06.088 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T00:38:06.192 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:38:06.523 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:38:06.513+0000 7f99a4fdaa40 -1 Falling back to public interface 2026-02-18T00:38:07.194 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:38:07.194 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:38:07.194 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T00:38:07.194 INFO:tasks.workunit.client.0.trial069.stdout:1 2026-02-18T00:38:07.195 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:38:07.195 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T00:38:07.303 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:38:07.442 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:38:07.433+0000 7f99a4fdaa40 -1 osd.0 0 log_to_monitors true 2026-02-18T00:38:08.305 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:38:08.305 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:38:08.305 INFO:tasks.workunit.client.0.trial069.stdout:2 2026-02-18T00:38:08.306 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-18T00:38:08.306 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:38:08.306 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T00:38:08.521 INFO:tasks.workunit.client.0.trial069.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/2581442736,v1:127.0.0.1:6801/2581442736] [v2:127.0.0.1:6802/2581442736,v1:127.0.0.1:6803/2581442736] exists,up 2802983a-5b2f-488f-9796-278b02cdff7f 2026-02-18T00:38:08.522 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:38:08.522 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:38:08.523 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:38:08.523 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2287: test_flush_pg_stats: create_rbd_pool 2026-02-18T00:38:08.523 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:526: create_rbd_pool: ceph osd pool delete rbd rbd --yes-i-really-really-mean-it 2026-02-18T00:38:08.725 INFO:tasks.workunit.client.0.trial069.stderr:pool 'rbd' does not exist 2026-02-18T00:38:08.734 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:527: create_rbd_pool: create_pool rbd 4 2026-02-18T00:38:08.734 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create rbd 4 2026-02-18T00:38:08.963 INFO:tasks.workunit.client.0.trial069.stderr:pool 'rbd' already exists 2026-02-18T00:38:08.972 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-18T00:38:09.973 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:528: create_rbd_pool: rbd pool init rbd 2026-02-18T00:38:10.252 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2288: test_flush_pg_stats: rados -p rbd put obj /etc/group 2026-02-18T00:38:10.271 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2289: test_flush_pg_stats: flush_pg_stats 2026-02-18T00:38:10.271 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-18T00:38:10.271 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-18T00:38:10.489 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids=0 2026-02-18T00:38:10.489 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-18T00:38:10.489 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:38:10.489 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-18T00:38:10.567 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836483 2026-02-18T00:38:10.568 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836483 2026-02-18T00:38:10.568 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836483' 2026-02-18T00:38:10.568 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:38:10.568 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836483 2026-02-18T00:38:10.568 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:38:10.569 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-18T00:38:10.570 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-21474836483 2026-02-18T00:38:10.570 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:38:10.571 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=21474836483 2026-02-18T00:38:10.571 INFO:tasks.workunit.client.0.trial069.stdout:waiting osd.0 seq 21474836483 2026-02-18T00:38:10.572 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 21474836483' 2026-02-18T00:38:10.572 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T00:38:10.787 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 21474836481 -lt 21474836483 2026-02-18T00:38:10.787 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-18T00:38:11.788 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-18T00:38:11.789 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T00:38:12.000 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 21474836483 -lt 21474836483 2026-02-18T00:38:12.000 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2290: test_flush_pg_stats: local 'jq_filter=.pools | .[] | select(.name == "rbd") | .stats' 2026-02-18T00:38:12.000 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2291: test_flush_pg_stats: ceph df detail --format=json 2026-02-18T00:38:12.001 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2291: test_flush_pg_stats: jq '.pools | .[] | select(.name == "rbd") | .stats.stored' 2026-02-18T00:38:12.275 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2291: test_flush_pg_stats: stored=8348 2026-02-18T00:38:12.276 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2292: test_flush_pg_stats: ceph df detail --format=json 2026-02-18T00:38:12.276 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2292: test_flush_pg_stats: jq '.pools | .[] | select(.name == "rbd") | .stats.stored_raw' 2026-02-18T00:38:12.559 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2292: test_flush_pg_stats: stored_raw=8348 2026-02-18T00:38:12.559 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2293: test_flush_pg_stats: test 8348 -gt 0 2026-02-18T00:38:12.559 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2294: test_flush_pg_stats: test 8348 == 8348 2026-02-18T00:38:12.559 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: test_flush_pg_stats: teardown td/ceph-helpers 2026-02-18T00:38:12.559 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/ceph-helpers 2026-02-18T00:38:12.559 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T00:38:12.559 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/ceph-helpers KILL 2026-02-18T00:38:12.560 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:38:12.560 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:38:12.560 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:38:12.560 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:38:12.560 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:38:12.667 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:38:12.667 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T00:38:12.668 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T00:38:12.668 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T00:38:12.669 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T00:38:12.670 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T00:38:12.670 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T00:38:12.671 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:38:12.671 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T00:38:12.671 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T00:38:12.672 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:38:12.673 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T00:38:12.674 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T00:38:12.674 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/ceph-helpers 2026-02-18T00:38:12.679 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T00:38:12.679 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:38:12.679 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:38:12.679 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.57427 2026-02-18T00:38:12.682 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T00:38:12.682 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T00:38:12.682 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2426: run_tests: for func in $funcs 2026-02-18T00:38:12.682 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2427: run_tests: test_get_config td/ceph-helpers 2026-02-18T00:38:12.682 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: test_get_config: local dir=td/ceph-helpers 2026-02-18T00:38:12.682 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1130: test_get_config: setup td/ceph-helpers 2026-02-18T00:38:12.682 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/ceph-helpers 2026-02-18T00:38:12.682 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/ceph-helpers 2026-02-18T00:38:12.682 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/ceph-helpers 2026-02-18T00:38:12.682 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T00:38:12.683 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/ceph-helpers KILL 2026-02-18T00:38:12.683 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:38:12.683 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:38:12.683 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:38:12.683 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:38:12.683 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:38:12.684 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:38:12.684 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T00:38:12.685 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T00:38:12.685 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T00:38:12.686 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T00:38:12.686 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T00:38:12.686 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T00:38:12.687 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:38:12.688 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T00:38:12.688 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T00:38:12.688 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:38:12.689 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T00:38:12.690 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T00:38:12.690 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/ceph-helpers 2026-02-18T00:38:12.691 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T00:38:12.691 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:38:12.692 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:38:12.692 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.57427 2026-02-18T00:38:12.693 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T00:38:12.693 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T00:38:12.693 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/ceph-helpers 2026-02-18T00:38:12.694 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-18T00:38:12.694 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:38:12.695 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:38:12.695 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.57427 2026-02-18T00:38:12.696 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-18T00:38:12.697 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-18T00:38:12.697 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-18T00:38:12.697 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/ceph-helpers 1' TERM HUP INT 2026-02-18T00:38:12.697 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1131: test_get_config: run_mon td/ceph-helpers a --osd_pool_default_size=1 --mon_allow_pool_size_one=true 2026-02-18T00:38:12.698 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/ceph-helpers 2026-02-18T00:38:12.698 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-18T00:38:12.698 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-18T00:38:12.698 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-18T00:38:12.698 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/ceph-helpers/a 2026-02-18T00:38:12.698 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/ceph-helpers/a --run-dir=td/ceph-helpers --osd_pool_default_size=1 --mon_allow_pool_size_one=true 2026-02-18T00:38:12.718 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-18T00:38:12.718 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:38:12.718 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:38:12.718 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:38:12.718 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:38:12.718 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:38:12.719 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.57427/$cluster-$name.asok' 2026-02-18T00:38:12.719 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/ceph-helpers/a '--log-file=td/ceph-helpers/$name.log' '--admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' --mon-cluster-log-file=td/ceph-helpers/log --run-dir=td/ceph-helpers '--pid-file=td/ceph-helpers/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --osd_pool_default_size=1 --mon_allow_pool_size_one=true 2026-02-18T00:38:12.743 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-18T00:38:12.744 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-18T00:38:12.744 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T00:38:12.744 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-18T00:38:12.744 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-18T00:38:12.744 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-18T00:38:12.745 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-18T00:38:12.745 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:38:12.746 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:38:12.746 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:38:12.746 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:38:12.746 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:38:12.746 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.57427/ceph-mon.a.asok 2026-02-18T00:38:12.746 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T00:38:12.746 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.57427/ceph-mon.a.asok config get fsid 2026-02-18T00:38:12.800 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-18T00:38:12.800 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T00:38:12.801 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-18T00:38:12.801 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-18T00:38:12.801 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-18T00:38:12.801 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-18T00:38:12.801 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:38:12.801 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:38:12.802 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:38:12.802 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:38:12.802 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:38:12.802 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.57427/ceph-mon.a.asok 2026-02-18T00:38:12.802 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T00:38:12.802 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.57427/ceph-mon.a.asok config get mon_host 2026-02-18T00:38:12.855 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: test_get_config: get_config mon a osd_pool_default_size 2026-02-18T00:38:12.856 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T00:38:12.856 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-18T00:38:12.856 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=osd_pool_default_size 2026-02-18T00:38:12.856 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .osd_pool_default_size 2026-02-18T00:38:12.857 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-18T00:38:12.857 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:38:12.857 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:38:12.857 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:38:12.857 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:38:12.857 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:38:12.858 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.57427/ceph-mon.a.asok 2026-02-18T00:38:12.858 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T00:38:12.858 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.57427/ceph-mon.a.asok config get osd_pool_default_size 2026-02-18T00:38:12.915 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: test_get_config: test 1 = 1 2026-02-18T00:38:12.915 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1133: test_get_config: run_mgr td/ceph-helpers x 2026-02-18T00:38:12.915 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/ceph-helpers 2026-02-18T00:38:12.915 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-18T00:38:12.915 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-18T00:38:12.916 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-18T00:38:12.916 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/ceph-helpers/x 2026-02-18T00:38:12.916 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-18T00:38:13.031 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-18T00:38:13.031 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:38:13.031 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:38:13.031 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:38:13.031 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:38:13.031 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:38:13.032 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.57427/$cluster-$name.asok' 2026-02-18T00:38:13.032 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-18T00:38:13.033 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/ceph-helpers/x '--log-file=td/ceph-helpers/$name.log' '--admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' --run-dir=td/ceph-helpers '--pid-file=td/ceph-helpers/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-18T00:38:13.052 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1134: test_get_config: run_osd td/ceph-helpers 0 --osd_max_scrubs=3 2026-02-18T00:38:13.052 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/ceph-helpers 2026-02-18T00:38:13.052 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T00:38:13.052 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-18T00:38:13.052 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T00:38:13.052 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/ceph-helpers/0 2026-02-18T00:38:13.052 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--cluster ceph --fsid=863c4e35-ceb0-4172-b7b2-c3ff099e05a2 --auth-supported=none --mon-host=127.0.0.1:7109 ' 2026-02-18T00:38:13.053 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T00:38:13.053 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T00:38:13.053 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T00:38:13.053 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/ceph-helpers/0' 2026-02-18T00:38:13.053 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/ceph-helpers/0/journal' 2026-02-18T00:38:13.053 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T00:38:13.053 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-18T00:38:13.053 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/ceph-helpers' 2026-02-18T00:38:13.053 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T00:38:13.053 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:38:13.053 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:38:13.053 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:38:13.054 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:38:13.054 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:38:13.054 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.57427/$cluster-$name.asok' 2026-02-18T00:38:13.054 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' 2026-02-18T00:38:13.054 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T00:38:13.054 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T00:38:13.054 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T00:38:13.054 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/ceph-helpers/$name.log' 2026-02-18T00:38:13.054 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/ceph-helpers/$name.pid' 2026-02-18T00:38:13.054 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T00:38:13.054 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T00:38:13.054 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T00:38:13.054 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T00:38:13.055 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T00:38:13.055 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=--osd_max_scrubs=3 2026-02-18T00:38:13.055 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/ceph-helpers/0 2026-02-18T00:38:13.055 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T00:38:13.055 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=bf8ec2d5-98a1-444f-8d7a-b21958e53187 2026-02-18T00:38:13.056 INFO:tasks.workunit.client.0.trial069.stdout:add osd0 bf8ec2d5-98a1-444f-8d7a-b21958e53187 2026-02-18T00:38:13.056 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 bf8ec2d5-98a1-444f-8d7a-b21958e53187' 2026-02-18T00:38:13.056 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T00:38:13.064 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQD1CZVpdlJ2AxAAotoPL+SEDGmu0kbEkGUmKA== 2026-02-18T00:38:13.064 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQD1CZVpdlJ2AxAAotoPL+SEDGmu0kbEkGUmKA=="}' 2026-02-18T00:38:13.064 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new bf8ec2d5-98a1-444f-8d7a-b21958e53187 -i td/ceph-helpers/0/new.json 2026-02-18T00:38:13.179 INFO:tasks.workunit.client.0.trial069.stdout:0 2026-02-18T00:38:13.187 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/ceph-helpers/0/new.json 2026-02-18T00:38:13.189 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --cluster ceph --fsid=863c4e35-ceb0-4172-b7b2-c3ff099e05a2 --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/0 --osd-journal=td/ceph-helpers/0/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_max_scrubs=3 --mkfs --key AQD1CZVpdlJ2AxAAotoPL+SEDGmu0kbEkGUmKA== --osd-uuid bf8ec2d5-98a1-444f-8d7a-b21958e53187 2026-02-18T00:38:13.204 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:38:13.193+0000 7f2256020a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:38:13.205 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:38:13.197+0000 7f2256020a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:38:13.206 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:38:13.197+0000 7f2256020a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:38:13.207 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:38:13.197+0000 7f2256020a40 -1 bdev(0x562a9b2e6c00 td/ceph-helpers/0/block) open stat got: (1) Operation not permitted 2026-02-18T00:38:13.207 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:38:13.197+0000 7f2256020a40 -1 bluestore(td/ceph-helpers/0) _read_fsid unparsable uuid 2026-02-18T00:38:13.872 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/ceph-helpers/0/keyring 2026-02-18T00:38:13.872 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T00:38:13.873 INFO:tasks.workunit.client.0.trial069.stdout:adding osd0 key to auth repository 2026-02-18T00:38:13.874 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-18T00:38:13.874 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/ceph-helpers/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T00:38:13.993 INFO:tasks.workunit.client.0.trial069.stdout:start osd.0 2026-02-18T00:38:13.995 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-18T00:38:13.995 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --cluster ceph --fsid=863c4e35-ceb0-4172-b7b2-c3ff099e05a2 --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/0 --osd-journal=td/ceph-helpers/0/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_max_scrubs=3 2026-02-18T00:38:13.995 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T00:38:13.995 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T00:38:13.995 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T00:38:14.017 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:38:14.005+0000 7fc7c372ba40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:38:14.018 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:38:14.009+0000 7fc7c372ba40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:38:14.019 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:38:14.009+0000 7fc7c372ba40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:38:14.102 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-18T00:38:14.102 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:38:14.103 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-18T00:38:14.103 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:38:14.103 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:38:14.103 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:38:14.103 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:38:14.103 INFO:tasks.workunit.client.0.trial069.stdout:0 2026-02-18T00:38:14.103 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:38:14.104 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T00:38:14.210 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:38:14.427 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:38:14.417+0000 7fc7c372ba40 -1 Falling back to public interface 2026-02-18T00:38:15.098 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:38:15.089+0000 7fc7c372ba40 -1 osd.0 0 log_to_monitors true 2026-02-18T00:38:15.211 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:38:15.211 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:38:15.211 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T00:38:15.212 INFO:tasks.workunit.client.0.trial069.stdout:1 2026-02-18T00:38:15.213 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T00:38:15.216 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:38:15.342 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:38:16.344 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:38:16.344 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:38:16.344 INFO:tasks.workunit.client.0.trial069.stdout:2 2026-02-18T00:38:16.345 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-18T00:38:16.345 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:38:16.345 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T00:38:16.554 INFO:tasks.workunit.client.0.trial069.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/580588853,v1:127.0.0.1:6801/580588853] [v2:127.0.0.1:6802/580588853,v1:127.0.0.1:6803/580588853] exists,up bf8ec2d5-98a1-444f-8d7a-b21958e53187 2026-02-18T00:38:16.555 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:38:16.555 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:38:16.556 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:38:16.556 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1135: test_get_config: get_config osd 0 osd_max_scrubs 2026-02-18T00:38:16.556 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=osd 2026-02-18T00:38:16.556 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=0 2026-02-18T00:38:16.556 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=osd_max_scrubs 2026-02-18T00:38:16.556 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .osd_max_scrubs 2026-02-18T00:38:16.556 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path osd.0 2026-02-18T00:38:16.556 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-18T00:38:16.556 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-18T00:38:16.556 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:38:16.556 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:38:16.557 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:38:16.557 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.57427/ceph-osd.0.asok 2026-02-18T00:38:16.557 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T00:38:16.557 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.57427/ceph-osd.0.asok config get osd_max_scrubs 2026-02-18T00:38:16.619 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1135: test_get_config: test 3 = 3 2026-02-18T00:38:16.619 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1136: test_get_config: teardown td/ceph-helpers 2026-02-18T00:38:16.619 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/ceph-helpers 2026-02-18T00:38:16.619 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T00:38:16.619 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/ceph-helpers KILL 2026-02-18T00:38:16.619 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:38:16.619 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:38:16.619 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:38:16.619 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:38:16.619 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:38:16.727 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:38:16.728 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T00:38:16.728 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T00:38:16.728 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T00:38:16.730 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T00:38:16.730 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T00:38:16.730 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T00:38:16.731 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:38:16.731 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T00:38:16.732 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T00:38:16.732 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:38:16.733 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T00:38:16.734 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T00:38:16.734 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/ceph-helpers 2026-02-18T00:38:16.737 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T00:38:16.737 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:38:16.737 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:38:16.737 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.57427 2026-02-18T00:38:16.740 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T00:38:16.740 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T00:38:16.740 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2426: run_tests: for func in $funcs 2026-02-18T00:38:16.740 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2427: run_tests: test_get_is_making_recovery_progress td/ceph-helpers 2026-02-18T00:38:16.740 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: test_get_is_making_recovery_progress: local dir=td/ceph-helpers 2026-02-18T00:38:16.740 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: test_get_is_making_recovery_progress: setup td/ceph-helpers 2026-02-18T00:38:16.740 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/ceph-helpers 2026-02-18T00:38:16.740 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/ceph-helpers 2026-02-18T00:38:16.740 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/ceph-helpers 2026-02-18T00:38:16.740 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T00:38:16.741 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/ceph-helpers KILL 2026-02-18T00:38:16.741 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:38:16.741 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:38:16.741 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:38:16.741 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:38:16.741 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:38:16.741 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:38:16.742 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T00:38:16.742 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T00:38:16.743 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T00:38:16.744 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T00:38:16.744 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T00:38:16.744 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T00:38:16.746 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:38:16.746 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T00:38:16.746 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T00:38:16.746 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:38:16.747 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T00:38:16.748 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T00:38:16.749 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/ceph-helpers 2026-02-18T00:38:16.750 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T00:38:16.750 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:38:16.750 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:38:16.750 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.57427 2026-02-18T00:38:16.751 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T00:38:16.752 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T00:38:16.752 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/ceph-helpers 2026-02-18T00:38:16.753 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-18T00:38:16.753 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:38:16.753 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:38:16.753 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.57427 2026-02-18T00:38:16.754 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-18T00:38:16.755 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-18T00:38:16.756 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-18T00:38:16.756 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/ceph-helpers 1' TERM HUP INT 2026-02-18T00:38:16.756 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1338: test_get_is_making_recovery_progress: run_mon td/ceph-helpers a 2026-02-18T00:38:16.756 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/ceph-helpers 2026-02-18T00:38:16.756 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-18T00:38:16.756 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-18T00:38:16.756 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-18T00:38:16.756 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/ceph-helpers/a 2026-02-18T00:38:16.756 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/ceph-helpers/a --run-dir=td/ceph-helpers 2026-02-18T00:38:16.777 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-18T00:38:16.777 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:38:16.777 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:38:16.778 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:38:16.778 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:38:16.778 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:38:16.778 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.57427/$cluster-$name.asok' 2026-02-18T00:38:16.778 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/ceph-helpers/a '--log-file=td/ceph-helpers/$name.log' '--admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' --mon-cluster-log-file=td/ceph-helpers/log --run-dir=td/ceph-helpers '--pid-file=td/ceph-helpers/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-18T00:38:16.805 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-18T00:38:16.805 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-18T00:38:16.806 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T00:38:16.806 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-18T00:38:16.806 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-18T00:38:16.807 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-18T00:38:16.807 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-18T00:38:16.807 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:38:16.807 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:38:16.807 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:38:16.807 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:38:16.808 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:38:16.808 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.57427/ceph-mon.a.asok 2026-02-18T00:38:16.808 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T00:38:16.808 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.57427/ceph-mon.a.asok config get fsid 2026-02-18T00:38:16.862 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-18T00:38:16.862 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T00:38:16.862 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-18T00:38:16.862 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-18T00:38:16.862 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-18T00:38:16.863 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-18T00:38:16.864 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:38:16.864 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:38:16.864 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:38:16.864 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:38:16.864 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:38:16.864 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.57427/ceph-mon.a.asok 2026-02-18T00:38:16.864 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T00:38:16.864 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.57427/ceph-mon.a.asok config get mon_host 2026-02-18T00:38:16.917 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: test_get_is_making_recovery_progress: run_mgr td/ceph-helpers x 2026-02-18T00:38:16.917 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/ceph-helpers 2026-02-18T00:38:16.917 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-18T00:38:16.917 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-18T00:38:16.917 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-18T00:38:16.917 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/ceph-helpers/x 2026-02-18T00:38:16.917 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-18T00:38:17.026 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-18T00:38:17.026 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:38:17.026 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:38:17.026 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:38:17.026 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:38:17.026 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:38:17.027 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.57427/$cluster-$name.asok' 2026-02-18T00:38:17.027 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-18T00:38:17.028 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/ceph-helpers/x '--log-file=td/ceph-helpers/$name.log' '--admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' --run-dir=td/ceph-helpers '--pid-file=td/ceph-helpers/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-18T00:38:17.046 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: test_get_is_making_recovery_progress: get_is_making_recovery_progress 2026-02-18T00:38:17.046 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-18T00:38:17.046 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-18T00:38:17.046 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-18T00:38:17.046 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-18T00:38:17.047 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-18T00:38:17.047 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-18T00:38:17.160 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-18T00:38:17.161 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-18T00:38:17.161 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1341: test_get_is_making_recovery_progress: teardown td/ceph-helpers 2026-02-18T00:38:17.161 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/ceph-helpers 2026-02-18T00:38:17.161 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T00:38:17.161 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/ceph-helpers KILL 2026-02-18T00:38:17.161 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:38:17.161 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:38:17.161 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:38:17.161 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:38:17.161 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:38:17.268 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:38:17.268 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T00:38:17.269 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T00:38:17.270 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T00:38:17.271 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T00:38:17.271 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T00:38:17.271 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T00:38:17.272 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:38:17.272 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T00:38:17.273 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T00:38:17.273 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:38:17.274 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T00:38:17.275 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T00:38:17.275 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/ceph-helpers 2026-02-18T00:38:17.277 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T00:38:17.278 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:38:17.278 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:38:17.278 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.57427 2026-02-18T00:38:17.280 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T00:38:17.280 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T00:38:17.280 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2426: run_tests: for func in $funcs 2026-02-18T00:38:17.280 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2427: run_tests: test_get_last_scrub_stamp td/ceph-helpers 2026-02-18T00:38:17.280 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1524: test_get_last_scrub_stamp: local dir=td/ceph-helpers 2026-02-18T00:38:17.281 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: test_get_last_scrub_stamp: setup td/ceph-helpers 2026-02-18T00:38:17.281 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/ceph-helpers 2026-02-18T00:38:17.281 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/ceph-helpers 2026-02-18T00:38:17.281 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/ceph-helpers 2026-02-18T00:38:17.281 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T00:38:17.281 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/ceph-helpers KILL 2026-02-18T00:38:17.281 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:38:17.281 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:38:17.281 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:38:17.281 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:38:17.281 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:38:17.282 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:38:17.282 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T00:38:17.283 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T00:38:17.284 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T00:38:17.284 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T00:38:17.285 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T00:38:17.285 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T00:38:17.286 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:38:17.286 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T00:38:17.287 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T00:38:17.287 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:38:17.288 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T00:38:17.289 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T00:38:17.289 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/ceph-helpers 2026-02-18T00:38:17.290 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T00:38:17.290 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:38:17.290 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:38:17.290 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.57427 2026-02-18T00:38:17.291 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T00:38:17.291 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T00:38:17.291 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/ceph-helpers 2026-02-18T00:38:17.293 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-18T00:38:17.293 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:38:17.293 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:38:17.293 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.57427 2026-02-18T00:38:17.294 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-18T00:38:17.295 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-18T00:38:17.295 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-18T00:38:17.295 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/ceph-helpers 1' TERM HUP INT 2026-02-18T00:38:17.295 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: test_get_last_scrub_stamp: run_mon td/ceph-helpers a --osd_pool_default_size=1 --mon_allow_pool_size_one=true 2026-02-18T00:38:17.295 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/ceph-helpers 2026-02-18T00:38:17.295 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-18T00:38:17.296 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-18T00:38:17.296 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-18T00:38:17.296 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/ceph-helpers/a 2026-02-18T00:38:17.296 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/ceph-helpers/a --run-dir=td/ceph-helpers --osd_pool_default_size=1 --mon_allow_pool_size_one=true 2026-02-18T00:38:17.317 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-18T00:38:17.317 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:38:17.317 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:38:17.317 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:38:17.317 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:38:17.317 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:38:17.318 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.57427/$cluster-$name.asok' 2026-02-18T00:38:17.318 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/ceph-helpers/a '--log-file=td/ceph-helpers/$name.log' '--admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' --mon-cluster-log-file=td/ceph-helpers/log --run-dir=td/ceph-helpers '--pid-file=td/ceph-helpers/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --osd_pool_default_size=1 --mon_allow_pool_size_one=true 2026-02-18T00:38:17.345 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-18T00:38:17.346 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-18T00:38:17.346 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T00:38:17.347 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-18T00:38:17.347 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-18T00:38:17.348 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-18T00:38:17.348 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-18T00:38:17.348 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:38:17.348 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:38:17.348 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:38:17.348 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:38:17.349 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:38:17.349 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.57427/ceph-mon.a.asok 2026-02-18T00:38:17.349 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T00:38:17.349 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.57427/ceph-mon.a.asok config get fsid 2026-02-18T00:38:17.403 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-18T00:38:17.403 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T00:38:17.403 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-18T00:38:17.403 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-18T00:38:17.403 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-18T00:38:17.404 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-18T00:38:17.405 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:38:17.405 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:38:17.405 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:38:17.405 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:38:17.405 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:38:17.405 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.57427/ceph-mon.a.asok 2026-02-18T00:38:17.405 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T00:38:17.405 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.57427/ceph-mon.a.asok config get mon_host 2026-02-18T00:38:17.457 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1528: test_get_last_scrub_stamp: run_mgr td/ceph-helpers x 2026-02-18T00:38:17.458 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/ceph-helpers 2026-02-18T00:38:17.458 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-18T00:38:17.458 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-18T00:38:17.458 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-18T00:38:17.458 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/ceph-helpers/x 2026-02-18T00:38:17.458 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-18T00:38:17.574 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-18T00:38:17.574 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:38:17.574 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:38:17.574 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:38:17.574 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:38:17.575 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:38:17.575 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.57427/$cluster-$name.asok' 2026-02-18T00:38:17.575 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-18T00:38:17.576 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/ceph-helpers/x '--log-file=td/ceph-helpers/$name.log' '--admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' --run-dir=td/ceph-helpers '--pid-file=td/ceph-helpers/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-18T00:38:17.595 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1529: test_get_last_scrub_stamp: run_osd td/ceph-helpers 0 2026-02-18T00:38:17.595 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/ceph-helpers 2026-02-18T00:38:17.595 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T00:38:17.595 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-18T00:38:17.596 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T00:38:17.596 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/ceph-helpers/0 2026-02-18T00:38:17.596 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--cluster ceph --fsid=863c4e35-ceb0-4172-b7b2-c3ff099e05a2 --auth-supported=none --mon-host=127.0.0.1:7109 ' 2026-02-18T00:38:17.596 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T00:38:17.596 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T00:38:17.596 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T00:38:17.596 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/ceph-helpers/0' 2026-02-18T00:38:17.596 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/ceph-helpers/0/journal' 2026-02-18T00:38:17.596 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T00:38:17.596 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-18T00:38:17.596 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/ceph-helpers' 2026-02-18T00:38:17.597 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T00:38:17.597 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:38:17.597 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:38:17.597 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:38:17.597 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:38:17.597 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:38:17.597 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.57427/$cluster-$name.asok' 2026-02-18T00:38:17.597 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' 2026-02-18T00:38:17.597 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T00:38:17.597 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T00:38:17.597 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T00:38:17.597 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/ceph-helpers/$name.log' 2026-02-18T00:38:17.597 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/ceph-helpers/$name.pid' 2026-02-18T00:38:17.598 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T00:38:17.598 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T00:38:17.598 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T00:38:17.598 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T00:38:17.598 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T00:38:17.598 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-18T00:38:17.598 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/ceph-helpers/0 2026-02-18T00:38:17.598 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T00:38:17.599 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=d04c76cb-3dd6-413c-bd86-72f86bd01e5e 2026-02-18T00:38:17.599 INFO:tasks.workunit.client.0.trial069.stdout:add osd0 d04c76cb-3dd6-413c-bd86-72f86bd01e5e 2026-02-18T00:38:17.599 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 d04c76cb-3dd6-413c-bd86-72f86bd01e5e' 2026-02-18T00:38:17.599 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T00:38:17.607 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQD5CZVpZMvSIxAAoby5c92KTKEF6C4wm9vcyg== 2026-02-18T00:38:17.607 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQD5CZVpZMvSIxAAoby5c92KTKEF6C4wm9vcyg=="}' 2026-02-18T00:38:17.607 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new d04c76cb-3dd6-413c-bd86-72f86bd01e5e -i td/ceph-helpers/0/new.json 2026-02-18T00:38:17.720 INFO:tasks.workunit.client.0.trial069.stdout:0 2026-02-18T00:38:17.728 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/ceph-helpers/0/new.json 2026-02-18T00:38:17.729 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --cluster ceph --fsid=863c4e35-ceb0-4172-b7b2-c3ff099e05a2 --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/0 --osd-journal=td/ceph-helpers/0/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQD5CZVpZMvSIxAAoby5c92KTKEF6C4wm9vcyg== --osd-uuid d04c76cb-3dd6-413c-bd86-72f86bd01e5e 2026-02-18T00:38:17.746 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:38:17.737+0000 7f7d39ac0a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:38:17.748 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:38:17.737+0000 7f7d39ac0a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:38:17.749 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:38:17.737+0000 7f7d39ac0a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:38:17.749 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:38:17.741+0000 7f7d39ac0a40 -1 bdev(0x55c3c488cc00 td/ceph-helpers/0/block) open stat got: (1) Operation not permitted 2026-02-18T00:38:17.749 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:38:17.741+0000 7f7d39ac0a40 -1 bluestore(td/ceph-helpers/0) _read_fsid unparsable uuid 2026-02-18T00:38:18.466 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/ceph-helpers/0/keyring 2026-02-18T00:38:18.466 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T00:38:18.467 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-18T00:38:18.467 INFO:tasks.workunit.client.0.trial069.stdout:adding osd0 key to auth repository 2026-02-18T00:38:18.467 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/ceph-helpers/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T00:38:18.581 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-18T00:38:18.582 INFO:tasks.workunit.client.0.trial069.stdout:start osd.0 2026-02-18T00:38:18.583 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --cluster ceph --fsid=863c4e35-ceb0-4172-b7b2-c3ff099e05a2 --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/0 --osd-journal=td/ceph-helpers/0/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T00:38:18.583 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T00:38:18.583 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T00:38:18.583 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T00:38:18.597 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:38:18.585+0000 7f9bf9071a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:38:18.599 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:38:18.589+0000 7f9bf9071a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:38:18.600 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:38:18.589+0000 7f9bf9071a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:38:18.691 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-18T00:38:18.691 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:38:18.691 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-18T00:38:18.691 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:38:18.691 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:38:18.692 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:38:18.692 INFO:tasks.workunit.client.0.trial069.stdout:0 2026-02-18T00:38:18.693 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:38:18.693 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:38:18.693 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T00:38:18.797 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:38:19.119 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:38:19.109+0000 7f9bf9071a40 -1 Falling back to public interface 2026-02-18T00:38:19.798 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:38:19.799 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:38:19.799 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T00:38:19.799 INFO:tasks.workunit.client.0.trial069.stdout:1 2026-02-18T00:38:19.800 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:38:19.800 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T00:38:19.906 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:38:20.054 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:38:20.045+0000 7f9bf9071a40 -1 osd.0 0 log_to_monitors true 2026-02-18T00:38:20.908 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:38:20.908 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:38:20.909 INFO:tasks.workunit.client.0.trial069.stdout:2 2026-02-18T00:38:20.909 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-18T00:38:20.910 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:38:20.910 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T00:38:21.120 INFO:tasks.workunit.client.0.trial069.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/1598024314,v1:127.0.0.1:6801/1598024314] [v2:127.0.0.1:6802/1598024314,v1:127.0.0.1:6803/1598024314] exists,up d04c76cb-3dd6-413c-bd86-72f86bd01e5e 2026-02-18T00:38:21.121 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:38:21.121 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:38:21.121 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:38:21.121 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1530: test_get_last_scrub_stamp: create_rbd_pool 2026-02-18T00:38:21.121 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:526: create_rbd_pool: ceph osd pool delete rbd rbd --yes-i-really-really-mean-it 2026-02-18T00:38:21.321 INFO:tasks.workunit.client.0.trial069.stderr:pool 'rbd' does not exist 2026-02-18T00:38:21.331 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:527: create_rbd_pool: create_pool rbd 4 2026-02-18T00:38:21.331 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create rbd 4 2026-02-18T00:38:21.564 INFO:tasks.workunit.client.0.trial069.stderr:pool 'rbd' already exists 2026-02-18T00:38:21.574 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-18T00:38:22.575 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:528: create_rbd_pool: rbd pool init rbd 2026-02-18T00:38:22.855 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1531: test_get_last_scrub_stamp: wait_for_clean 2026-02-18T00:38:22.855 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-18T00:38:22.856 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-18T00:38:22.856 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-18T00:38:22.856 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-18T00:38:22.856 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-18T00:38:22.856 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-18T00:38:22.857 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-18T00:38:22.857 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-18T00:38:22.857 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-18T00:38:22.959 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-18T00:38:22.959 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-18T00:38:22.959 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-18T00:38:22.959 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-18T00:38:22.959 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-18T00:38:22.959 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-18T00:38:23.174 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids=0 2026-02-18T00:38:23.174 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-18T00:38:23.175 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:38:23.175 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-18T00:38:23.252 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836483 2026-02-18T00:38:23.252 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836483 2026-02-18T00:38:23.253 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836483' 2026-02-18T00:38:23.253 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:38:23.253 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836483 2026-02-18T00:38:23.253 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:38:23.253 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-18T00:38:23.254 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-21474836483 2026-02-18T00:38:23.254 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:38:23.255 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=21474836483 2026-02-18T00:38:23.256 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 21474836483' 2026-02-18T00:38:23.256 INFO:tasks.workunit.client.0.trial069.stdout:waiting osd.0 seq 21474836483 2026-02-18T00:38:23.256 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T00:38:23.475 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 21474836481 -lt 21474836483 2026-02-18T00:38:23.476 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-18T00:38:24.476 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-18T00:38:24.477 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T00:38:24.692 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 21474836483 -lt 21474836483 2026-02-18T00:38:24.692 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-18T00:38:24.693 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T00:38:24.693 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T00:38:24.985 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 4 == 0 2026-02-18T00:38:24.985 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-18T00:38:24.985 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-18T00:38:24.985 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-18T00:38:24.985 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-18T00:38:24.986 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-18T00:38:24.986 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-18T00:38:24.986 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-18T00:38:25.200 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=4 2026-02-18T00:38:25.200 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-18T00:38:25.201 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T00:38:25.201 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T00:38:25.485 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 4 = 4 2026-02-18T00:38:25.486 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-18T00:38:25.486 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-18T00:38:25.486 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1532: test_get_last_scrub_stamp: get_last_scrub_stamp 1.0 2026-02-18T00:38:25.486 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-18T00:38:25.486 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-18T00:38:25.486 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-18T00:38:25.486 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-18T00:38:25.697 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1532: test_get_last_scrub_stamp: stamp=2026-02-18T00:38:21.505662+0000 2026-02-18T00:38:25.697 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1533: test_get_last_scrub_stamp: test -n 2026-02-18T00:38:21.505662+0000 2026-02-18T00:38:25.697 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1534: test_get_last_scrub_stamp: teardown td/ceph-helpers 2026-02-18T00:38:25.697 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/ceph-helpers 2026-02-18T00:38:25.697 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T00:38:25.697 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/ceph-helpers KILL 2026-02-18T00:38:25.697 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:38:25.697 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:38:25.697 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:38:25.697 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:38:25.697 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:38:25.804 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:38:25.804 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T00:38:25.805 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T00:38:25.805 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T00:38:25.806 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T00:38:25.806 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T00:38:25.806 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T00:38:25.807 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:38:25.807 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T00:38:25.808 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T00:38:25.808 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:38:25.809 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T00:38:25.810 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T00:38:25.810 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/ceph-helpers 2026-02-18T00:38:25.815 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T00:38:25.815 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:38:25.815 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:38:25.815 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.57427 2026-02-18T00:38:25.817 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T00:38:25.817 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T00:38:25.817 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2426: run_tests: for func in $funcs 2026-02-18T00:38:25.817 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2427: run_tests: test_get_not_primary td/ceph-helpers 2026-02-18T00:38:25.817 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1229: test_get_not_primary: local dir=td/ceph-helpers 2026-02-18T00:38:25.817 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1231: test_get_not_primary: setup td/ceph-helpers 2026-02-18T00:38:25.817 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/ceph-helpers 2026-02-18T00:38:25.817 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/ceph-helpers 2026-02-18T00:38:25.817 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/ceph-helpers 2026-02-18T00:38:25.817 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T00:38:25.817 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/ceph-helpers KILL 2026-02-18T00:38:25.817 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:38:25.817 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:38:25.818 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:38:25.818 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:38:25.818 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:38:25.820 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:38:25.820 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T00:38:25.821 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T00:38:25.821 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T00:38:25.822 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T00:38:25.822 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T00:38:25.822 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T00:38:25.823 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:38:25.823 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T00:38:25.824 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T00:38:25.824 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:38:25.825 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T00:38:25.826 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T00:38:25.826 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/ceph-helpers 2026-02-18T00:38:25.827 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T00:38:25.827 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:38:25.827 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:38:25.828 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.57427 2026-02-18T00:38:25.829 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T00:38:25.829 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T00:38:25.829 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/ceph-helpers 2026-02-18T00:38:25.830 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-18T00:38:25.830 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:38:25.830 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:38:25.830 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.57427 2026-02-18T00:38:25.832 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-18T00:38:25.833 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-18T00:38:25.833 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-18T00:38:25.833 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/ceph-helpers 1' TERM HUP INT 2026-02-18T00:38:25.833 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1232: test_get_not_primary: run_mon td/ceph-helpers a --osd_pool_default_size=2 2026-02-18T00:38:25.833 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/ceph-helpers 2026-02-18T00:38:25.833 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-18T00:38:25.833 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-18T00:38:25.833 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-18T00:38:25.833 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/ceph-helpers/a 2026-02-18T00:38:25.833 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/ceph-helpers/a --run-dir=td/ceph-helpers --osd_pool_default_size=2 2026-02-18T00:38:25.854 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-18T00:38:25.854 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:38:25.854 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:38:25.854 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:38:25.854 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:38:25.854 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:38:25.854 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.57427/$cluster-$name.asok' 2026-02-18T00:38:25.855 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/ceph-helpers/a '--log-file=td/ceph-helpers/$name.log' '--admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' --mon-cluster-log-file=td/ceph-helpers/log --run-dir=td/ceph-helpers '--pid-file=td/ceph-helpers/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --osd_pool_default_size=2 2026-02-18T00:38:25.884 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-18T00:38:25.884 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-18T00:38:25.885 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T00:38:25.885 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-18T00:38:25.885 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-18T00:38:25.885 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-18T00:38:25.885 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-18T00:38:25.885 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:38:25.885 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:38:25.886 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:38:25.886 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:38:25.886 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:38:25.886 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.57427/ceph-mon.a.asok 2026-02-18T00:38:25.886 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T00:38:25.886 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.57427/ceph-mon.a.asok config get fsid 2026-02-18T00:38:25.940 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-18T00:38:25.940 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T00:38:25.940 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-18T00:38:25.940 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-18T00:38:25.940 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-18T00:38:25.941 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-18T00:38:25.941 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:38:25.941 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:38:25.941 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:38:25.941 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:38:25.941 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:38:25.941 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.57427/ceph-mon.a.asok 2026-02-18T00:38:25.942 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T00:38:25.942 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.57427/ceph-mon.a.asok config get mon_host 2026-02-18T00:38:25.995 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1233: test_get_not_primary: run_mgr td/ceph-helpers x 2026-02-18T00:38:25.995 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/ceph-helpers 2026-02-18T00:38:25.995 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-18T00:38:25.995 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-18T00:38:25.995 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-18T00:38:25.995 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/ceph-helpers/x 2026-02-18T00:38:25.995 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-18T00:38:26.103 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-18T00:38:26.103 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:38:26.103 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:38:26.104 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:38:26.104 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:38:26.104 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:38:26.104 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.57427/$cluster-$name.asok' 2026-02-18T00:38:26.105 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-18T00:38:26.106 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/ceph-helpers/x '--log-file=td/ceph-helpers/$name.log' '--admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' --run-dir=td/ceph-helpers '--pid-file=td/ceph-helpers/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-18T00:38:26.124 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1234: test_get_not_primary: run_osd td/ceph-helpers 0 2026-02-18T00:38:26.124 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/ceph-helpers 2026-02-18T00:38:26.124 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T00:38:26.124 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-18T00:38:26.124 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T00:38:26.124 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/ceph-helpers/0 2026-02-18T00:38:26.124 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--cluster ceph --fsid=863c4e35-ceb0-4172-b7b2-c3ff099e05a2 --auth-supported=none --mon-host=127.0.0.1:7109 ' 2026-02-18T00:38:26.124 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T00:38:26.125 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T00:38:26.125 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T00:38:26.125 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/ceph-helpers/0' 2026-02-18T00:38:26.125 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/ceph-helpers/0/journal' 2026-02-18T00:38:26.125 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T00:38:26.125 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-18T00:38:26.125 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/ceph-helpers' 2026-02-18T00:38:26.125 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T00:38:26.125 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:38:26.125 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:38:26.125 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:38:26.125 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:38:26.125 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:38:26.125 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.57427/$cluster-$name.asok' 2026-02-18T00:38:26.126 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' 2026-02-18T00:38:26.126 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T00:38:26.126 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T00:38:26.126 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T00:38:26.126 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/ceph-helpers/$name.log' 2026-02-18T00:38:26.126 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/ceph-helpers/$name.pid' 2026-02-18T00:38:26.126 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T00:38:26.126 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T00:38:26.126 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T00:38:26.126 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T00:38:26.126 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T00:38:26.126 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-18T00:38:26.126 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/ceph-helpers/0 2026-02-18T00:38:26.127 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T00:38:26.128 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=9d06c238-0083-472e-b670-853a1c1aa689 2026-02-18T00:38:26.128 INFO:tasks.workunit.client.0.trial069.stdout:add osd0 9d06c238-0083-472e-b670-853a1c1aa689 2026-02-18T00:38:26.128 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 9d06c238-0083-472e-b670-853a1c1aa689' 2026-02-18T00:38:26.128 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T00:38:26.140 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQACCpVptPD1BxAAubRKGCRN/xQJiZg2SAQ1Mg== 2026-02-18T00:38:26.140 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQACCpVptPD1BxAAubRKGCRN/xQJiZg2SAQ1Mg=="}' 2026-02-18T00:38:26.140 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 9d06c238-0083-472e-b670-853a1c1aa689 -i td/ceph-helpers/0/new.json 2026-02-18T00:38:26.253 INFO:tasks.workunit.client.0.trial069.stdout:0 2026-02-18T00:38:26.261 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/ceph-helpers/0/new.json 2026-02-18T00:38:26.263 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --cluster ceph --fsid=863c4e35-ceb0-4172-b7b2-c3ff099e05a2 --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/0 --osd-journal=td/ceph-helpers/0/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQACCpVptPD1BxAAubRKGCRN/xQJiZg2SAQ1Mg== --osd-uuid 9d06c238-0083-472e-b670-853a1c1aa689 2026-02-18T00:38:26.279 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:38:26.268+0000 7f5a84abba40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:38:26.281 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:38:26.272+0000 7f5a84abba40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:38:26.283 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:38:26.272+0000 7f5a84abba40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:38:26.283 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:38:26.272+0000 7f5a84abba40 -1 bdev(0x55736c026c00 td/ceph-helpers/0/block) open stat got: (1) Operation not permitted 2026-02-18T00:38:26.283 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:38:26.272+0000 7f5a84abba40 -1 bluestore(td/ceph-helpers/0) _read_fsid unparsable uuid 2026-02-18T00:38:27.021 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/ceph-helpers/0/keyring 2026-02-18T00:38:27.022 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T00:38:27.022 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-18T00:38:27.023 INFO:tasks.workunit.client.0.trial069.stdout:adding osd0 key to auth repository 2026-02-18T00:38:27.023 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/ceph-helpers/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T00:38:27.144 INFO:tasks.workunit.client.0.trial069.stdout:start osd.0 2026-02-18T00:38:27.145 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-18T00:38:27.145 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --cluster ceph --fsid=863c4e35-ceb0-4172-b7b2-c3ff099e05a2 --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/0 --osd-journal=td/ceph-helpers/0/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T00:38:27.145 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T00:38:27.145 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T00:38:27.145 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T00:38:27.168 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:38:27.156+0000 7f7d86364a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:38:27.171 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:38:27.160+0000 7f7d86364a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:38:27.172 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:38:27.160+0000 7f7d86364a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:38:27.252 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-18T00:38:27.252 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:38:27.252 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-18T00:38:27.252 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:38:27.252 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:38:27.252 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:38:27.252 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:38:27.253 INFO:tasks.workunit.client.0.trial069.stdout:0 2026-02-18T00:38:27.253 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:38:27.254 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T00:38:27.359 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:38:27.703 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:38:27.692+0000 7f7d86364a40 -1 Falling back to public interface 2026-02-18T00:38:28.360 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:38:28.361 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:38:28.361 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T00:38:28.361 INFO:tasks.workunit.client.0.trial069.stdout:1 2026-02-18T00:38:28.362 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:38:28.362 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T00:38:28.467 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:38:28.668 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:38:28.656+0000 7f7d86364a40 -1 osd.0 0 log_to_monitors true 2026-02-18T00:38:29.468 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:38:29.469 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:38:29.469 INFO:tasks.workunit.client.0.trial069.stdout:2 2026-02-18T00:38:29.470 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-18T00:38:29.470 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:38:29.470 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T00:38:29.687 INFO:tasks.workunit.client.0.trial069.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/2050679577,v1:127.0.0.1:6801/2050679577] [v2:127.0.0.1:6802/2050679577,v1:127.0.0.1:6803/2050679577] exists,up 9d06c238-0083-472e-b670-853a1c1aa689 2026-02-18T00:38:29.690 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:38:29.690 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:38:29.690 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:38:29.690 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1235: test_get_not_primary: run_osd td/ceph-helpers 1 2026-02-18T00:38:29.690 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/ceph-helpers 2026-02-18T00:38:29.690 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T00:38:29.690 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2026-02-18T00:38:29.690 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T00:38:29.691 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/ceph-helpers/1 2026-02-18T00:38:29.691 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--cluster ceph --fsid=863c4e35-ceb0-4172-b7b2-c3ff099e05a2 --auth-supported=none --mon-host=127.0.0.1:7109 ' 2026-02-18T00:38:29.691 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T00:38:29.691 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T00:38:29.691 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T00:38:29.691 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/ceph-helpers/1' 2026-02-18T00:38:29.691 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/ceph-helpers/1/journal' 2026-02-18T00:38:29.691 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T00:38:29.691 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-18T00:38:29.691 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/ceph-helpers' 2026-02-18T00:38:29.691 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T00:38:29.691 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:38:29.692 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:38:29.692 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:38:29.692 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:38:29.692 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:38:29.692 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.57427/$cluster-$name.asok' 2026-02-18T00:38:29.692 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' 2026-02-18T00:38:29.692 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T00:38:29.692 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T00:38:29.692 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T00:38:29.692 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/ceph-helpers/$name.log' 2026-02-18T00:38:29.692 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/ceph-helpers/$name.pid' 2026-02-18T00:38:29.692 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T00:38:29.692 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T00:38:29.693 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T00:38:29.693 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T00:38:29.693 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T00:38:29.693 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-18T00:38:29.693 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/ceph-helpers/1 2026-02-18T00:38:29.693 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T00:38:29.694 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=7528e5bc-0a43-4e13-9d10-161d11490098 2026-02-18T00:38:29.694 INFO:tasks.workunit.client.0.trial069.stdout:add osd1 7528e5bc-0a43-4e13-9d10-161d11490098 2026-02-18T00:38:29.694 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 7528e5bc-0a43-4e13-9d10-161d11490098' 2026-02-18T00:38:29.694 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T00:38:29.704 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQAFCpVpBxaPKRAAv8BDy5hxDeHgM5u2nradig== 2026-02-18T00:38:29.704 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQAFCpVpBxaPKRAAv8BDy5hxDeHgM5u2nradig=="}' 2026-02-18T00:38:29.704 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 7528e5bc-0a43-4e13-9d10-161d11490098 -i td/ceph-helpers/1/new.json 2026-02-18T00:38:29.910 INFO:tasks.workunit.client.0.trial069.stdout:1 2026-02-18T00:38:29.919 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/ceph-helpers/1/new.json 2026-02-18T00:38:29.920 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --cluster ceph --fsid=863c4e35-ceb0-4172-b7b2-c3ff099e05a2 --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/1 --osd-journal=td/ceph-helpers/1/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAFCpVpBxaPKRAAv8BDy5hxDeHgM5u2nradig== --osd-uuid 7528e5bc-0a43-4e13-9d10-161d11490098 2026-02-18T00:38:29.936 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:38:29.924+0000 7f429a0cfa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:38:29.937 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:38:29.924+0000 7f429a0cfa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:38:29.938 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:38:29.928+0000 7f429a0cfa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:38:29.939 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:38:29.928+0000 7f429a0cfa40 -1 bdev(0x5618f41eec00 td/ceph-helpers/1/block) open stat got: (1) Operation not permitted 2026-02-18T00:38:29.939 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:38:29.928+0000 7f429a0cfa40 -1 bluestore(td/ceph-helpers/1) _read_fsid unparsable uuid 2026-02-18T00:38:30.585 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/ceph-helpers/1/keyring 2026-02-18T00:38:30.585 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T00:38:30.586 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2026-02-18T00:38:30.587 INFO:tasks.workunit.client.0.trial069.stdout:adding osd1 key to auth repository 2026-02-18T00:38:30.587 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/ceph-helpers/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T00:38:30.868 INFO:tasks.workunit.client.0.trial069.stdout:start osd.1 2026-02-18T00:38:30.869 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2026-02-18T00:38:30.869 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --cluster ceph --fsid=863c4e35-ceb0-4172-b7b2-c3ff099e05a2 --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/1 --osd-journal=td/ceph-helpers/1/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T00:38:30.869 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T00:38:30.869 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T00:38:30.870 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T00:38:30.892 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:38:30.880+0000 7efcf4a6ba40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:38:30.893 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:38:30.884+0000 7efcf4a6ba40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:38:30.895 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:38:30.884+0000 7efcf4a6ba40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:38:31.082 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2026-02-18T00:38:31.083 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:38:31.083 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-18T00:38:31.083 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:38:31.083 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:38:31.083 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:38:31.083 INFO:tasks.workunit.client.0.trial069.stdout:0 2026-02-18T00:38:31.084 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:38:31.084 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:38:31.084 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-18T00:38:31.251 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:38:31.240+0000 7efcf4a6ba40 -1 Falling back to public interface 2026-02-18T00:38:31.295 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:38:31.828 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:38:31.816+0000 7efcf4a6ba40 -1 osd.1 0 log_to_monitors true 2026-02-18T00:38:32.297 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:38:32.297 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:38:32.297 INFO:tasks.workunit.client.0.trial069.stdout:1 2026-02-18T00:38:32.298 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T00:38:32.298 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:38:32.298 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-18T00:38:32.510 INFO:tasks.workunit.client.0.trial069.stdout:osd.1 up in weight 1 up_from 9 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/298379322,v1:127.0.0.1:6811/298379322] [v2:127.0.0.1:6812/298379322,v1:127.0.0.1:6813/298379322] exists,up 7528e5bc-0a43-4e13-9d10-161d11490098 2026-02-18T00:38:32.511 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:38:32.511 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:38:32.511 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:38:32.511 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1236: test_get_not_primary: create_rbd_pool 2026-02-18T00:38:32.511 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:526: create_rbd_pool: ceph osd pool delete rbd rbd --yes-i-really-really-mean-it 2026-02-18T00:38:32.713 INFO:tasks.workunit.client.0.trial069.stderr:pool 'rbd' does not exist 2026-02-18T00:38:32.722 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:527: create_rbd_pool: create_pool rbd 4 2026-02-18T00:38:32.722 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create rbd 4 2026-02-18T00:38:32.996 INFO:tasks.workunit.client.0.trial069.stderr:pool 'rbd' already exists 2026-02-18T00:38:33.007 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-18T00:38:34.009 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:528: create_rbd_pool: rbd pool init rbd 2026-02-18T00:38:34.291 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1237: test_get_not_primary: wait_for_clean 2026-02-18T00:38:34.291 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-18T00:38:34.291 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-18T00:38:34.292 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-18T00:38:34.292 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-18T00:38:34.293 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-18T00:38:34.293 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-18T00:38:34.293 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-18T00:38:34.293 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-18T00:38:34.293 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-18T00:38:34.394 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-18T00:38:34.394 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-18T00:38:34.394 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-18T00:38:34.394 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-18T00:38:34.394 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-18T00:38:34.394 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-18T00:38:34.608 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-18T00:38:34.608 INFO:tasks.workunit.client.0.trial069.stderr:1' 2026-02-18T00:38:34.608 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-18T00:38:34.608 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:38:34.608 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-18T00:38:34.685 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836483 2026-02-18T00:38:34.685 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836483 2026-02-18T00:38:34.685 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836483' 2026-02-18T00:38:34.686 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:38:34.686 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-18T00:38:34.764 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705667 2026-02-18T00:38:34.764 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705667 2026-02-18T00:38:34.765 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836483 1-38654705667' 2026-02-18T00:38:34.765 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:38:34.765 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836483 2026-02-18T00:38:34.765 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:38:34.765 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-18T00:38:34.766 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-21474836483 2026-02-18T00:38:34.766 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:38:34.767 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=21474836483 2026-02-18T00:38:34.768 INFO:tasks.workunit.client.0.trial069.stdout:waiting osd.0 seq 21474836483 2026-02-18T00:38:34.768 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 21474836483' 2026-02-18T00:38:34.768 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T00:38:34.986 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 21474836481 -lt 21474836483 2026-02-18T00:38:34.986 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-18T00:38:35.987 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-18T00:38:35.988 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T00:38:36.206 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 21474836481 -lt 21474836483 2026-02-18T00:38:36.206 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-18T00:38:37.207 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-18T00:38:37.208 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T00:38:37.421 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 21474836484 -lt 21474836483 2026-02-18T00:38:37.421 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:38:37.421 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705667 2026-02-18T00:38:37.422 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:38:37.423 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=1 2026-02-18T00:38:37.423 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 1-38654705667 2026-02-18T00:38:37.423 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:38:37.425 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=38654705667 2026-02-18T00:38:37.425 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.1 seq 38654705667' 2026-02-18T00:38:37.425 INFO:tasks.workunit.client.0.trial069.stdout:waiting osd.1 seq 38654705667 2026-02-18T00:38:37.425 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-18T00:38:37.646 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 38654705667 -lt 38654705667 2026-02-18T00:38:37.647 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-18T00:38:37.647 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T00:38:37.647 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T00:38:37.928 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 4 == 0 2026-02-18T00:38:37.928 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-18T00:38:37.928 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-18T00:38:37.928 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-18T00:38:37.929 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-18T00:38:37.929 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-18T00:38:37.929 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-18T00:38:37.929 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-18T00:38:38.141 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=4 2026-02-18T00:38:38.142 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-18T00:38:38.142 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T00:38:38.142 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T00:38:38.420 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 4 = 4 2026-02-18T00:38:38.420 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-18T00:38:38.420 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-18T00:38:38.420 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1238: test_get_not_primary: get_primary rbd GROUP 2026-02-18T00:38:38.420 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1187: get_primary: local poolname=rbd 2026-02-18T00:38:38.420 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1188: get_primary: local objectname=GROUP 2026-02-18T00:38:38.421 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1190: get_primary: ceph --format json osd map rbd GROUP 2026-02-18T00:38:38.421 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1191: get_primary: jq .acting_primary 2026-02-18T00:38:38.639 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1238: test_get_not_primary: local primary=1 2026-02-18T00:38:38.640 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1239: test_get_not_primary: get_not_primary rbd GROUP 2026-02-18T00:38:38.640 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1220: get_not_primary: local poolname=rbd 2026-02-18T00:38:38.640 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1221: get_not_primary: local objectname=GROUP 2026-02-18T00:38:38.640 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1223: get_not_primary: get_primary rbd GROUP 2026-02-18T00:38:38.640 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1187: get_primary: local poolname=rbd 2026-02-18T00:38:38.640 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1188: get_primary: local objectname=GROUP 2026-02-18T00:38:38.641 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1190: get_primary: ceph --format json osd map rbd GROUP 2026-02-18T00:38:38.641 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1191: get_primary: jq .acting_primary 2026-02-18T00:38:38.855 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1223: get_not_primary: local primary=1 2026-02-18T00:38:38.855 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1224: get_not_primary: ceph --format json osd map rbd GROUP 2026-02-18T00:38:38.855 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1225: get_not_primary: jq '.acting | map(select (. != 1)) | .[0]' 2026-02-18T00:38:39.079 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1239: test_get_not_primary: local not_primary=0 2026-02-18T00:38:39.080 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1240: test_get_not_primary: test 0 '!=' 1 2026-02-18T00:38:39.080 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1241: test_get_not_primary: test 0 = 0 -o 0 = 1 2026-02-18T00:38:39.080 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1242: test_get_not_primary: teardown td/ceph-helpers 2026-02-18T00:38:39.080 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/ceph-helpers 2026-02-18T00:38:39.080 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T00:38:39.080 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/ceph-helpers KILL 2026-02-18T00:38:39.080 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:38:39.080 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:38:39.080 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:38:39.080 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:38:39.080 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:38:39.187 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:38:39.188 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T00:38:39.189 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T00:38:39.189 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T00:38:39.190 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T00:38:39.190 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T00:38:39.191 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T00:38:39.191 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:38:39.191 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T00:38:39.192 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T00:38:39.192 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:38:39.193 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T00:38:39.194 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T00:38:39.194 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/ceph-helpers 2026-02-18T00:38:39.202 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T00:38:39.202 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:38:39.202 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:38:39.202 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.57427 2026-02-18T00:38:39.204 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T00:38:39.205 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T00:38:39.205 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2426: run_tests: for func in $funcs 2026-02-18T00:38:39.205 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2427: run_tests: test_get_num_active_clean td/ceph-helpers 2026-02-18T00:38:39.205 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: test_get_num_active_clean: local dir=td/ceph-helpers 2026-02-18T00:38:39.205 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: test_get_num_active_clean: setup td/ceph-helpers 2026-02-18T00:38:39.205 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/ceph-helpers 2026-02-18T00:38:39.205 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/ceph-helpers 2026-02-18T00:38:39.205 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/ceph-helpers 2026-02-18T00:38:39.205 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T00:38:39.205 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/ceph-helpers KILL 2026-02-18T00:38:39.205 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:38:39.205 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:38:39.206 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:38:39.206 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:38:39.206 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:38:39.206 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:38:39.207 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T00:38:39.207 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T00:38:39.208 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T00:38:39.209 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T00:38:39.209 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T00:38:39.209 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T00:38:39.210 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:38:39.210 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T00:38:39.211 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T00:38:39.211 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:38:39.212 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T00:38:39.213 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T00:38:39.213 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/ceph-helpers 2026-02-18T00:38:39.214 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T00:38:39.214 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:38:39.214 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:38:39.214 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.57427 2026-02-18T00:38:39.215 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T00:38:39.215 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T00:38:39.215 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/ceph-helpers 2026-02-18T00:38:39.217 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-18T00:38:39.217 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:38:39.217 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:38:39.217 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.57427 2026-02-18T00:38:39.218 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-18T00:38:39.220 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-18T00:38:39.220 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-18T00:38:39.220 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/ceph-helpers 1' TERM HUP INT 2026-02-18T00:38:39.220 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: test_get_num_active_clean: run_mon td/ceph-helpers a --osd_pool_default_size=1 --mon_allow_pool_size_one=true 2026-02-18T00:38:39.220 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/ceph-helpers 2026-02-18T00:38:39.220 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-18T00:38:39.220 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-18T00:38:39.220 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-18T00:38:39.220 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/ceph-helpers/a 2026-02-18T00:38:39.220 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/ceph-helpers/a --run-dir=td/ceph-helpers --osd_pool_default_size=1 --mon_allow_pool_size_one=true 2026-02-18T00:38:39.241 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-18T00:38:39.241 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:38:39.241 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:38:39.242 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:38:39.242 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:38:39.242 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:38:39.242 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.57427/$cluster-$name.asok' 2026-02-18T00:38:39.242 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/ceph-helpers/a '--log-file=td/ceph-helpers/$name.log' '--admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' --mon-cluster-log-file=td/ceph-helpers/log --run-dir=td/ceph-helpers '--pid-file=td/ceph-helpers/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --osd_pool_default_size=1 --mon_allow_pool_size_one=true 2026-02-18T00:38:39.269 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-18T00:38:39.270 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-18T00:38:39.270 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T00:38:39.270 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-18T00:38:39.271 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-18T00:38:39.272 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-18T00:38:39.272 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-18T00:38:39.272 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:38:39.272 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:38:39.272 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:38:39.272 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:38:39.272 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:38:39.272 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.57427/ceph-mon.a.asok 2026-02-18T00:38:39.273 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T00:38:39.273 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.57427/ceph-mon.a.asok config get fsid 2026-02-18T00:38:39.327 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-18T00:38:39.327 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T00:38:39.327 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-18T00:38:39.327 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-18T00:38:39.327 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-18T00:38:39.328 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-18T00:38:39.328 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:38:39.328 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:38:39.329 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:38:39.329 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:38:39.329 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:38:39.329 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.57427/ceph-mon.a.asok 2026-02-18T00:38:39.329 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T00:38:39.329 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.57427/ceph-mon.a.asok config get mon_host 2026-02-18T00:38:39.382 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: test_get_num_active_clean: run_mgr td/ceph-helpers x 2026-02-18T00:38:39.383 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/ceph-helpers 2026-02-18T00:38:39.383 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-18T00:38:39.383 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-18T00:38:39.383 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-18T00:38:39.383 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/ceph-helpers/x 2026-02-18T00:38:39.383 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-18T00:38:39.493 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-18T00:38:39.494 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:38:39.494 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:38:39.494 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:38:39.494 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:38:39.494 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:38:39.495 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.57427/$cluster-$name.asok' 2026-02-18T00:38:39.495 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-18T00:38:39.495 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/ceph-helpers/x '--log-file=td/ceph-helpers/$name.log' '--admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' --run-dir=td/ceph-helpers '--pid-file=td/ceph-helpers/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-18T00:38:39.516 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: test_get_num_active_clean: run_osd td/ceph-helpers 0 2026-02-18T00:38:39.516 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/ceph-helpers 2026-02-18T00:38:39.517 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T00:38:39.517 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-18T00:38:39.517 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T00:38:39.517 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/ceph-helpers/0 2026-02-18T00:38:39.517 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--cluster ceph --fsid=863c4e35-ceb0-4172-b7b2-c3ff099e05a2 --auth-supported=none --mon-host=127.0.0.1:7109 ' 2026-02-18T00:38:39.517 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T00:38:39.517 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T00:38:39.517 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T00:38:39.517 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/ceph-helpers/0' 2026-02-18T00:38:39.517 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/ceph-helpers/0/journal' 2026-02-18T00:38:39.517 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T00:38:39.517 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-18T00:38:39.518 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/ceph-helpers' 2026-02-18T00:38:39.518 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T00:38:39.518 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:38:39.518 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:38:39.518 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:38:39.518 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:38:39.518 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:38:39.518 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.57427/$cluster-$name.asok' 2026-02-18T00:38:39.518 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' 2026-02-18T00:38:39.518 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T00:38:39.518 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T00:38:39.518 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T00:38:39.519 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/ceph-helpers/$name.log' 2026-02-18T00:38:39.519 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/ceph-helpers/$name.pid' 2026-02-18T00:38:39.519 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T00:38:39.519 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T00:38:39.519 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T00:38:39.519 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T00:38:39.519 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T00:38:39.519 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-18T00:38:39.519 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/ceph-helpers/0 2026-02-18T00:38:39.520 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T00:38:39.520 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=02572c34-440d-41f8-be17-7ac5dafc6543 2026-02-18T00:38:39.520 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 02572c34-440d-41f8-be17-7ac5dafc6543' 2026-02-18T00:38:39.520 INFO:tasks.workunit.client.0.trial069.stdout:add osd0 02572c34-440d-41f8-be17-7ac5dafc6543 2026-02-18T00:38:39.521 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T00:38:39.531 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQAPCpVpRY04HxAA3Kqw16ky/z1a9SC4NYxPFg== 2026-02-18T00:38:39.531 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQAPCpVpRY04HxAA3Kqw16ky/z1a9SC4NYxPFg=="}' 2026-02-18T00:38:39.531 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 02572c34-440d-41f8-be17-7ac5dafc6543 -i td/ceph-helpers/0/new.json 2026-02-18T00:38:39.646 INFO:tasks.workunit.client.0.trial069.stdout:0 2026-02-18T00:38:39.655 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/ceph-helpers/0/new.json 2026-02-18T00:38:39.656 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --cluster ceph --fsid=863c4e35-ceb0-4172-b7b2-c3ff099e05a2 --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/0 --osd-journal=td/ceph-helpers/0/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAPCpVpRY04HxAA3Kqw16ky/z1a9SC4NYxPFg== --osd-uuid 02572c34-440d-41f8-be17-7ac5dafc6543 2026-02-18T00:38:39.672 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:38:39.660+0000 7fcec2d0aa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:38:39.673 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:38:39.660+0000 7fcec2d0aa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:38:39.674 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:38:39.664+0000 7fcec2d0aa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:38:39.675 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:38:39.664+0000 7fcec2d0aa40 -1 bdev(0x556f67e58c00 td/ceph-helpers/0/block) open stat got: (1) Operation not permitted 2026-02-18T00:38:39.675 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:38:39.664+0000 7fcec2d0aa40 -1 bluestore(td/ceph-helpers/0) _read_fsid unparsable uuid 2026-02-18T00:38:40.417 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/ceph-helpers/0/keyring 2026-02-18T00:38:40.417 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T00:38:40.418 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-18T00:38:40.418 INFO:tasks.workunit.client.0.trial069.stdout:adding osd0 key to auth repository 2026-02-18T00:38:40.419 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/ceph-helpers/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T00:38:40.538 INFO:tasks.workunit.client.0.trial069.stdout:start osd.0 2026-02-18T00:38:40.539 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-18T00:38:40.539 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --cluster ceph --fsid=863c4e35-ceb0-4172-b7b2-c3ff099e05a2 --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/0 --osd-journal=td/ceph-helpers/0/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T00:38:40.539 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T00:38:40.539 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T00:38:40.540 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T00:38:40.561 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:38:40.548+0000 7f116fbb8a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:38:40.563 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:38:40.552+0000 7f116fbb8a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:38:40.565 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:38:40.552+0000 7f116fbb8a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:38:40.647 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-18T00:38:40.647 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:38:40.647 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-18T00:38:40.647 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:38:40.647 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:38:40.648 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:38:40.648 INFO:tasks.workunit.client.0.trial069.stdout:0 2026-02-18T00:38:40.649 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:38:40.649 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:38:40.649 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T00:38:40.763 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:38:41.023 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:38:41.012+0000 7f116fbb8a40 -1 Falling back to public interface 2026-02-18T00:38:41.764 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:38:41.764 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:38:41.764 INFO:tasks.workunit.client.0.trial069.stdout:1 2026-02-18T00:38:41.764 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T00:38:41.765 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:38:41.765 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T00:38:41.869 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:38:41.976 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:38:41.964+0000 7f116fbb8a40 -1 osd.0 0 log_to_monitors true 2026-02-18T00:38:42.871 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:38:42.871 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:38:42.872 INFO:tasks.workunit.client.0.trial069.stdout:2 2026-02-18T00:38:42.872 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-18T00:38:42.873 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:38:42.873 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T00:38:43.089 INFO:tasks.workunit.client.0.trial069.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/1298184078,v1:127.0.0.1:6801/1298184078] [v2:127.0.0.1:6802/1298184078,v1:127.0.0.1:6803/1298184078] exists,up 02572c34-440d-41f8-be17-7ac5dafc6543 2026-02-18T00:38:43.090 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:38:43.090 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:38:43.090 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:38:43.090 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1369: test_get_num_active_clean: create_rbd_pool 2026-02-18T00:38:43.090 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:526: create_rbd_pool: ceph osd pool delete rbd rbd --yes-i-really-really-mean-it 2026-02-18T00:38:43.289 INFO:tasks.workunit.client.0.trial069.stderr:pool 'rbd' does not exist 2026-02-18T00:38:43.300 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:527: create_rbd_pool: create_pool rbd 4 2026-02-18T00:38:43.300 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create rbd 4 2026-02-18T00:38:43.531 INFO:tasks.workunit.client.0.trial069.stderr:pool 'rbd' already exists 2026-02-18T00:38:43.542 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-18T00:38:44.543 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:528: create_rbd_pool: rbd pool init rbd 2026-02-18T00:38:44.822 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1370: test_get_num_active_clean: wait_for_clean 2026-02-18T00:38:44.822 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-18T00:38:44.822 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-18T00:38:44.822 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-18T00:38:44.822 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-18T00:38:44.823 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-18T00:38:44.823 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-18T00:38:44.823 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-18T00:38:44.823 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-18T00:38:44.824 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-18T00:38:44.924 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-18T00:38:44.924 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-18T00:38:44.924 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-18T00:38:44.924 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-18T00:38:44.924 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-18T00:38:44.924 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-18T00:38:45.141 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids=0 2026-02-18T00:38:45.141 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-18T00:38:45.142 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:38:45.142 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-18T00:38:45.221 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836483 2026-02-18T00:38:45.221 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836483 2026-02-18T00:38:45.221 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836483' 2026-02-18T00:38:45.221 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:38:45.222 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836483 2026-02-18T00:38:45.222 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:38:45.222 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-18T00:38:45.223 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-21474836483 2026-02-18T00:38:45.223 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:38:45.225 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=21474836483 2026-02-18T00:38:45.225 INFO:tasks.workunit.client.0.trial069.stdout:waiting osd.0 seq 21474836483 2026-02-18T00:38:45.225 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 21474836483' 2026-02-18T00:38:45.225 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T00:38:45.446 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 21474836481 -lt 21474836483 2026-02-18T00:38:45.447 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-18T00:38:46.448 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-18T00:38:46.448 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T00:38:46.666 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 21474836483 -lt 21474836483 2026-02-18T00:38:46.667 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-18T00:38:46.667 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T00:38:46.667 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T00:38:46.946 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 4 == 0 2026-02-18T00:38:46.946 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-18T00:38:46.946 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-18T00:38:46.946 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-18T00:38:46.947 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-18T00:38:46.947 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-18T00:38:46.947 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-18T00:38:46.947 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-18T00:38:47.150 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=4 2026-02-18T00:38:47.150 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-18T00:38:47.151 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T00:38:47.151 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T00:38:47.429 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 4 = 4 2026-02-18T00:38:47.429 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-18T00:38:47.429 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-18T00:38:47.429 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1371: test_get_num_active_clean: get_num_active_clean 2026-02-18T00:38:47.429 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-18T00:38:47.429 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-18T00:38:47.429 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-18T00:38:47.429 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-18T00:38:47.430 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-18T00:38:47.643 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1371: test_get_num_active_clean: local num_active_clean=4 2026-02-18T00:38:47.644 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1372: test_get_num_active_clean: test 4 = 4 2026-02-18T00:38:47.644 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1373: test_get_num_active_clean: teardown td/ceph-helpers 2026-02-18T00:38:47.644 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/ceph-helpers 2026-02-18T00:38:47.644 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T00:38:47.644 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/ceph-helpers KILL 2026-02-18T00:38:47.644 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:38:47.644 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:38:47.644 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:38:47.644 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:38:47.644 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:38:47.953 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:38:47.953 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T00:38:47.954 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T00:38:47.955 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T00:38:47.956 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T00:38:47.957 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T00:38:47.957 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T00:38:47.958 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:38:47.958 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T00:38:47.959 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T00:38:47.959 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:38:47.960 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T00:38:47.961 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T00:38:47.962 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/ceph-helpers 2026-02-18T00:38:47.966 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T00:38:47.966 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:38:47.966 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:38:47.967 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.57427 2026-02-18T00:38:47.969 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T00:38:47.969 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T00:38:47.969 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2426: run_tests: for func in $funcs 2026-02-18T00:38:47.969 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2427: run_tests: test_get_num_active_or_peered td/ceph-helpers 2026-02-18T00:38:47.969 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1393: test_get_num_active_or_peered: local dir=td/ceph-helpers 2026-02-18T00:38:47.969 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1395: test_get_num_active_or_peered: setup td/ceph-helpers 2026-02-18T00:38:47.969 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/ceph-helpers 2026-02-18T00:38:47.970 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/ceph-helpers 2026-02-18T00:38:47.970 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/ceph-helpers 2026-02-18T00:38:47.970 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T00:38:47.970 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/ceph-helpers KILL 2026-02-18T00:38:47.970 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:38:47.970 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:38:47.970 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:38:47.970 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:38:47.970 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:38:47.971 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:38:47.971 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T00:38:47.972 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T00:38:47.972 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T00:38:47.973 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T00:38:47.974 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T00:38:47.974 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T00:38:47.975 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:38:47.975 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T00:38:47.975 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T00:38:47.975 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:38:47.976 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T00:38:47.977 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T00:38:47.977 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/ceph-helpers 2026-02-18T00:38:47.979 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T00:38:47.979 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:38:47.979 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:38:47.979 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.57427 2026-02-18T00:38:47.980 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T00:38:47.980 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T00:38:47.980 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/ceph-helpers 2026-02-18T00:38:47.982 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-18T00:38:47.982 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:38:47.982 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:38:47.982 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.57427 2026-02-18T00:38:47.984 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-18T00:38:47.984 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-18T00:38:47.984 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-18T00:38:47.985 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/ceph-helpers 1' TERM HUP INT 2026-02-18T00:38:47.985 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1396: test_get_num_active_or_peered: run_mon td/ceph-helpers a --osd_pool_default_size=1 --mon_allow_pool_size_one=true 2026-02-18T00:38:47.985 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/ceph-helpers 2026-02-18T00:38:47.985 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-18T00:38:47.985 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-18T00:38:47.985 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-18T00:38:47.985 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/ceph-helpers/a 2026-02-18T00:38:47.985 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/ceph-helpers/a --run-dir=td/ceph-helpers --osd_pool_default_size=1 --mon_allow_pool_size_one=true 2026-02-18T00:38:48.005 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-18T00:38:48.005 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:38:48.005 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:38:48.006 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:38:48.006 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:38:48.006 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:38:48.006 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.57427/$cluster-$name.asok' 2026-02-18T00:38:48.006 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/ceph-helpers/a '--log-file=td/ceph-helpers/$name.log' '--admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' --mon-cluster-log-file=td/ceph-helpers/log --run-dir=td/ceph-helpers '--pid-file=td/ceph-helpers/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --osd_pool_default_size=1 --mon_allow_pool_size_one=true 2026-02-18T00:38:48.036 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-18T00:38:48.037 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-18T00:38:48.037 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T00:38:48.037 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-18T00:38:48.037 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-18T00:38:48.037 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-18T00:38:48.037 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-18T00:38:48.037 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:38:48.038 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:38:48.038 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:38:48.038 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:38:48.038 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:38:48.038 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.57427/ceph-mon.a.asok 2026-02-18T00:38:48.039 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T00:38:48.039 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.57427/ceph-mon.a.asok config get fsid 2026-02-18T00:38:48.094 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-18T00:38:48.094 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T00:38:48.094 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-18T00:38:48.094 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-18T00:38:48.094 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-18T00:38:48.095 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-18T00:38:48.095 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:38:48.095 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:38:48.095 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:38:48.095 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:38:48.095 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:38:48.096 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.57427/ceph-mon.a.asok 2026-02-18T00:38:48.096 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T00:38:48.096 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.57427/ceph-mon.a.asok config get mon_host 2026-02-18T00:38:48.149 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1397: test_get_num_active_or_peered: run_mgr td/ceph-helpers x 2026-02-18T00:38:48.149 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/ceph-helpers 2026-02-18T00:38:48.149 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-18T00:38:48.149 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-18T00:38:48.149 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-18T00:38:48.150 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/ceph-helpers/x 2026-02-18T00:38:48.150 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-18T00:38:48.258 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-18T00:38:48.258 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:38:48.258 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:38:48.259 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:38:48.259 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:38:48.259 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:38:48.259 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.57427/$cluster-$name.asok' 2026-02-18T00:38:48.259 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-18T00:38:48.260 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/ceph-helpers/x '--log-file=td/ceph-helpers/$name.log' '--admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' --run-dir=td/ceph-helpers '--pid-file=td/ceph-helpers/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-18T00:38:48.283 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1398: test_get_num_active_or_peered: run_osd td/ceph-helpers 0 2026-02-18T00:38:48.284 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/ceph-helpers 2026-02-18T00:38:48.284 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T00:38:48.284 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-18T00:38:48.284 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T00:38:48.284 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/ceph-helpers/0 2026-02-18T00:38:48.285 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--cluster ceph --fsid=863c4e35-ceb0-4172-b7b2-c3ff099e05a2 --auth-supported=none --mon-host=127.0.0.1:7109 ' 2026-02-18T00:38:48.285 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T00:38:48.285 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T00:38:48.285 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T00:38:48.285 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/ceph-helpers/0' 2026-02-18T00:38:48.285 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/ceph-helpers/0/journal' 2026-02-18T00:38:48.286 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T00:38:48.286 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-18T00:38:48.286 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/ceph-helpers' 2026-02-18T00:38:48.286 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T00:38:48.286 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:38:48.287 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:38:48.287 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:38:48.287 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:38:48.287 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:38:48.287 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.57427/$cluster-$name.asok' 2026-02-18T00:38:48.287 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' 2026-02-18T00:38:48.288 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T00:38:48.288 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T00:38:48.288 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T00:38:48.288 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/ceph-helpers/$name.log' 2026-02-18T00:38:48.288 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/ceph-helpers/$name.pid' 2026-02-18T00:38:48.289 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T00:38:48.289 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T00:38:48.289 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T00:38:48.289 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T00:38:48.289 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T00:38:48.289 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-18T00:38:48.290 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/ceph-helpers/0 2026-02-18T00:38:48.290 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T00:38:48.290 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=aa9af232-21e5-4cdf-9dc7-2e3c2fda03d9 2026-02-18T00:38:48.290 INFO:tasks.workunit.client.0.trial069.stdout:add osd0 aa9af232-21e5-4cdf-9dc7-2e3c2fda03d9 2026-02-18T00:38:48.291 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 aa9af232-21e5-4cdf-9dc7-2e3c2fda03d9' 2026-02-18T00:38:48.291 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T00:38:48.293 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQAYCpVp2vkNERAAakX/bh+lP5Udn3t1gVMZow== 2026-02-18T00:38:48.294 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQAYCpVp2vkNERAAakX/bh+lP5Udn3t1gVMZow=="}' 2026-02-18T00:38:48.294 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new aa9af232-21e5-4cdf-9dc7-2e3c2fda03d9 -i td/ceph-helpers/0/new.json 2026-02-18T00:38:48.410 INFO:tasks.workunit.client.0.trial069.stdout:0 2026-02-18T00:38:48.417 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/ceph-helpers/0/new.json 2026-02-18T00:38:48.419 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --cluster ceph --fsid=863c4e35-ceb0-4172-b7b2-c3ff099e05a2 --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/0 --osd-journal=td/ceph-helpers/0/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAYCpVp2vkNERAAakX/bh+lP5Udn3t1gVMZow== --osd-uuid aa9af232-21e5-4cdf-9dc7-2e3c2fda03d9 2026-02-18T00:38:48.435 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:38:48.424+0000 7f261524ea40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:38:48.437 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:38:48.424+0000 7f261524ea40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:38:48.437 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:38:48.424+0000 7f261524ea40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:38:48.438 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:38:48.424+0000 7f261524ea40 -1 bdev(0x559d9dbfac00 td/ceph-helpers/0/block) open stat got: (1) Operation not permitted 2026-02-18T00:38:48.438 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:38:48.428+0000 7f261524ea40 -1 bluestore(td/ceph-helpers/0) _read_fsid unparsable uuid 2026-02-18T00:38:49.093 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/ceph-helpers/0/keyring 2026-02-18T00:38:49.093 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T00:38:49.094 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-18T00:38:49.094 INFO:tasks.workunit.client.0.trial069.stdout:adding osd0 key to auth repository 2026-02-18T00:38:49.095 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/ceph-helpers/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T00:38:49.212 INFO:tasks.workunit.client.0.trial069.stdout:start osd.0 2026-02-18T00:38:49.213 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-18T00:38:49.213 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --cluster ceph --fsid=863c4e35-ceb0-4172-b7b2-c3ff099e05a2 --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/0 --osd-journal=td/ceph-helpers/0/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T00:38:49.213 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T00:38:49.213 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T00:38:49.213 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T00:38:49.227 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:38:49.216+0000 7f77c8ff2a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:38:49.229 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:38:49.216+0000 7f77c8ff2a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:38:49.230 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:38:49.220+0000 7f77c8ff2a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:38:49.324 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-18T00:38:49.325 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:38:49.325 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-18T00:38:49.325 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:38:49.325 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:38:49.325 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:38:49.325 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:38:49.325 INFO:tasks.workunit.client.0.trial069.stdout:0 2026-02-18T00:38:49.326 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:38:49.326 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T00:38:49.432 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:38:49.715 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:38:49.704+0000 7f77c8ff2a40 -1 Falling back to public interface 2026-02-18T00:38:50.433 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:38:50.434 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:38:50.434 INFO:tasks.workunit.client.0.trial069.stdout:1 2026-02-18T00:38:50.435 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T00:38:50.435 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:38:50.435 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T00:38:50.543 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:38:50.686 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:38:50.672+0000 7f77c8ff2a40 -1 osd.0 0 log_to_monitors true 2026-02-18T00:38:51.544 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:38:51.545 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:38:51.545 INFO:tasks.workunit.client.0.trial069.stdout:2 2026-02-18T00:38:51.546 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-18T00:38:51.546 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:38:51.546 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T00:38:51.755 INFO:tasks.workunit.client.0.trial069.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/3300547047,v1:127.0.0.1:6801/3300547047] [v2:127.0.0.1:6802/3300547047,v1:127.0.0.1:6803/3300547047] exists,up aa9af232-21e5-4cdf-9dc7-2e3c2fda03d9 2026-02-18T00:38:51.756 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:38:51.756 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:38:51.756 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:38:51.756 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1399: test_get_num_active_or_peered: create_rbd_pool 2026-02-18T00:38:51.757 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:526: create_rbd_pool: ceph osd pool delete rbd rbd --yes-i-really-really-mean-it 2026-02-18T00:38:51.956 INFO:tasks.workunit.client.0.trial069.stderr:pool 'rbd' does not exist 2026-02-18T00:38:51.965 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:527: create_rbd_pool: create_pool rbd 4 2026-02-18T00:38:51.965 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create rbd 4 2026-02-18T00:38:52.198 INFO:tasks.workunit.client.0.trial069.stderr:pool 'rbd' already exists 2026-02-18T00:38:52.207 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-18T00:38:53.209 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:528: create_rbd_pool: rbd pool init rbd 2026-02-18T00:38:53.491 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1400: test_get_num_active_or_peered: wait_for_clean 2026-02-18T00:38:53.491 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-18T00:38:53.491 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-18T00:38:53.491 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-18T00:38:53.491 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-18T00:38:53.492 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-18T00:38:53.492 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-18T00:38:53.492 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-18T00:38:53.492 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-18T00:38:53.493 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-18T00:38:53.592 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-18T00:38:53.592 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-18T00:38:53.592 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-18T00:38:53.592 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-18T00:38:53.592 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-18T00:38:53.592 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-18T00:38:53.816 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids=0 2026-02-18T00:38:53.816 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-18T00:38:53.816 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:38:53.816 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-18T00:38:53.895 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836483 2026-02-18T00:38:53.895 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836483 2026-02-18T00:38:53.895 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836483' 2026-02-18T00:38:53.895 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:38:53.895 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836483 2026-02-18T00:38:53.895 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:38:53.896 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-18T00:38:53.897 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-21474836483 2026-02-18T00:38:53.897 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:38:53.898 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=21474836483 2026-02-18T00:38:53.898 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 21474836483' 2026-02-18T00:38:53.898 INFO:tasks.workunit.client.0.trial069.stdout:waiting osd.0 seq 21474836483 2026-02-18T00:38:53.899 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T00:38:54.109 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 21474836481 -lt 21474836483 2026-02-18T00:38:54.109 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-18T00:38:55.110 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-18T00:38:55.110 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T00:38:55.322 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 21474836483 -lt 21474836483 2026-02-18T00:38:55.322 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-18T00:38:55.322 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T00:38:55.322 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T00:38:55.609 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 4 == 0 2026-02-18T00:38:55.609 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-18T00:38:55.610 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-18T00:38:55.610 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-18T00:38:55.610 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-18T00:38:55.610 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-18T00:38:55.610 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-18T00:38:55.610 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-18T00:38:55.816 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=4 2026-02-18T00:38:55.817 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-18T00:38:55.817 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T00:38:55.817 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T00:38:56.094 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 4 = 4 2026-02-18T00:38:56.094 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-18T00:38:56.094 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-18T00:38:56.094 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1401: test_get_num_active_or_peered: get_num_active_or_peered 2026-02-18T00:38:56.094 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1385: get_num_active_or_peered: local expression 2026-02-18T00:38:56.094 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1386: get_num_active_or_peered: expression+='select(contains("active") or contains("peered")) | ' 2026-02-18T00:38:56.094 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1387: get_num_active_or_peered: expression+='select(contains("stale") | not)' 2026-02-18T00:38:56.095 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1388: get_num_active_or_peered: ceph --format json pg dump pgs 2026-02-18T00:38:56.095 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1389: get_num_active_or_peered: jq '.pg_stats | [.[] | .state | select(contains("active") or contains("peered")) | select(contains("stale") | not)] | length' 2026-02-18T00:38:56.296 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1401: test_get_num_active_or_peered: local num_peered=4 2026-02-18T00:38:56.296 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1402: test_get_num_active_or_peered: test 4 = 4 2026-02-18T00:38:56.296 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1403: test_get_num_active_or_peered: teardown td/ceph-helpers 2026-02-18T00:38:56.296 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/ceph-helpers 2026-02-18T00:38:56.296 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T00:38:56.296 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/ceph-helpers KILL 2026-02-18T00:38:56.297 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:38:56.297 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:38:56.297 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:38:56.297 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:38:56.297 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:38:56.405 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:38:56.405 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T00:38:56.406 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T00:38:56.407 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T00:38:56.408 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T00:38:56.408 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T00:38:56.408 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T00:38:56.409 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:38:56.409 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T00:38:56.410 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T00:38:56.410 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:38:56.412 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T00:38:56.413 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T00:38:56.413 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/ceph-helpers 2026-02-18T00:38:56.416 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T00:38:56.417 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:38:56.417 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:38:56.417 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.57427 2026-02-18T00:38:56.419 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T00:38:56.419 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T00:38:56.419 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2426: run_tests: for func in $funcs 2026-02-18T00:38:56.419 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2427: run_tests: test_get_num_pgs td/ceph-helpers 2026-02-18T00:38:56.419 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1420: test_get_num_pgs: local dir=td/ceph-helpers 2026-02-18T00:38:56.419 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1422: test_get_num_pgs: setup td/ceph-helpers 2026-02-18T00:38:56.420 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/ceph-helpers 2026-02-18T00:38:56.420 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/ceph-helpers 2026-02-18T00:38:56.420 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/ceph-helpers 2026-02-18T00:38:56.420 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T00:38:56.420 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/ceph-helpers KILL 2026-02-18T00:38:56.420 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:38:56.420 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:38:56.420 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:38:56.420 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:38:56.420 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:38:56.421 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:38:56.421 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T00:38:56.422 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T00:38:56.422 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T00:38:56.423 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T00:38:56.423 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T00:38:56.423 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T00:38:56.424 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:38:56.425 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T00:38:56.425 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T00:38:56.425 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:38:56.426 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T00:38:56.427 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T00:38:56.427 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/ceph-helpers 2026-02-18T00:38:56.428 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T00:38:56.428 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:38:56.429 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:38:56.429 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.57427 2026-02-18T00:38:56.430 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T00:38:56.430 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T00:38:56.430 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/ceph-helpers 2026-02-18T00:38:56.431 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-18T00:38:56.431 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:38:56.431 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:38:56.432 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.57427 2026-02-18T00:38:56.433 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-18T00:38:56.434 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-18T00:38:56.434 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-18T00:38:56.434 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/ceph-helpers 1' TERM HUP INT 2026-02-18T00:38:56.434 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1423: test_get_num_pgs: run_mon td/ceph-helpers a --osd_pool_default_size=1 --mon_allow_pool_size_one=true 2026-02-18T00:38:56.434 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/ceph-helpers 2026-02-18T00:38:56.434 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-18T00:38:56.434 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-18T00:38:56.435 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-18T00:38:56.435 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/ceph-helpers/a 2026-02-18T00:38:56.435 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/ceph-helpers/a --run-dir=td/ceph-helpers --osd_pool_default_size=1 --mon_allow_pool_size_one=true 2026-02-18T00:38:56.455 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-18T00:38:56.455 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:38:56.455 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:38:56.455 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:38:56.455 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:38:56.455 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:38:56.455 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.57427/$cluster-$name.asok' 2026-02-18T00:38:56.456 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/ceph-helpers/a '--log-file=td/ceph-helpers/$name.log' '--admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' --mon-cluster-log-file=td/ceph-helpers/log --run-dir=td/ceph-helpers '--pid-file=td/ceph-helpers/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --osd_pool_default_size=1 --mon_allow_pool_size_one=true 2026-02-18T00:38:56.486 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-18T00:38:56.486 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-18T00:38:56.487 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T00:38:56.487 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-18T00:38:56.487 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-18T00:38:56.488 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-18T00:38:56.488 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-18T00:38:56.488 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:38:56.488 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:38:56.488 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:38:56.489 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:38:56.489 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:38:56.489 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.57427/ceph-mon.a.asok 2026-02-18T00:38:56.489 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T00:38:56.489 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.57427/ceph-mon.a.asok config get fsid 2026-02-18T00:38:56.543 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-18T00:38:56.544 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T00:38:56.544 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-18T00:38:56.544 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-18T00:38:56.544 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-18T00:38:56.544 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-18T00:38:56.544 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:38:56.544 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:38:56.545 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:38:56.545 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:38:56.545 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:38:56.545 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.57427/ceph-mon.a.asok 2026-02-18T00:38:56.545 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T00:38:56.546 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.57427/ceph-mon.a.asok config get mon_host 2026-02-18T00:38:56.600 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1424: test_get_num_pgs: run_mgr td/ceph-helpers x 2026-02-18T00:38:56.600 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/ceph-helpers 2026-02-18T00:38:56.601 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-18T00:38:56.601 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-18T00:38:56.601 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-18T00:38:56.601 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/ceph-helpers/x 2026-02-18T00:38:56.601 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-18T00:38:56.716 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-18T00:38:56.716 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:38:56.716 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:38:56.716 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:38:56.717 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:38:56.717 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:38:56.717 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.57427/$cluster-$name.asok' 2026-02-18T00:38:56.717 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-18T00:38:56.718 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/ceph-helpers/x '--log-file=td/ceph-helpers/$name.log' '--admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' --run-dir=td/ceph-helpers '--pid-file=td/ceph-helpers/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-18T00:38:56.737 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: test_get_num_pgs: run_osd td/ceph-helpers 0 2026-02-18T00:38:56.737 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/ceph-helpers 2026-02-18T00:38:56.737 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T00:38:56.737 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-18T00:38:56.737 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T00:38:56.737 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/ceph-helpers/0 2026-02-18T00:38:56.737 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--cluster ceph --fsid=863c4e35-ceb0-4172-b7b2-c3ff099e05a2 --auth-supported=none --mon-host=127.0.0.1:7109 ' 2026-02-18T00:38:56.738 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T00:38:56.738 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T00:38:56.738 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T00:38:56.738 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/ceph-helpers/0' 2026-02-18T00:38:56.738 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/ceph-helpers/0/journal' 2026-02-18T00:38:56.738 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T00:38:56.738 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-18T00:38:56.738 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/ceph-helpers' 2026-02-18T00:38:56.738 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T00:38:56.738 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:38:56.738 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:38:56.739 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:38:56.739 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:38:56.739 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:38:56.739 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.57427/$cluster-$name.asok' 2026-02-18T00:38:56.739 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' 2026-02-18T00:38:56.739 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T00:38:56.739 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T00:38:56.739 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T00:38:56.739 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/ceph-helpers/$name.log' 2026-02-18T00:38:56.739 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/ceph-helpers/$name.pid' 2026-02-18T00:38:56.739 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T00:38:56.739 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T00:38:56.739 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T00:38:56.740 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T00:38:56.740 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T00:38:56.740 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-18T00:38:56.740 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/ceph-helpers/0 2026-02-18T00:38:56.740 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T00:38:56.740 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=b50efc6f-652e-4a68-abfb-59872a0878ef 2026-02-18T00:38:56.741 INFO:tasks.workunit.client.0.trial069.stdout:add osd0 b50efc6f-652e-4a68-abfb-59872a0878ef 2026-02-18T00:38:56.741 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 b50efc6f-652e-4a68-abfb-59872a0878ef' 2026-02-18T00:38:56.742 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T00:38:56.751 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQAgCpVpvDdTLBAAJuxtlgaOBpouRyfK+u4z4A== 2026-02-18T00:38:56.751 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQAgCpVpvDdTLBAAJuxtlgaOBpouRyfK+u4z4A=="}' 2026-02-18T00:38:56.751 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new b50efc6f-652e-4a68-abfb-59872a0878ef -i td/ceph-helpers/0/new.json 2026-02-18T00:38:56.864 INFO:tasks.workunit.client.0.trial069.stdout:0 2026-02-18T00:38:56.872 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/ceph-helpers/0/new.json 2026-02-18T00:38:56.873 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --cluster ceph --fsid=863c4e35-ceb0-4172-b7b2-c3ff099e05a2 --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/0 --osd-journal=td/ceph-helpers/0/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAgCpVpvDdTLBAAJuxtlgaOBpouRyfK+u4z4A== --osd-uuid b50efc6f-652e-4a68-abfb-59872a0878ef 2026-02-18T00:38:56.888 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:38:56.876+0000 7fef67935a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:38:56.890 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:38:56.876+0000 7fef67935a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:38:56.891 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:38:56.880+0000 7fef67935a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:38:56.891 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:38:56.880+0000 7fef67935a40 -1 bdev(0x55ac91fccc00 td/ceph-helpers/0/block) open stat got: (1) Operation not permitted 2026-02-18T00:38:56.891 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:38:56.880+0000 7fef67935a40 -1 bluestore(td/ceph-helpers/0) _read_fsid unparsable uuid 2026-02-18T00:38:57.677 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/ceph-helpers/0/keyring 2026-02-18T00:38:57.678 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T00:38:57.678 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-18T00:38:57.678 INFO:tasks.workunit.client.0.trial069.stdout:adding osd0 key to auth repository 2026-02-18T00:38:57.679 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/ceph-helpers/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T00:38:57.792 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-18T00:38:57.792 INFO:tasks.workunit.client.0.trial069.stdout:start osd.0 2026-02-18T00:38:57.793 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --cluster ceph --fsid=863c4e35-ceb0-4172-b7b2-c3ff099e05a2 --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/0 --osd-journal=td/ceph-helpers/0/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T00:38:57.793 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T00:38:57.793 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T00:38:57.794 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T00:38:57.816 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:38:57.804+0000 7f14bbf82a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:38:57.818 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:38:57.808+0000 7f14bbf82a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:38:57.820 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:38:57.808+0000 7f14bbf82a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:38:57.899 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-18T00:38:57.899 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:38:57.899 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-18T00:38:57.899 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:38:57.899 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:38:57.899 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:38:57.899 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:38:57.900 INFO:tasks.workunit.client.0.trial069.stdout:0 2026-02-18T00:38:57.900 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:38:57.900 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T00:38:58.007 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:38:58.196 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:38:58.184+0000 7f14bbf82a40 -1 Falling back to public interface 2026-02-18T00:38:58.946 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:38:58.932+0000 7f14bbf82a40 -1 osd.0 0 log_to_monitors true 2026-02-18T00:38:59.008 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:38:59.008 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:38:59.009 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T00:38:59.009 INFO:tasks.workunit.client.0.trial069.stdout:1 2026-02-18T00:38:59.009 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:38:59.010 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T00:38:59.115 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:39:00.117 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:39:00.117 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:39:00.118 INFO:tasks.workunit.client.0.trial069.stdout:2 2026-02-18T00:39:00.118 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-18T00:39:00.118 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:39:00.118 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T00:39:00.333 INFO:tasks.workunit.client.0.trial069.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/4017332999,v1:127.0.0.1:6801/4017332999] [v2:127.0.0.1:6802/4017332999,v1:127.0.0.1:6803/4017332999] exists,up b50efc6f-652e-4a68-abfb-59872a0878ef 2026-02-18T00:39:00.334 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:39:00.335 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:39:00.335 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:39:00.335 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1426: test_get_num_pgs: create_rbd_pool 2026-02-18T00:39:00.335 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:526: create_rbd_pool: ceph osd pool delete rbd rbd --yes-i-really-really-mean-it 2026-02-18T00:39:00.540 INFO:tasks.workunit.client.0.trial069.stderr:pool 'rbd' does not exist 2026-02-18T00:39:00.550 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:527: create_rbd_pool: create_pool rbd 4 2026-02-18T00:39:00.550 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create rbd 4 2026-02-18T00:39:00.779 INFO:tasks.workunit.client.0.trial069.stderr:pool 'rbd' already exists 2026-02-18T00:39:00.788 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-18T00:39:01.790 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:528: create_rbd_pool: rbd pool init rbd 2026-02-18T00:39:02.099 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1427: test_get_num_pgs: wait_for_clean 2026-02-18T00:39:02.099 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-18T00:39:02.099 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-18T00:39:02.099 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-18T00:39:02.099 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-18T00:39:02.100 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-18T00:39:02.100 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-18T00:39:02.100 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-18T00:39:02.101 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-18T00:39:02.101 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-18T00:39:02.195 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-18T00:39:02.195 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-18T00:39:02.195 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-18T00:39:02.196 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-18T00:39:02.196 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-18T00:39:02.196 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-18T00:39:02.404 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids=0 2026-02-18T00:39:02.404 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-18T00:39:02.404 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:39:02.404 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-18T00:39:02.484 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836483 2026-02-18T00:39:02.484 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836483 2026-02-18T00:39:02.484 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836483' 2026-02-18T00:39:02.484 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:39:02.485 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836483 2026-02-18T00:39:02.485 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:39:02.486 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-18T00:39:02.486 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-21474836483 2026-02-18T00:39:02.486 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:39:02.487 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=21474836483 2026-02-18T00:39:02.488 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 21474836483' 2026-02-18T00:39:02.488 INFO:tasks.workunit.client.0.trial069.stdout:waiting osd.0 seq 21474836483 2026-02-18T00:39:02.488 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T00:39:02.711 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 21474836481 -lt 21474836483 2026-02-18T00:39:02.711 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-18T00:39:03.712 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-18T00:39:03.713 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T00:39:03.931 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 21474836483 -lt 21474836483 2026-02-18T00:39:03.932 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-18T00:39:03.932 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T00:39:03.932 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T00:39:04.214 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 4 == 0 2026-02-18T00:39:04.214 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-18T00:39:04.214 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-18T00:39:04.214 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-18T00:39:04.214 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-18T00:39:04.215 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-18T00:39:04.215 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-18T00:39:04.215 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-18T00:39:04.416 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=4 2026-02-18T00:39:04.417 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-18T00:39:04.417 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T00:39:04.417 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T00:39:04.690 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 4 = 4 2026-02-18T00:39:04.690 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-18T00:39:04.691 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-18T00:39:04.691 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1428: test_get_num_pgs: get_num_pgs 2026-02-18T00:39:04.691 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T00:39:04.691 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T00:39:04.963 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1428: test_get_num_pgs: local num_pgs=4 2026-02-18T00:39:04.963 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1429: test_get_num_pgs: test 4 -gt 0 2026-02-18T00:39:04.963 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1430: test_get_num_pgs: teardown td/ceph-helpers 2026-02-18T00:39:04.963 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/ceph-helpers 2026-02-18T00:39:04.963 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T00:39:04.963 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/ceph-helpers KILL 2026-02-18T00:39:04.964 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:39:04.964 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:39:04.964 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:39:04.964 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:39:04.964 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:39:05.072 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:39:05.072 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T00:39:05.073 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T00:39:05.073 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T00:39:05.074 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T00:39:05.075 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T00:39:05.075 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T00:39:05.076 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:39:05.076 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T00:39:05.076 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T00:39:05.077 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:39:05.078 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T00:39:05.079 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T00:39:05.079 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/ceph-helpers 2026-02-18T00:39:05.082 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T00:39:05.082 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:39:05.082 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:39:05.082 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.57427 2026-02-18T00:39:05.085 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T00:39:05.085 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T00:39:05.085 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2426: run_tests: for func in $funcs 2026-02-18T00:39:05.085 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2427: run_tests: test_get_op_scheduler td/ceph-helpers 2026-02-18T00:39:05.085 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2316: test_get_op_scheduler: local dir=td/ceph-helpers 2026-02-18T00:39:05.085 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2318: test_get_op_scheduler: setup td/ceph-helpers 2026-02-18T00:39:05.085 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/ceph-helpers 2026-02-18T00:39:05.085 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/ceph-helpers 2026-02-18T00:39:05.085 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/ceph-helpers 2026-02-18T00:39:05.085 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T00:39:05.085 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/ceph-helpers KILL 2026-02-18T00:39:05.086 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:39:05.086 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:39:05.086 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:39:05.086 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:39:05.086 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:39:05.087 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:39:05.087 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T00:39:05.088 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T00:39:05.088 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T00:39:05.089 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T00:39:05.089 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T00:39:05.089 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T00:39:05.090 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:39:05.090 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T00:39:05.090 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T00:39:05.090 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:39:05.091 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T00:39:05.092 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T00:39:05.092 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/ceph-helpers 2026-02-18T00:39:05.093 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T00:39:05.094 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:39:05.094 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:39:05.094 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.57427 2026-02-18T00:39:05.095 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T00:39:05.095 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T00:39:05.095 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/ceph-helpers 2026-02-18T00:39:05.096 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-18T00:39:05.096 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:39:05.096 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:39:05.096 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.57427 2026-02-18T00:39:05.098 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-18T00:39:05.099 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-18T00:39:05.099 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-18T00:39:05.099 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/ceph-helpers 1' TERM HUP INT 2026-02-18T00:39:05.099 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2320: test_get_op_scheduler: run_mon td/ceph-helpers a 2026-02-18T00:39:05.099 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/ceph-helpers 2026-02-18T00:39:05.099 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-18T00:39:05.099 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-18T00:39:05.099 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-18T00:39:05.099 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/ceph-helpers/a 2026-02-18T00:39:05.099 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/ceph-helpers/a --run-dir=td/ceph-helpers 2026-02-18T00:39:05.120 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-18T00:39:05.121 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:39:05.121 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:39:05.121 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:39:05.121 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:39:05.121 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:39:05.121 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.57427/$cluster-$name.asok' 2026-02-18T00:39:05.122 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/ceph-helpers/a '--log-file=td/ceph-helpers/$name.log' '--admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' --mon-cluster-log-file=td/ceph-helpers/log --run-dir=td/ceph-helpers '--pid-file=td/ceph-helpers/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-18T00:39:05.150 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-18T00:39:05.151 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-18T00:39:05.151 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T00:39:05.151 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-18T00:39:05.151 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-18T00:39:05.152 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-18T00:39:05.153 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-18T00:39:05.153 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:39:05.153 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:39:05.153 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:39:05.153 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:39:05.153 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:39:05.153 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.57427/ceph-mon.a.asok 2026-02-18T00:39:05.153 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T00:39:05.153 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.57427/ceph-mon.a.asok config get fsid 2026-02-18T00:39:05.208 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-18T00:39:05.208 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T00:39:05.208 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-18T00:39:05.209 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-18T00:39:05.209 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-18T00:39:05.210 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-18T00:39:05.210 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:39:05.210 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:39:05.210 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:39:05.210 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:39:05.210 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:39:05.210 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.57427/ceph-mon.a.asok 2026-02-18T00:39:05.210 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T00:39:05.210 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.57427/ceph-mon.a.asok config get mon_host 2026-02-18T00:39:05.263 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2321: test_get_op_scheduler: run_mgr td/ceph-helpers x 2026-02-18T00:39:05.263 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/ceph-helpers 2026-02-18T00:39:05.264 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-18T00:39:05.264 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-18T00:39:05.264 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-18T00:39:05.264 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/ceph-helpers/x 2026-02-18T00:39:05.264 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-18T00:39:05.380 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-18T00:39:05.380 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:39:05.380 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:39:05.380 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:39:05.380 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:39:05.380 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:39:05.380 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.57427/$cluster-$name.asok' 2026-02-18T00:39:05.381 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-18T00:39:05.381 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/ceph-helpers/x '--log-file=td/ceph-helpers/$name.log' '--admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' --run-dir=td/ceph-helpers '--pid-file=td/ceph-helpers/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-18T00:39:05.400 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2323: test_get_op_scheduler: run_osd td/ceph-helpers 0 --osd_op_queue=wpq 2026-02-18T00:39:05.400 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/ceph-helpers 2026-02-18T00:39:05.400 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T00:39:05.400 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-18T00:39:05.400 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T00:39:05.400 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/ceph-helpers/0 2026-02-18T00:39:05.400 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--cluster ceph --fsid=863c4e35-ceb0-4172-b7b2-c3ff099e05a2 --auth-supported=none --mon-host=127.0.0.1:7109 ' 2026-02-18T00:39:05.401 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T00:39:05.401 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T00:39:05.401 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T00:39:05.401 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/ceph-helpers/0' 2026-02-18T00:39:05.401 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/ceph-helpers/0/journal' 2026-02-18T00:39:05.401 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T00:39:05.401 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-18T00:39:05.401 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/ceph-helpers' 2026-02-18T00:39:05.401 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T00:39:05.401 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:39:05.401 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:39:05.401 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:39:05.401 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:39:05.402 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:39:05.402 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.57427/$cluster-$name.asok' 2026-02-18T00:39:05.402 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' 2026-02-18T00:39:05.402 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T00:39:05.402 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T00:39:05.402 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T00:39:05.402 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/ceph-helpers/$name.log' 2026-02-18T00:39:05.402 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/ceph-helpers/$name.pid' 2026-02-18T00:39:05.402 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T00:39:05.402 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T00:39:05.402 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T00:39:05.402 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T00:39:05.403 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T00:39:05.403 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=--osd_op_queue=wpq 2026-02-18T00:39:05.403 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/ceph-helpers/0 2026-02-18T00:39:05.403 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T00:39:05.404 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=0199cfbd-7c3b-4021-bec6-25e247ed4153 2026-02-18T00:39:05.404 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 0199cfbd-7c3b-4021-bec6-25e247ed4153' 2026-02-18T00:39:05.404 INFO:tasks.workunit.client.0.trial069.stdout:add osd0 0199cfbd-7c3b-4021-bec6-25e247ed4153 2026-02-18T00:39:05.404 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T00:39:05.413 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQApCpVpZRooGBAAqTQTP0AAK/jQ34HlK1oc5w== 2026-02-18T00:39:05.413 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQApCpVpZRooGBAAqTQTP0AAK/jQ34HlK1oc5w=="}' 2026-02-18T00:39:05.413 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 0199cfbd-7c3b-4021-bec6-25e247ed4153 -i td/ceph-helpers/0/new.json 2026-02-18T00:39:05.528 INFO:tasks.workunit.client.0.trial069.stdout:0 2026-02-18T00:39:05.536 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/ceph-helpers/0/new.json 2026-02-18T00:39:05.537 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --cluster ceph --fsid=863c4e35-ceb0-4172-b7b2-c3ff099e05a2 --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/0 --osd-journal=td/ceph-helpers/0/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_op_queue=wpq --mkfs --key AQApCpVpZRooGBAAqTQTP0AAK/jQ34HlK1oc5w== --osd-uuid 0199cfbd-7c3b-4021-bec6-25e247ed4153 2026-02-18T00:39:05.552 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:39:05.539+0000 7f1455ec6a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:39:05.554 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:39:05.539+0000 7f1455ec6a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:39:05.555 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:39:05.543+0000 7f1455ec6a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:39:05.555 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:39:05.543+0000 7f1455ec6a40 -1 bdev(0x558ece1d2c00 td/ceph-helpers/0/block) open stat got: (1) Operation not permitted 2026-02-18T00:39:05.556 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:39:05.543+0000 7f1455ec6a40 -1 bluestore(td/ceph-helpers/0) _read_fsid unparsable uuid 2026-02-18T00:39:06.312 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/ceph-helpers/0/keyring 2026-02-18T00:39:06.313 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T00:39:06.314 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-18T00:39:06.314 INFO:tasks.workunit.client.0.trial069.stdout:adding osd0 key to auth repository 2026-02-18T00:39:06.314 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/ceph-helpers/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T00:39:06.434 INFO:tasks.workunit.client.0.trial069.stdout:start osd.0 2026-02-18T00:39:06.434 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-18T00:39:06.435 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --cluster ceph --fsid=863c4e35-ceb0-4172-b7b2-c3ff099e05a2 --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/0 --osd-journal=td/ceph-helpers/0/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_op_queue=wpq 2026-02-18T00:39:06.435 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T00:39:06.435 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T00:39:06.435 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T00:39:06.459 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:39:06.447+0000 7f9be9f47a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:39:06.461 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:39:06.447+0000 7f9be9f47a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:39:06.462 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:39:06.451+0000 7f9be9f47a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:39:06.543 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-18T00:39:06.543 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:39:06.543 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-18T00:39:06.543 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:39:06.543 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:39:06.543 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:39:06.544 INFO:tasks.workunit.client.0.trial069.stdout:0 2026-02-18T00:39:06.544 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:39:06.545 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:39:06.545 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T00:39:06.651 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:39:07.036 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:39:07.023+0000 7f9be9f47a40 -1 Falling back to public interface 2026-02-18T00:39:07.652 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:39:07.652 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:39:07.653 INFO:tasks.workunit.client.0.trial069.stdout:1 2026-02-18T00:39:07.653 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T00:39:07.653 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:39:07.653 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T00:39:07.759 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:39:07.968 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:39:07.955+0000 7f9be9f47a40 -1 osd.0 0 log_to_monitors true 2026-02-18T00:39:08.760 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:39:08.760 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:39:08.761 INFO:tasks.workunit.client.0.trial069.stdout:2 2026-02-18T00:39:08.761 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-18T00:39:08.762 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:39:08.762 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T00:39:08.974 INFO:tasks.workunit.client.0.trial069.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/3878235020,v1:127.0.0.1:6801/3878235020] [v2:127.0.0.1:6802/3878235020,v1:127.0.0.1:6803/3878235020] exists,up 0199cfbd-7c3b-4021-bec6-25e247ed4153 2026-02-18T00:39:08.975 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:39:08.975 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:39:08.975 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:39:08.976 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2324: test_get_op_scheduler: get_op_scheduler 0 2026-02-18T00:39:08.976 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2310: get_op_scheduler: local id=0 2026-02-18T00:39:08.976 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2312: get_op_scheduler: get_config osd 0 osd_op_queue 2026-02-18T00:39:08.976 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=osd 2026-02-18T00:39:08.976 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=0 2026-02-18T00:39:08.976 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=osd_op_queue 2026-02-18T00:39:08.976 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .osd_op_queue 2026-02-18T00:39:08.976 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path osd.0 2026-02-18T00:39:08.976 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-18T00:39:08.976 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-18T00:39:08.977 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:39:08.977 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:39:08.977 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:39:08.977 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.57427/ceph-osd.0.asok 2026-02-18T00:39:08.978 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T00:39:08.978 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.57427/ceph-osd.0.asok config get osd_op_queue 2026-02-18T00:39:09.041 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2324: test_get_op_scheduler: test wpq = wpq 2026-02-18T00:39:09.042 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2326: test_get_op_scheduler: run_osd td/ceph-helpers 1 --osd_op_queue=mclock_scheduler 2026-02-18T00:39:09.042 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/ceph-helpers 2026-02-18T00:39:09.042 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T00:39:09.042 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2026-02-18T00:39:09.042 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T00:39:09.042 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/ceph-helpers/1 2026-02-18T00:39:09.042 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--cluster ceph --fsid=863c4e35-ceb0-4172-b7b2-c3ff099e05a2 --auth-supported=none --mon-host=127.0.0.1:7109 ' 2026-02-18T00:39:09.042 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T00:39:09.042 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T00:39:09.043 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T00:39:09.043 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/ceph-helpers/1' 2026-02-18T00:39:09.043 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/ceph-helpers/1/journal' 2026-02-18T00:39:09.043 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T00:39:09.043 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-18T00:39:09.043 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/ceph-helpers' 2026-02-18T00:39:09.043 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T00:39:09.043 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:39:09.043 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:39:09.043 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:39:09.044 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:39:09.044 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:39:09.044 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.57427/$cluster-$name.asok' 2026-02-18T00:39:09.044 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' 2026-02-18T00:39:09.044 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T00:39:09.044 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T00:39:09.044 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T00:39:09.044 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/ceph-helpers/$name.log' 2026-02-18T00:39:09.044 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/ceph-helpers/$name.pid' 2026-02-18T00:39:09.044 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T00:39:09.044 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T00:39:09.045 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T00:39:09.045 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T00:39:09.045 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T00:39:09.045 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=--osd_op_queue=mclock_scheduler 2026-02-18T00:39:09.045 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/ceph-helpers/1 2026-02-18T00:39:09.045 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T00:39:09.046 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=d9195e48-390b-4525-ab00-bb3ac9a9e970 2026-02-18T00:39:09.046 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 d9195e48-390b-4525-ab00-bb3ac9a9e970' 2026-02-18T00:39:09.046 INFO:tasks.workunit.client.0.trial069.stdout:add osd1 d9195e48-390b-4525-ab00-bb3ac9a9e970 2026-02-18T00:39:09.047 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T00:39:09.055 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQAtCpVp5X/RAhAAO4Sv7m98dgTBRiDqDKtsSw== 2026-02-18T00:39:09.055 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQAtCpVp5X/RAhAAO4Sv7m98dgTBRiDqDKtsSw=="}' 2026-02-18T00:39:09.055 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new d9195e48-390b-4525-ab00-bb3ac9a9e970 -i td/ceph-helpers/1/new.json 2026-02-18T00:39:09.264 INFO:tasks.workunit.client.0.trial069.stdout:1 2026-02-18T00:39:09.273 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/ceph-helpers/1/new.json 2026-02-18T00:39:09.274 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --cluster ceph --fsid=863c4e35-ceb0-4172-b7b2-c3ff099e05a2 --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/1 --osd-journal=td/ceph-helpers/1/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_op_queue=mclock_scheduler --mkfs --key AQAtCpVp5X/RAhAAO4Sv7m98dgTBRiDqDKtsSw== --osd-uuid d9195e48-390b-4525-ab00-bb3ac9a9e970 2026-02-18T00:39:09.291 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:39:09.283+0000 7f556fd76a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:39:09.293 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:39:09.283+0000 7f556fd76a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:39:09.294 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:39:09.283+0000 7f556fd76a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:39:09.294 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:39:09.283+0000 7f556fd76a40 -1 bdev(0x55b04b242c00 td/ceph-helpers/1/block) open stat got: (1) Operation not permitted 2026-02-18T00:39:09.294 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:39:09.283+0000 7f556fd76a40 -1 bluestore(td/ceph-helpers/1) _read_fsid unparsable uuid 2026-02-18T00:39:09.930 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/ceph-helpers/1/keyring 2026-02-18T00:39:09.931 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T00:39:09.931 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2026-02-18T00:39:09.932 INFO:tasks.workunit.client.0.trial069.stdout:adding osd1 key to auth repository 2026-02-18T00:39:09.932 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/ceph-helpers/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T00:39:10.223 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2026-02-18T00:39:10.224 INFO:tasks.workunit.client.0.trial069.stdout:start osd.1 2026-02-18T00:39:10.224 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --cluster ceph --fsid=863c4e35-ceb0-4172-b7b2-c3ff099e05a2 --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/1 --osd-journal=td/ceph-helpers/1/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_op_queue=mclock_scheduler 2026-02-18T00:39:10.225 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T00:39:10.225 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T00:39:10.225 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T00:39:10.247 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:39:10.239+0000 7f08a3873a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:39:10.248 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:39:10.239+0000 7f08a3873a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:39:10.249 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:39:10.239+0000 7f08a3873a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:39:10.438 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2026-02-18T00:39:10.439 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:39:10.439 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-18T00:39:10.439 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:39:10.439 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:39:10.439 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:39:10.439 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:39:10.439 INFO:tasks.workunit.client.0.trial069.stdout:0 2026-02-18T00:39:10.440 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:39:10.440 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-18T00:39:10.644 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:39:10.635+0000 7f08a3873a40 -1 Falling back to public interface 2026-02-18T00:39:10.654 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:39:11.257 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:39:11.247+0000 7f08a3873a40 -1 osd.1 0 log_to_monitors true 2026-02-18T00:39:11.655 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:39:11.656 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:39:11.656 INFO:tasks.workunit.client.0.trial069.stdout:1 2026-02-18T00:39:11.657 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T00:39:11.657 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:39:11.657 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-18T00:39:11.862 INFO:tasks.workunit.client.0.trial069.stdout:osd.1 up in weight 1 up_from 9 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/2005155386,v1:127.0.0.1:6811/2005155386] [v2:127.0.0.1:6812/2005155386,v1:127.0.0.1:6813/2005155386] exists,up d9195e48-390b-4525-ab00-bb3ac9a9e970 2026-02-18T00:39:11.864 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:39:11.864 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:39:11.864 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:39:11.864 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2327: test_get_op_scheduler: get_op_scheduler 1 2026-02-18T00:39:11.864 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2310: get_op_scheduler: local id=1 2026-02-18T00:39:11.864 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2312: get_op_scheduler: get_config osd 1 osd_op_queue 2026-02-18T00:39:11.864 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=osd 2026-02-18T00:39:11.864 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=1 2026-02-18T00:39:11.864 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=osd_op_queue 2026-02-18T00:39:11.864 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .osd_op_queue 2026-02-18T00:39:11.865 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path osd.1 2026-02-18T00:39:11.865 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.1 2026-02-18T00:39:11.865 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.1 ']' 2026-02-18T00:39:11.866 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:39:11.866 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:39:11.866 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:39:11.866 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.57427/ceph-osd.1.asok 2026-02-18T00:39:11.866 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T00:39:11.866 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.57427/ceph-osd.1.asok config get osd_op_queue 2026-02-18T00:39:11.927 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2327: test_get_op_scheduler: test mclock_scheduler = mclock_scheduler 2026-02-18T00:39:11.927 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2328: test_get_op_scheduler: teardown td/ceph-helpers 2026-02-18T00:39:11.927 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/ceph-helpers 2026-02-18T00:39:11.928 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T00:39:11.928 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/ceph-helpers KILL 2026-02-18T00:39:11.928 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:39:11.928 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:39:11.928 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:39:11.928 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:39:11.928 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:39:12.237 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:39:12.238 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T00:39:12.238 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T00:39:12.239 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T00:39:12.240 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T00:39:12.241 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T00:39:12.241 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T00:39:12.242 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:39:12.243 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T00:39:12.243 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T00:39:12.243 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:39:12.244 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T00:39:12.245 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T00:39:12.246 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/ceph-helpers 2026-02-18T00:39:12.251 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T00:39:12.251 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:39:12.251 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:39:12.251 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.57427 2026-02-18T00:39:12.254 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T00:39:12.254 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T00:39:12.254 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2426: run_tests: for func in $funcs 2026-02-18T00:39:12.254 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2427: run_tests: test_get_osd_id_used_by_pgs td/ceph-helpers 2026-02-18T00:39:12.254 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1450: test_get_osd_id_used_by_pgs: local dir=td/ceph-helpers 2026-02-18T00:39:12.254 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1452: test_get_osd_id_used_by_pgs: setup td/ceph-helpers 2026-02-18T00:39:12.254 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/ceph-helpers 2026-02-18T00:39:12.254 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/ceph-helpers 2026-02-18T00:39:12.255 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/ceph-helpers 2026-02-18T00:39:12.255 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T00:39:12.255 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/ceph-helpers KILL 2026-02-18T00:39:12.255 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:39:12.255 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:39:12.255 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:39:12.255 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:39:12.255 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:39:12.256 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:39:12.256 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T00:39:12.257 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T00:39:12.257 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T00:39:12.258 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T00:39:12.259 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T00:39:12.259 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T00:39:12.260 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:39:12.260 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T00:39:12.261 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T00:39:12.261 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:39:12.262 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T00:39:12.263 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T00:39:12.263 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/ceph-helpers 2026-02-18T00:39:12.264 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T00:39:12.265 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:39:12.265 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:39:12.265 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.57427 2026-02-18T00:39:12.266 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T00:39:12.266 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T00:39:12.266 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/ceph-helpers 2026-02-18T00:39:12.267 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-18T00:39:12.267 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:39:12.268 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:39:12.268 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.57427 2026-02-18T00:39:12.269 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-18T00:39:12.270 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-18T00:39:12.270 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-18T00:39:12.270 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/ceph-helpers 1' TERM HUP INT 2026-02-18T00:39:12.270 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1453: test_get_osd_id_used_by_pgs: run_mon td/ceph-helpers a --osd_pool_default_size=1 --mon_allow_pool_size_one=true 2026-02-18T00:39:12.271 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/ceph-helpers 2026-02-18T00:39:12.271 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-18T00:39:12.271 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-18T00:39:12.271 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-18T00:39:12.271 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/ceph-helpers/a 2026-02-18T00:39:12.271 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/ceph-helpers/a --run-dir=td/ceph-helpers --osd_pool_default_size=1 --mon_allow_pool_size_one=true 2026-02-18T00:39:12.292 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-18T00:39:12.292 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:39:12.292 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:39:12.292 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:39:12.292 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:39:12.292 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:39:12.292 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.57427/$cluster-$name.asok' 2026-02-18T00:39:12.292 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/ceph-helpers/a '--log-file=td/ceph-helpers/$name.log' '--admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' --mon-cluster-log-file=td/ceph-helpers/log --run-dir=td/ceph-helpers '--pid-file=td/ceph-helpers/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --osd_pool_default_size=1 --mon_allow_pool_size_one=true 2026-02-18T00:39:12.322 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-18T00:39:12.323 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-18T00:39:12.323 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T00:39:12.323 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-18T00:39:12.323 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-18T00:39:12.323 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-18T00:39:12.325 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-18T00:39:12.325 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:39:12.325 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:39:12.325 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:39:12.325 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:39:12.325 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:39:12.325 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.57427/ceph-mon.a.asok 2026-02-18T00:39:12.325 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T00:39:12.326 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.57427/ceph-mon.a.asok config get fsid 2026-02-18T00:39:12.379 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-18T00:39:12.379 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T00:39:12.379 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-18T00:39:12.379 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-18T00:39:12.379 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-18T00:39:12.381 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-18T00:39:12.381 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:39:12.381 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:39:12.381 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:39:12.381 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:39:12.381 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:39:12.381 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.57427/ceph-mon.a.asok 2026-02-18T00:39:12.381 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T00:39:12.381 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.57427/ceph-mon.a.asok config get mon_host 2026-02-18T00:39:12.434 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1454: test_get_osd_id_used_by_pgs: run_mgr td/ceph-helpers x 2026-02-18T00:39:12.435 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/ceph-helpers 2026-02-18T00:39:12.435 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-18T00:39:12.435 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-18T00:39:12.435 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-18T00:39:12.435 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/ceph-helpers/x 2026-02-18T00:39:12.435 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-18T00:39:12.545 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-18T00:39:12.545 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:39:12.545 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:39:12.545 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:39:12.545 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:39:12.546 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:39:12.546 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.57427/$cluster-$name.asok' 2026-02-18T00:39:12.546 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-18T00:39:12.546 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/ceph-helpers/x '--log-file=td/ceph-helpers/$name.log' '--admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' --run-dir=td/ceph-helpers '--pid-file=td/ceph-helpers/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-18T00:39:12.567 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1455: test_get_osd_id_used_by_pgs: run_osd td/ceph-helpers 0 2026-02-18T00:39:12.568 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/ceph-helpers 2026-02-18T00:39:12.568 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T00:39:12.568 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-18T00:39:12.568 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T00:39:12.568 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/ceph-helpers/0 2026-02-18T00:39:12.568 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--cluster ceph --fsid=863c4e35-ceb0-4172-b7b2-c3ff099e05a2 --auth-supported=none --mon-host=127.0.0.1:7109 ' 2026-02-18T00:39:12.568 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T00:39:12.568 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T00:39:12.568 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T00:39:12.569 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/ceph-helpers/0' 2026-02-18T00:39:12.569 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/ceph-helpers/0/journal' 2026-02-18T00:39:12.569 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T00:39:12.569 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-18T00:39:12.569 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/ceph-helpers' 2026-02-18T00:39:12.569 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T00:39:12.569 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:39:12.569 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:39:12.569 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:39:12.569 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:39:12.569 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:39:12.569 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.57427/$cluster-$name.asok' 2026-02-18T00:39:12.570 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' 2026-02-18T00:39:12.570 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T00:39:12.570 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T00:39:12.570 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T00:39:12.570 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/ceph-helpers/$name.log' 2026-02-18T00:39:12.570 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/ceph-helpers/$name.pid' 2026-02-18T00:39:12.570 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T00:39:12.570 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T00:39:12.570 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T00:39:12.570 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T00:39:12.570 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T00:39:12.571 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-18T00:39:12.571 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/ceph-helpers/0 2026-02-18T00:39:12.571 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T00:39:12.571 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=a3e0d1bd-4501-4d9f-8a5b-9ac7bef94cba 2026-02-18T00:39:12.572 INFO:tasks.workunit.client.0.trial069.stdout:add osd0 a3e0d1bd-4501-4d9f-8a5b-9ac7bef94cba 2026-02-18T00:39:12.572 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 a3e0d1bd-4501-4d9f-8a5b-9ac7bef94cba' 2026-02-18T00:39:12.572 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T00:39:12.580 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQAwCpVpn9sgIhAAq1q71PQDWBjtbykt8z3vHw== 2026-02-18T00:39:12.580 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQAwCpVpn9sgIhAAq1q71PQDWBjtbykt8z3vHw=="}' 2026-02-18T00:39:12.580 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new a3e0d1bd-4501-4d9f-8a5b-9ac7bef94cba -i td/ceph-helpers/0/new.json 2026-02-18T00:39:12.695 INFO:tasks.workunit.client.0.trial069.stdout:0 2026-02-18T00:39:12.703 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/ceph-helpers/0/new.json 2026-02-18T00:39:12.704 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --cluster ceph --fsid=863c4e35-ceb0-4172-b7b2-c3ff099e05a2 --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/0 --osd-journal=td/ceph-helpers/0/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAwCpVpn9sgIhAAq1q71PQDWBjtbykt8z3vHw== --osd-uuid a3e0d1bd-4501-4d9f-8a5b-9ac7bef94cba 2026-02-18T00:39:12.720 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:39:12.711+0000 7f38d7831a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:39:12.722 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:39:12.711+0000 7f38d7831a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:39:12.723 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:39:12.715+0000 7f38d7831a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:39:12.724 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:39:12.715+0000 7f38d7831a40 -1 bdev(0x5568b9472c00 td/ceph-helpers/0/block) open stat got: (1) Operation not permitted 2026-02-18T00:39:12.724 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:39:12.715+0000 7f38d7831a40 -1 bluestore(td/ceph-helpers/0) _read_fsid unparsable uuid 2026-02-18T00:39:13.365 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/ceph-helpers/0/keyring 2026-02-18T00:39:13.366 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T00:39:13.366 INFO:tasks.workunit.client.0.trial069.stdout:adding osd0 key to auth repository 2026-02-18T00:39:13.367 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-18T00:39:13.367 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/ceph-helpers/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T00:39:13.482 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-18T00:39:13.483 INFO:tasks.workunit.client.0.trial069.stdout:start osd.0 2026-02-18T00:39:13.483 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --cluster ceph --fsid=863c4e35-ceb0-4172-b7b2-c3ff099e05a2 --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/0 --osd-journal=td/ceph-helpers/0/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T00:39:13.484 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T00:39:13.484 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T00:39:13.484 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T00:39:13.497 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:39:13.487+0000 7fe380dc0a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:39:13.499 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:39:13.491+0000 7fe380dc0a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:39:13.500 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:39:13.491+0000 7fe380dc0a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:39:13.593 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-18T00:39:13.593 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:39:13.593 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-18T00:39:13.593 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:39:13.593 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:39:13.593 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:39:13.594 INFO:tasks.workunit.client.0.trial069.stdout:0 2026-02-18T00:39:13.594 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:39:13.594 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:39:13.595 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T00:39:13.704 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:39:13.896 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:39:13.887+0000 7fe380dc0a40 -1 Falling back to public interface 2026-02-18T00:39:14.500 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:39:14.491+0000 7fe380dc0a40 -1 osd.0 0 log_to_monitors true 2026-02-18T00:39:14.705 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:39:14.705 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:39:14.706 INFO:tasks.workunit.client.0.trial069.stdout:1 2026-02-18T00:39:14.706 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T00:39:14.706 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:39:14.707 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T00:39:14.821 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:39:15.822 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:39:15.823 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:39:15.823 INFO:tasks.workunit.client.0.trial069.stdout:2 2026-02-18T00:39:15.824 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-18T00:39:15.824 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:39:15.824 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T00:39:16.031 INFO:tasks.workunit.client.0.trial069.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/1287518885,v1:127.0.0.1:6801/1287518885] [v2:127.0.0.1:6802/1287518885,v1:127.0.0.1:6803/1287518885] exists,up a3e0d1bd-4501-4d9f-8a5b-9ac7bef94cba 2026-02-18T00:39:16.032 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:39:16.032 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:39:16.032 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:39:16.032 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1456: test_get_osd_id_used_by_pgs: create_rbd_pool 2026-02-18T00:39:16.032 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:526: create_rbd_pool: ceph osd pool delete rbd rbd --yes-i-really-really-mean-it 2026-02-18T00:39:16.228 INFO:tasks.workunit.client.0.trial069.stderr:pool 'rbd' does not exist 2026-02-18T00:39:16.237 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:527: create_rbd_pool: create_pool rbd 4 2026-02-18T00:39:16.237 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create rbd 4 2026-02-18T00:39:16.480 INFO:tasks.workunit.client.0.trial069.stderr:pool 'rbd' already exists 2026-02-18T00:39:16.491 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-18T00:39:17.492 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:528: create_rbd_pool: rbd pool init rbd 2026-02-18T00:39:17.772 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1457: test_get_osd_id_used_by_pgs: wait_for_clean 2026-02-18T00:39:17.772 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-18T00:39:17.772 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-18T00:39:17.772 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-18T00:39:17.773 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-18T00:39:17.773 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-18T00:39:17.774 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-18T00:39:17.774 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-18T00:39:17.774 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-18T00:39:17.774 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-18T00:39:17.876 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-18T00:39:17.876 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-18T00:39:17.876 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-18T00:39:17.876 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-18T00:39:17.876 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-18T00:39:17.876 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-18T00:39:18.083 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids=0 2026-02-18T00:39:18.083 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-18T00:39:18.084 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:39:18.084 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-18T00:39:18.166 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836483 2026-02-18T00:39:18.166 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836483 2026-02-18T00:39:18.166 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836483' 2026-02-18T00:39:18.166 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:39:18.167 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836483 2026-02-18T00:39:18.167 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:39:18.167 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-18T00:39:18.168 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-21474836483 2026-02-18T00:39:18.168 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:39:18.170 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=21474836483 2026-02-18T00:39:18.170 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 21474836483' 2026-02-18T00:39:18.170 INFO:tasks.workunit.client.0.trial069.stdout:waiting osd.0 seq 21474836483 2026-02-18T00:39:18.170 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T00:39:18.391 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 21474836481 -lt 21474836483 2026-02-18T00:39:18.391 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-18T00:39:19.392 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-18T00:39:19.392 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T00:39:19.600 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 21474836483 -lt 21474836483 2026-02-18T00:39:19.601 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-18T00:39:19.601 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T00:39:19.601 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T00:39:19.891 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 4 == 0 2026-02-18T00:39:19.891 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-18T00:39:19.891 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-18T00:39:19.891 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-18T00:39:19.891 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-18T00:39:19.891 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-18T00:39:19.891 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-18T00:39:19.891 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-18T00:39:20.102 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=4 2026-02-18T00:39:20.102 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-18T00:39:20.103 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T00:39:20.103 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T00:39:20.381 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 4 = 4 2026-02-18T00:39:20.382 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-18T00:39:20.382 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-18T00:39:20.383 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1458: test_get_osd_id_used_by_pgs: get_osd_id_used_by_pgs 2026-02-18T00:39:20.383 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1458: test_get_osd_id_used_by_pgs: uniq 2026-02-18T00:39:20.383 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1446: get_osd_id_used_by_pgs: ceph --format json pg dump pgs 2026-02-18T00:39:20.383 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1446: get_osd_id_used_by_pgs: jq '.pg_stats | .[] | .up[], .acting[]' 2026-02-18T00:39:20.383 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1446: get_osd_id_used_by_pgs: sort 2026-02-18T00:39:20.597 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1458: test_get_osd_id_used_by_pgs: local osd_ids=0 2026-02-18T00:39:20.597 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1459: test_get_osd_id_used_by_pgs: test 0 = 0 2026-02-18T00:39:20.598 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1460: test_get_osd_id_used_by_pgs: teardown td/ceph-helpers 2026-02-18T00:39:20.598 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/ceph-helpers 2026-02-18T00:39:20.598 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T00:39:20.598 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/ceph-helpers KILL 2026-02-18T00:39:20.598 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:39:20.598 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:39:20.598 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:39:20.598 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:39:20.598 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:39:20.705 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:39:20.706 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T00:39:20.706 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T00:39:20.707 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T00:39:20.708 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T00:39:20.708 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T00:39:20.708 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T00:39:20.709 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:39:20.709 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T00:39:20.710 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T00:39:20.710 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:39:20.711 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T00:39:20.712 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T00:39:20.712 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/ceph-helpers 2026-02-18T00:39:20.717 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T00:39:20.717 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:39:20.718 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:39:20.718 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.57427 2026-02-18T00:39:20.720 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T00:39:20.720 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T00:39:20.720 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2426: run_tests: for func in $funcs 2026-02-18T00:39:20.720 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2427: run_tests: test_get_osds td/ceph-helpers 2026-02-18T00:39:20.720 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1022: test_get_osds: local dir=td/ceph-helpers 2026-02-18T00:39:20.720 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1024: test_get_osds: setup td/ceph-helpers 2026-02-18T00:39:20.721 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/ceph-helpers 2026-02-18T00:39:20.721 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/ceph-helpers 2026-02-18T00:39:20.721 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/ceph-helpers 2026-02-18T00:39:20.721 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T00:39:20.721 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/ceph-helpers KILL 2026-02-18T00:39:20.721 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:39:20.721 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:39:20.721 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:39:20.721 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:39:20.721 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:39:20.722 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:39:20.722 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T00:39:20.723 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T00:39:20.723 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T00:39:20.724 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T00:39:20.724 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T00:39:20.725 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T00:39:20.725 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:39:20.725 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T00:39:20.726 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T00:39:20.726 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:39:20.727 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T00:39:20.728 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T00:39:20.728 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/ceph-helpers 2026-02-18T00:39:20.729 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T00:39:20.729 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:39:20.729 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:39:20.730 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.57427 2026-02-18T00:39:20.731 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T00:39:20.731 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T00:39:20.731 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/ceph-helpers 2026-02-18T00:39:20.732 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-18T00:39:20.732 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:39:20.732 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:39:20.732 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.57427 2026-02-18T00:39:20.734 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-18T00:39:20.735 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-18T00:39:20.735 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-18T00:39:20.735 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/ceph-helpers 1' TERM HUP INT 2026-02-18T00:39:20.735 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1025: test_get_osds: run_mon td/ceph-helpers a --osd_pool_default_size=2 2026-02-18T00:39:20.735 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/ceph-helpers 2026-02-18T00:39:20.735 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-18T00:39:20.735 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-18T00:39:20.736 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-18T00:39:20.736 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/ceph-helpers/a 2026-02-18T00:39:20.736 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/ceph-helpers/a --run-dir=td/ceph-helpers --osd_pool_default_size=2 2026-02-18T00:39:20.758 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-18T00:39:20.758 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:39:20.758 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:39:20.758 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:39:20.758 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:39:20.758 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:39:20.759 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.57427/$cluster-$name.asok' 2026-02-18T00:39:20.759 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/ceph-helpers/a '--log-file=td/ceph-helpers/$name.log' '--admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' --mon-cluster-log-file=td/ceph-helpers/log --run-dir=td/ceph-helpers '--pid-file=td/ceph-helpers/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --osd_pool_default_size=2 2026-02-18T00:39:20.787 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-18T00:39:20.788 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-18T00:39:20.788 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T00:39:20.788 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-18T00:39:20.788 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-18T00:39:20.789 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-18T00:39:20.789 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-18T00:39:20.789 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:39:20.789 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:39:20.789 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:39:20.789 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:39:20.790 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:39:20.790 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.57427/ceph-mon.a.asok 2026-02-18T00:39:20.790 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T00:39:20.790 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.57427/ceph-mon.a.asok config get fsid 2026-02-18T00:39:20.854 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-18T00:39:20.854 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T00:39:20.854 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-18T00:39:20.854 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-18T00:39:20.854 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-18T00:39:20.856 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-18T00:39:20.856 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:39:20.856 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:39:20.856 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:39:20.856 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:39:20.856 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:39:20.856 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.57427/ceph-mon.a.asok 2026-02-18T00:39:20.856 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T00:39:20.856 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.57427/ceph-mon.a.asok config get mon_host 2026-02-18T00:39:20.911 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1026: test_get_osds: run_mgr td/ceph-helpers x 2026-02-18T00:39:20.911 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/ceph-helpers 2026-02-18T00:39:20.911 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-18T00:39:20.911 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-18T00:39:20.911 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-18T00:39:20.911 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/ceph-helpers/x 2026-02-18T00:39:20.911 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-18T00:39:21.025 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-18T00:39:21.026 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:39:21.026 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:39:21.027 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:39:21.027 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:39:21.027 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:39:21.027 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.57427/$cluster-$name.asok' 2026-02-18T00:39:21.027 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-18T00:39:21.028 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/ceph-helpers/x '--log-file=td/ceph-helpers/$name.log' '--admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' --run-dir=td/ceph-helpers '--pid-file=td/ceph-helpers/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-18T00:39:21.049 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1027: test_get_osds: run_osd td/ceph-helpers 0 2026-02-18T00:39:21.049 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/ceph-helpers 2026-02-18T00:39:21.049 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T00:39:21.049 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-18T00:39:21.049 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T00:39:21.049 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/ceph-helpers/0 2026-02-18T00:39:21.049 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--cluster ceph --fsid=863c4e35-ceb0-4172-b7b2-c3ff099e05a2 --auth-supported=none --mon-host=127.0.0.1:7109 ' 2026-02-18T00:39:21.049 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T00:39:21.049 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T00:39:21.050 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T00:39:21.050 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/ceph-helpers/0' 2026-02-18T00:39:21.050 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/ceph-helpers/0/journal' 2026-02-18T00:39:21.050 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T00:39:21.050 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-18T00:39:21.050 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/ceph-helpers' 2026-02-18T00:39:21.050 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T00:39:21.050 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:39:21.050 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:39:21.050 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:39:21.050 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:39:21.050 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:39:21.050 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.57427/$cluster-$name.asok' 2026-02-18T00:39:21.051 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' 2026-02-18T00:39:21.051 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T00:39:21.051 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T00:39:21.051 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T00:39:21.051 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/ceph-helpers/$name.log' 2026-02-18T00:39:21.051 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/ceph-helpers/$name.pid' 2026-02-18T00:39:21.051 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T00:39:21.051 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T00:39:21.051 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T00:39:21.051 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T00:39:21.051 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T00:39:21.051 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-18T00:39:21.052 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/ceph-helpers/0 2026-02-18T00:39:21.052 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T00:39:21.052 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=0b906a52-a41e-4f49-afc8-0a3d62b8f721 2026-02-18T00:39:21.052 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 0b906a52-a41e-4f49-afc8-0a3d62b8f721' 2026-02-18T00:39:21.053 INFO:tasks.workunit.client.0.trial069.stdout:add osd0 0b906a52-a41e-4f49-afc8-0a3d62b8f721 2026-02-18T00:39:21.053 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T00:39:21.062 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQA5CpVphjNDAxAA5f2AGfD53mhoyiRGpqi5cg== 2026-02-18T00:39:21.063 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQA5CpVphjNDAxAA5f2AGfD53mhoyiRGpqi5cg=="}' 2026-02-18T00:39:21.063 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 0b906a52-a41e-4f49-afc8-0a3d62b8f721 -i td/ceph-helpers/0/new.json 2026-02-18T00:39:21.175 INFO:tasks.workunit.client.0.trial069.stdout:0 2026-02-18T00:39:21.183 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/ceph-helpers/0/new.json 2026-02-18T00:39:21.184 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --cluster ceph --fsid=863c4e35-ceb0-4172-b7b2-c3ff099e05a2 --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/0 --osd-journal=td/ceph-helpers/0/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQA5CpVphjNDAxAA5f2AGfD53mhoyiRGpqi5cg== --osd-uuid 0b906a52-a41e-4f49-afc8-0a3d62b8f721 2026-02-18T00:39:21.200 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:39:21.191+0000 7f6e6f648a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:39:21.202 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:39:21.191+0000 7f6e6f648a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:39:21.203 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:39:21.195+0000 7f6e6f648a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:39:21.204 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:39:21.195+0000 7f6e6f648a40 -1 bdev(0x5563aba5ec00 td/ceph-helpers/0/block) open stat got: (1) Operation not permitted 2026-02-18T00:39:21.204 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:39:21.195+0000 7f6e6f648a40 -1 bluestore(td/ceph-helpers/0) _read_fsid unparsable uuid 2026-02-18T00:39:21.986 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/ceph-helpers/0/keyring 2026-02-18T00:39:21.987 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T00:39:21.987 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-18T00:39:21.988 INFO:tasks.workunit.client.0.trial069.stdout:adding osd0 key to auth repository 2026-02-18T00:39:21.988 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/ceph-helpers/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T00:39:22.104 INFO:tasks.workunit.client.0.trial069.stdout:start osd.0 2026-02-18T00:39:22.105 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-18T00:39:22.105 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --cluster ceph --fsid=863c4e35-ceb0-4172-b7b2-c3ff099e05a2 --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/0 --osd-journal=td/ceph-helpers/0/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T00:39:22.105 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T00:39:22.105 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T00:39:22.105 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T00:39:22.127 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:39:22.119+0000 7f09a2509a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:39:22.129 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:39:22.119+0000 7f09a2509a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:39:22.130 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:39:22.119+0000 7f09a2509a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:39:22.215 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-18T00:39:22.216 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:39:22.216 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-18T00:39:22.216 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:39:22.216 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:39:22.216 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:39:22.216 INFO:tasks.workunit.client.0.trial069.stdout:0 2026-02-18T00:39:22.217 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:39:22.217 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:39:22.217 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T00:39:22.325 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:39:22.544 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:39:22.535+0000 7f09a2509a40 -1 Falling back to public interface 2026-02-18T00:39:23.153 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:39:23.143+0000 7f09a2509a40 -1 osd.0 0 log_to_monitors true 2026-02-18T00:39:23.326 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:39:23.326 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:39:23.327 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T00:39:23.327 INFO:tasks.workunit.client.0.trial069.stdout:1 2026-02-18T00:39:23.327 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:39:23.328 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T00:39:23.544 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:39:24.546 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:39:24.546 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:39:24.546 INFO:tasks.workunit.client.0.trial069.stdout:2 2026-02-18T00:39:24.547 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-18T00:39:24.547 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:39:24.547 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T00:39:24.761 INFO:tasks.workunit.client.0.trial069.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/2122754052,v1:127.0.0.1:6801/2122754052] [v2:127.0.0.1:6802/2122754052,v1:127.0.0.1:6803/2122754052] exists,up 0b906a52-a41e-4f49-afc8-0a3d62b8f721 2026-02-18T00:39:24.764 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:39:24.764 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:39:24.764 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:39:24.765 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1028: test_get_osds: run_osd td/ceph-helpers 1 2026-02-18T00:39:24.765 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/ceph-helpers 2026-02-18T00:39:24.765 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T00:39:24.765 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2026-02-18T00:39:24.765 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T00:39:24.765 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/ceph-helpers/1 2026-02-18T00:39:24.765 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--cluster ceph --fsid=863c4e35-ceb0-4172-b7b2-c3ff099e05a2 --auth-supported=none --mon-host=127.0.0.1:7109 ' 2026-02-18T00:39:24.765 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T00:39:24.765 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T00:39:24.765 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T00:39:24.765 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/ceph-helpers/1' 2026-02-18T00:39:24.766 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/ceph-helpers/1/journal' 2026-02-18T00:39:24.766 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T00:39:24.766 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-18T00:39:24.766 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/ceph-helpers' 2026-02-18T00:39:24.766 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T00:39:24.766 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:39:24.766 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:39:24.766 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:39:24.766 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:39:24.766 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:39:24.766 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.57427/$cluster-$name.asok' 2026-02-18T00:39:24.766 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' 2026-02-18T00:39:24.766 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T00:39:24.767 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T00:39:24.767 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T00:39:24.767 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/ceph-helpers/$name.log' 2026-02-18T00:39:24.767 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/ceph-helpers/$name.pid' 2026-02-18T00:39:24.767 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T00:39:24.767 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T00:39:24.767 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T00:39:24.767 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T00:39:24.767 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T00:39:24.767 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-18T00:39:24.767 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/ceph-helpers/1 2026-02-18T00:39:24.767 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T00:39:24.768 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=b740284d-3263-463f-a757-33e737fc4ed3 2026-02-18T00:39:24.768 INFO:tasks.workunit.client.0.trial069.stdout:add osd1 b740284d-3263-463f-a757-33e737fc4ed3 2026-02-18T00:39:24.769 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 b740284d-3263-463f-a757-33e737fc4ed3' 2026-02-18T00:39:24.769 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T00:39:24.777 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQA8CpVpm8TcLRAAQq3Ab0y5amk9jCMIgE43hw== 2026-02-18T00:39:24.777 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQA8CpVpm8TcLRAAQq3Ab0y5amk9jCMIgE43hw=="}' 2026-02-18T00:39:24.778 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new b740284d-3263-463f-a757-33e737fc4ed3 -i td/ceph-helpers/1/new.json 2026-02-18T00:39:25.002 INFO:tasks.workunit.client.0.trial069.stdout:1 2026-02-18T00:39:25.012 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/ceph-helpers/1/new.json 2026-02-18T00:39:25.013 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --cluster ceph --fsid=863c4e35-ceb0-4172-b7b2-c3ff099e05a2 --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/1 --osd-journal=td/ceph-helpers/1/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQA8CpVpm8TcLRAAQq3Ab0y5amk9jCMIgE43hw== --osd-uuid b740284d-3263-463f-a757-33e737fc4ed3 2026-02-18T00:39:25.030 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:39:25.019+0000 7fca90272a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:39:25.031 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:39:25.023+0000 7fca90272a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:39:25.032 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:39:25.023+0000 7fca90272a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:39:25.032 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:39:25.023+0000 7fca90272a40 -1 bdev(0x561922d4ec00 td/ceph-helpers/1/block) open stat got: (1) Operation not permitted 2026-02-18T00:39:25.033 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:39:25.023+0000 7fca90272a40 -1 bluestore(td/ceph-helpers/1) _read_fsid unparsable uuid 2026-02-18T00:39:25.698 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/ceph-helpers/1/keyring 2026-02-18T00:39:25.698 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T00:39:25.699 INFO:tasks.workunit.client.0.trial069.stdout:adding osd1 key to auth repository 2026-02-18T00:39:25.699 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2026-02-18T00:39:25.699 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/ceph-helpers/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T00:39:25.991 INFO:tasks.workunit.client.0.trial069.stdout:start osd.1 2026-02-18T00:39:25.992 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2026-02-18T00:39:25.992 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --cluster ceph --fsid=863c4e35-ceb0-4172-b7b2-c3ff099e05a2 --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/1 --osd-journal=td/ceph-helpers/1/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T00:39:25.992 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T00:39:25.992 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T00:39:25.992 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T00:39:26.015 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:39:26.007+0000 7f2d86dc3a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:39:26.017 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:39:26.007+0000 7f2d86dc3a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:39:26.018 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:39:26.007+0000 7f2d86dc3a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:39:26.201 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2026-02-18T00:39:26.202 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:39:26.202 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-18T00:39:26.202 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:39:26.202 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:39:26.202 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:39:26.202 INFO:tasks.workunit.client.0.trial069.stdout:0 2026-02-18T00:39:26.203 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:39:26.203 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:39:26.203 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-18T00:39:26.420 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:39:26.461 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:39:26.451+0000 7f2d86dc3a40 -1 Falling back to public interface 2026-02-18T00:39:27.107 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:39:27.095+0000 7f2d86dc3a40 -1 osd.1 0 log_to_monitors true 2026-02-18T00:39:27.421 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:39:27.422 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:39:27.422 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T00:39:27.422 INFO:tasks.workunit.client.0.trial069.stdout:1 2026-02-18T00:39:27.423 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:39:27.423 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-18T00:39:27.638 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:39:28.640 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:39:28.640 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:39:28.640 INFO:tasks.workunit.client.0.trial069.stdout:2 2026-02-18T00:39:28.641 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-18T00:39:28.641 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:39:28.641 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-18T00:39:28.856 INFO:tasks.workunit.client.0.trial069.stdout:osd.1 up in weight 1 up_from 9 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/1650866298,v1:127.0.0.1:6811/1650866298] [v2:127.0.0.1:6812/1650866298,v1:127.0.0.1:6813/1650866298] exists,up b740284d-3263-463f-a757-33e737fc4ed3 2026-02-18T00:39:28.856 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:39:28.857 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:39:28.857 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:39:28.857 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1029: test_get_osds: create_rbd_pool 2026-02-18T00:39:28.857 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:526: create_rbd_pool: ceph osd pool delete rbd rbd --yes-i-really-really-mean-it 2026-02-18T00:39:29.076 INFO:tasks.workunit.client.0.trial069.stderr:pool 'rbd' does not exist 2026-02-18T00:39:29.085 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:527: create_rbd_pool: create_pool rbd 4 2026-02-18T00:39:29.085 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create rbd 4 2026-02-18T00:39:29.364 INFO:tasks.workunit.client.0.trial069.stderr:pool 'rbd' already exists 2026-02-18T00:39:29.374 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-18T00:39:30.376 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:528: create_rbd_pool: rbd pool init rbd 2026-02-18T00:39:30.657 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1030: test_get_osds: wait_for_clean 2026-02-18T00:39:30.657 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-18T00:39:30.657 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-18T00:39:30.657 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-18T00:39:30.657 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-18T00:39:30.658 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-18T00:39:30.658 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-18T00:39:30.659 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-18T00:39:30.659 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-18T00:39:30.659 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-18T00:39:30.760 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-18T00:39:30.760 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-18T00:39:30.760 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-18T00:39:30.760 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-18T00:39:30.760 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-18T00:39:30.760 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-18T00:39:30.971 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-18T00:39:30.971 INFO:tasks.workunit.client.0.trial069.stderr:1' 2026-02-18T00:39:30.971 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-18T00:39:30.971 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:39:30.971 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-18T00:39:31.051 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836484 2026-02-18T00:39:31.051 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836484 2026-02-18T00:39:31.051 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836484' 2026-02-18T00:39:31.051 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:39:31.051 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-18T00:39:31.130 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705667 2026-02-18T00:39:31.130 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705667 2026-02-18T00:39:31.130 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836484 1-38654705667' 2026-02-18T00:39:31.131 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:39:31.131 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836484 2026-02-18T00:39:31.131 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:39:31.132 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-18T00:39:31.133 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-21474836484 2026-02-18T00:39:31.133 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:39:31.134 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=21474836484 2026-02-18T00:39:31.134 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 21474836484' 2026-02-18T00:39:31.135 INFO:tasks.workunit.client.0.trial069.stdout:waiting osd.0 seq 21474836484 2026-02-18T00:39:31.135 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T00:39:31.357 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 21474836484 -lt 21474836484 2026-02-18T00:39:31.357 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:39:31.358 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705667 2026-02-18T00:39:31.358 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:39:31.359 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=1 2026-02-18T00:39:31.359 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 1-38654705667 2026-02-18T00:39:31.359 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:39:31.361 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=38654705667 2026-02-18T00:39:31.361 INFO:tasks.workunit.client.0.trial069.stdout:waiting osd.1 seq 38654705667 2026-02-18T00:39:31.362 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.1 seq 38654705667' 2026-02-18T00:39:31.362 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-18T00:39:31.588 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 38654705667 -lt 38654705667 2026-02-18T00:39:31.588 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-18T00:39:31.589 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T00:39:31.589 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T00:39:31.877 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 4 == 0 2026-02-18T00:39:31.877 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-18T00:39:31.877 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-18T00:39:31.877 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-18T00:39:31.877 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-18T00:39:31.877 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-18T00:39:31.878 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-18T00:39:31.878 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-18T00:39:32.083 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=4 2026-02-18T00:39:32.084 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-18T00:39:32.084 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T00:39:32.084 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T00:39:32.373 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 4 = 4 2026-02-18T00:39:32.374 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-18T00:39:32.374 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-18T00:39:32.374 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1031: test_get_osds: create_rbd_pool 2026-02-18T00:39:32.374 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:526: create_rbd_pool: ceph osd pool delete rbd rbd --yes-i-really-really-mean-it 2026-02-18T00:39:32.636 INFO:tasks.workunit.client.0.trial069.stderr:pool 'rbd' does not exist 2026-02-18T00:39:32.647 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:527: create_rbd_pool: create_pool rbd 4 2026-02-18T00:39:32.647 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create rbd 4 2026-02-18T00:39:32.910 INFO:tasks.workunit.client.0.trial069.stderr:pool 'rbd' already exists 2026-02-18T00:39:32.920 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-18T00:39:33.922 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:528: create_rbd_pool: rbd pool init rbd 2026-02-18T00:39:34.203 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1032: test_get_osds: get_osds rbd GROUP 2026-02-18T00:39:34.204 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1012: get_osds: local poolname=rbd 2026-02-18T00:39:34.204 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1013: get_osds: local objectname=GROUP 2026-02-18T00:39:34.204 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1032: test_get_osds: grep --quiet '^[0-1] [0-1]$' 2026-02-18T00:39:34.204 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: ceph --format json osd map rbd GROUP 2026-02-18T00:39:34.205 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: jq '.acting | .[]' 2026-02-18T00:39:34.417 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: local 'osds=1 2026-02-18T00:39:34.417 INFO:tasks.workunit.client.0.trial069.stderr:0' 2026-02-18T00:39:34.417 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1018: get_osds: echo 1 0 2026-02-18T00:39:34.417 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1033: test_get_osds: teardown td/ceph-helpers 2026-02-18T00:39:34.418 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/ceph-helpers 2026-02-18T00:39:34.418 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T00:39:34.418 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/ceph-helpers KILL 2026-02-18T00:39:34.418 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:39:34.418 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:39:34.418 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:39:34.418 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:39:34.419 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:39:34.526 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:39:34.526 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T00:39:34.527 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T00:39:34.527 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T00:39:34.528 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T00:39:34.528 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T00:39:34.528 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T00:39:34.529 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:39:34.529 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T00:39:34.530 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T00:39:34.530 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:39:34.531 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T00:39:34.532 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T00:39:34.532 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/ceph-helpers 2026-02-18T00:39:34.540 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T00:39:34.540 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:39:34.540 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:39:34.540 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.57427 2026-02-18T00:39:34.542 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T00:39:34.543 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T00:39:34.543 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2426: run_tests: for func in $funcs 2026-02-18T00:39:34.543 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2427: run_tests: test_get_pg td/ceph-helpers 2026-02-18T00:39:34.543 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1091: test_get_pg: local dir=td/ceph-helpers 2026-02-18T00:39:34.543 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1093: test_get_pg: setup td/ceph-helpers 2026-02-18T00:39:34.543 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/ceph-helpers 2026-02-18T00:39:34.543 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/ceph-helpers 2026-02-18T00:39:34.543 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/ceph-helpers 2026-02-18T00:39:34.544 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T00:39:34.544 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/ceph-helpers KILL 2026-02-18T00:39:34.544 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:39:34.544 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:39:34.544 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:39:34.544 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:39:34.544 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:39:34.545 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:39:34.545 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T00:39:34.545 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T00:39:34.546 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T00:39:34.546 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T00:39:34.546 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T00:39:34.547 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T00:39:34.548 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:39:34.548 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T00:39:34.548 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T00:39:34.549 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:39:34.549 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T00:39:34.550 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T00:39:34.551 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/ceph-helpers 2026-02-18T00:39:34.552 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T00:39:34.552 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:39:34.552 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:39:34.552 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.57427 2026-02-18T00:39:34.553 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T00:39:34.553 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T00:39:34.553 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/ceph-helpers 2026-02-18T00:39:34.555 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-18T00:39:34.555 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:39:34.555 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:39:34.555 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.57427 2026-02-18T00:39:34.556 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-18T00:39:34.558 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-18T00:39:34.558 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-18T00:39:34.558 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/ceph-helpers 1' TERM HUP INT 2026-02-18T00:39:34.558 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1094: test_get_pg: run_mon td/ceph-helpers a --osd_pool_default_size=1 --mon_allow_pool_size_one=true 2026-02-18T00:39:34.558 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/ceph-helpers 2026-02-18T00:39:34.558 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-18T00:39:34.558 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-18T00:39:34.558 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-18T00:39:34.558 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/ceph-helpers/a 2026-02-18T00:39:34.559 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/ceph-helpers/a --run-dir=td/ceph-helpers --osd_pool_default_size=1 --mon_allow_pool_size_one=true 2026-02-18T00:39:34.580 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-18T00:39:34.580 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:39:34.580 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:39:34.580 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:39:34.580 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:39:34.581 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:39:34.581 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.57427/$cluster-$name.asok' 2026-02-18T00:39:34.581 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/ceph-helpers/a '--log-file=td/ceph-helpers/$name.log' '--admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' --mon-cluster-log-file=td/ceph-helpers/log --run-dir=td/ceph-helpers '--pid-file=td/ceph-helpers/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --osd_pool_default_size=1 --mon_allow_pool_size_one=true 2026-02-18T00:39:34.609 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-18T00:39:34.609 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-18T00:39:34.609 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T00:39:34.609 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-18T00:39:34.609 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-18T00:39:34.610 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-18T00:39:34.610 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-18T00:39:34.610 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:39:34.610 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:39:34.611 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:39:34.611 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:39:34.611 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:39:34.611 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.57427/ceph-mon.a.asok 2026-02-18T00:39:34.611 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T00:39:34.611 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.57427/ceph-mon.a.asok config get fsid 2026-02-18T00:39:34.668 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-18T00:39:34.668 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T00:39:34.668 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-18T00:39:34.668 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-18T00:39:34.669 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-18T00:39:34.669 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-18T00:39:34.669 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:39:34.669 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:39:34.670 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:39:34.670 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:39:34.670 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:39:34.670 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.57427/ceph-mon.a.asok 2026-02-18T00:39:34.670 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T00:39:34.670 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.57427/ceph-mon.a.asok config get mon_host 2026-02-18T00:39:34.725 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1095: test_get_pg: run_mgr td/ceph-helpers x 2026-02-18T00:39:34.725 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/ceph-helpers 2026-02-18T00:39:34.725 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-18T00:39:34.725 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-18T00:39:34.725 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-18T00:39:34.726 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/ceph-helpers/x 2026-02-18T00:39:34.726 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-18T00:39:34.840 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-18T00:39:34.840 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:39:34.840 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:39:34.840 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:39:34.840 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:39:34.840 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:39:34.840 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.57427/$cluster-$name.asok' 2026-02-18T00:39:34.841 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-18T00:39:34.841 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/ceph-helpers/x '--log-file=td/ceph-helpers/$name.log' '--admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' --run-dir=td/ceph-helpers '--pid-file=td/ceph-helpers/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-18T00:39:34.862 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1096: test_get_pg: run_osd td/ceph-helpers 0 2026-02-18T00:39:34.862 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/ceph-helpers 2026-02-18T00:39:34.862 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T00:39:34.862 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-18T00:39:34.862 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T00:39:34.862 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/ceph-helpers/0 2026-02-18T00:39:34.862 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--cluster ceph --fsid=863c4e35-ceb0-4172-b7b2-c3ff099e05a2 --auth-supported=none --mon-host=127.0.0.1:7109 ' 2026-02-18T00:39:34.862 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T00:39:34.863 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T00:39:34.863 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T00:39:34.863 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/ceph-helpers/0' 2026-02-18T00:39:34.863 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/ceph-helpers/0/journal' 2026-02-18T00:39:34.863 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T00:39:34.863 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-18T00:39:34.863 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/ceph-helpers' 2026-02-18T00:39:34.863 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T00:39:34.863 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:39:34.863 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:39:34.863 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:39:34.863 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:39:34.864 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:39:34.864 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.57427/$cluster-$name.asok' 2026-02-18T00:39:34.864 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' 2026-02-18T00:39:34.864 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T00:39:34.864 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T00:39:34.864 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T00:39:34.864 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/ceph-helpers/$name.log' 2026-02-18T00:39:34.864 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/ceph-helpers/$name.pid' 2026-02-18T00:39:34.864 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T00:39:34.864 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T00:39:34.864 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T00:39:34.864 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T00:39:34.864 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T00:39:34.865 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-18T00:39:34.865 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/ceph-helpers/0 2026-02-18T00:39:34.865 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T00:39:34.865 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=c187104c-f008-453d-9894-c74c3a54472e 2026-02-18T00:39:34.866 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 c187104c-f008-453d-9894-c74c3a54472e' 2026-02-18T00:39:34.866 INFO:tasks.workunit.client.0.trial069.stdout:add osd0 c187104c-f008-453d-9894-c74c3a54472e 2026-02-18T00:39:34.866 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T00:39:34.876 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQBGCpVpOFWzMxAAvE5Ga9/0mTsO7X4uISVDjQ== 2026-02-18T00:39:34.876 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQBGCpVpOFWzMxAAvE5Ga9/0mTsO7X4uISVDjQ=="}' 2026-02-18T00:39:34.876 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new c187104c-f008-453d-9894-c74c3a54472e -i td/ceph-helpers/0/new.json 2026-02-18T00:39:34.986 INFO:tasks.workunit.client.0.trial069.stdout:0 2026-02-18T00:39:34.994 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/ceph-helpers/0/new.json 2026-02-18T00:39:34.995 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --cluster ceph --fsid=863c4e35-ceb0-4172-b7b2-c3ff099e05a2 --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/0 --osd-journal=td/ceph-helpers/0/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQBGCpVpOFWzMxAAvE5Ga9/0mTsO7X4uISVDjQ== --osd-uuid c187104c-f008-453d-9894-c74c3a54472e 2026-02-18T00:39:35.010 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:39:34.999+0000 7faa73648a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:39:35.012 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:39:35.003+0000 7faa73648a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:39:35.012 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:39:35.003+0000 7faa73648a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:39:35.013 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:39:35.003+0000 7faa73648a40 -1 bdev(0x559a42668c00 td/ceph-helpers/0/block) open stat got: (1) Operation not permitted 2026-02-18T00:39:35.013 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:39:35.003+0000 7faa73648a40 -1 bluestore(td/ceph-helpers/0) _read_fsid unparsable uuid 2026-02-18T00:39:35.699 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/ceph-helpers/0/keyring 2026-02-18T00:39:35.699 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T00:39:35.699 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-18T00:39:35.700 INFO:tasks.workunit.client.0.trial069.stdout:adding osd0 key to auth repository 2026-02-18T00:39:35.700 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/ceph-helpers/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T00:39:35.823 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-18T00:39:35.823 INFO:tasks.workunit.client.0.trial069.stdout:start osd.0 2026-02-18T00:39:35.824 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --cluster ceph --fsid=863c4e35-ceb0-4172-b7b2-c3ff099e05a2 --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/0 --osd-journal=td/ceph-helpers/0/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T00:39:35.824 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T00:39:35.824 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T00:39:35.824 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T00:39:35.849 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:39:35.839+0000 7f853e181a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:39:35.851 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:39:35.843+0000 7f853e181a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:39:35.853 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:39:35.843+0000 7f853e181a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:39:35.932 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-18T00:39:35.932 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:39:35.932 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-18T00:39:35.932 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:39:35.932 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:39:35.932 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:39:35.932 INFO:tasks.workunit.client.0.trial069.stdout:0 2026-02-18T00:39:35.933 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:39:35.933 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:39:35.933 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T00:39:36.041 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:39:36.253 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:39:36.243+0000 7f853e181a40 -1 Falling back to public interface 2026-02-18T00:39:37.043 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:39:37.043 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:39:37.043 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T00:39:37.043 INFO:tasks.workunit.client.0.trial069.stdout:1 2026-02-18T00:39:37.044 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:39:37.044 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T00:39:37.153 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:39:37.298 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:39:37.287+0000 7f853e181a40 -1 osd.0 0 log_to_monitors true 2026-02-18T00:39:38.155 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:39:38.155 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:39:38.155 INFO:tasks.workunit.client.0.trial069.stdout:2 2026-02-18T00:39:38.156 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-18T00:39:38.156 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:39:38.156 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T00:39:38.374 INFO:tasks.workunit.client.0.trial069.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/191326677,v1:127.0.0.1:6801/191326677] [v2:127.0.0.1:6802/191326677,v1:127.0.0.1:6803/191326677] exists,up c187104c-f008-453d-9894-c74c3a54472e 2026-02-18T00:39:38.374 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:39:38.375 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:39:38.375 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:39:38.375 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1097: test_get_pg: create_rbd_pool 2026-02-18T00:39:38.375 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:526: create_rbd_pool: ceph osd pool delete rbd rbd --yes-i-really-really-mean-it 2026-02-18T00:39:38.579 INFO:tasks.workunit.client.0.trial069.stderr:pool 'rbd' does not exist 2026-02-18T00:39:38.588 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:527: create_rbd_pool: create_pool rbd 4 2026-02-18T00:39:38.589 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create rbd 4 2026-02-18T00:39:38.821 INFO:tasks.workunit.client.0.trial069.stderr:pool 'rbd' already exists 2026-02-18T00:39:38.830 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-18T00:39:39.831 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:528: create_rbd_pool: rbd pool init rbd 2026-02-18T00:39:40.112 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1098: test_get_pg: wait_for_clean 2026-02-18T00:39:40.112 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-18T00:39:40.113 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-18T00:39:40.113 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-18T00:39:40.113 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-18T00:39:40.113 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-18T00:39:40.113 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-18T00:39:40.113 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-18T00:39:40.113 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-18T00:39:40.113 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-18T00:39:40.214 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-18T00:39:40.214 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-18T00:39:40.214 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-18T00:39:40.214 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-18T00:39:40.214 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-18T00:39:40.215 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-18T00:39:40.439 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids=0 2026-02-18T00:39:40.439 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-18T00:39:40.440 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:39:40.440 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-18T00:39:40.518 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836484 2026-02-18T00:39:40.518 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836484 2026-02-18T00:39:40.518 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836484' 2026-02-18T00:39:40.518 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:39:40.519 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836484 2026-02-18T00:39:40.519 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:39:40.520 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-18T00:39:40.520 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-21474836484 2026-02-18T00:39:40.520 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:39:40.521 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=21474836484 2026-02-18T00:39:40.522 INFO:tasks.workunit.client.0.trial069.stdout:waiting osd.0 seq 21474836484 2026-02-18T00:39:40.522 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 21474836484' 2026-02-18T00:39:40.522 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T00:39:40.747 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 21474836482 -lt 21474836484 2026-02-18T00:39:40.748 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-18T00:39:41.748 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-18T00:39:41.749 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T00:39:41.959 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 21474836484 -lt 21474836484 2026-02-18T00:39:41.960 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-18T00:39:41.960 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T00:39:41.961 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T00:39:42.235 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 4 == 0 2026-02-18T00:39:42.236 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-18T00:39:42.236 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-18T00:39:42.236 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-18T00:39:42.236 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-18T00:39:42.236 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-18T00:39:42.236 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-18T00:39:42.236 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-18T00:39:42.439 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=4 2026-02-18T00:39:42.440 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-18T00:39:42.440 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T00:39:42.440 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T00:39:42.722 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 4 = 4 2026-02-18T00:39:42.723 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-18T00:39:42.723 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-18T00:39:42.723 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1099: test_get_pg: get_pg rbd GROUP 2026-02-18T00:39:42.723 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1099: test_get_pg: grep --quiet '^[0-9]\.[0-9a-f][0-9a-f]*$' 2026-02-18T00:39:42.723 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1084: get_pg: local poolname=rbd 2026-02-18T00:39:42.723 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1085: get_pg: local objectname=GROUP 2026-02-18T00:39:42.723 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: ceph --format json osd map rbd GROUP 2026-02-18T00:39:42.724 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: jq -r .pgid 2026-02-18T00:39:42.937 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1100: test_get_pg: teardown td/ceph-helpers 2026-02-18T00:39:42.937 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/ceph-helpers 2026-02-18T00:39:42.937 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T00:39:42.937 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/ceph-helpers KILL 2026-02-18T00:39:42.938 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:39:42.938 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:39:42.938 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:39:42.938 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:39:42.938 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:39:43.046 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:39:43.046 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T00:39:43.047 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T00:39:43.047 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T00:39:43.048 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T00:39:43.048 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T00:39:43.049 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T00:39:43.050 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:39:43.050 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T00:39:43.050 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T00:39:43.051 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:39:43.052 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T00:39:43.053 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T00:39:43.053 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/ceph-helpers 2026-02-18T00:39:43.056 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T00:39:43.057 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:39:43.057 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:39:43.057 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.57427 2026-02-18T00:39:43.059 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T00:39:43.059 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T00:39:43.059 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2426: run_tests: for func in $funcs 2026-02-18T00:39:43.059 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2427: run_tests: test_get_primary td/ceph-helpers 2026-02-18T00:39:43.060 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1195: test_get_primary: local dir=td/ceph-helpers 2026-02-18T00:39:43.060 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1197: test_get_primary: setup td/ceph-helpers 2026-02-18T00:39:43.060 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/ceph-helpers 2026-02-18T00:39:43.060 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/ceph-helpers 2026-02-18T00:39:43.060 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/ceph-helpers 2026-02-18T00:39:43.060 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T00:39:43.060 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/ceph-helpers KILL 2026-02-18T00:39:43.060 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:39:43.060 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:39:43.060 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:39:43.060 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:39:43.060 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:39:43.061 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:39:43.061 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T00:39:43.062 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T00:39:43.062 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T00:39:43.063 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T00:39:43.064 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T00:39:43.064 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T00:39:43.065 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:39:43.065 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T00:39:43.066 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T00:39:43.066 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:39:43.067 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T00:39:43.068 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T00:39:43.068 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/ceph-helpers 2026-02-18T00:39:43.069 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T00:39:43.069 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:39:43.069 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:39:43.069 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.57427 2026-02-18T00:39:43.070 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T00:39:43.070 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T00:39:43.070 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/ceph-helpers 2026-02-18T00:39:43.072 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-18T00:39:43.072 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:39:43.072 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:39:43.072 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.57427 2026-02-18T00:39:43.074 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-18T00:39:43.075 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-18T00:39:43.075 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-18T00:39:43.075 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/ceph-helpers 1' TERM HUP INT 2026-02-18T00:39:43.075 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1198: test_get_primary: run_mon td/ceph-helpers a --osd_pool_default_size=1 --mon_allow_pool_size_one=true 2026-02-18T00:39:43.075 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/ceph-helpers 2026-02-18T00:39:43.075 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-18T00:39:43.075 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-18T00:39:43.076 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-18T00:39:43.076 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/ceph-helpers/a 2026-02-18T00:39:43.076 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/ceph-helpers/a --run-dir=td/ceph-helpers --osd_pool_default_size=1 --mon_allow_pool_size_one=true 2026-02-18T00:39:43.096 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-18T00:39:43.096 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:39:43.097 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:39:43.097 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:39:43.097 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:39:43.097 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:39:43.097 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.57427/$cluster-$name.asok' 2026-02-18T00:39:43.098 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/ceph-helpers/a '--log-file=td/ceph-helpers/$name.log' '--admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' --mon-cluster-log-file=td/ceph-helpers/log --run-dir=td/ceph-helpers '--pid-file=td/ceph-helpers/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --osd_pool_default_size=1 --mon_allow_pool_size_one=true 2026-02-18T00:39:43.126 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-18T00:39:43.127 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-18T00:39:43.127 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T00:39:43.127 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-18T00:39:43.128 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-18T00:39:43.129 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-18T00:39:43.129 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-18T00:39:43.129 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:39:43.129 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:39:43.129 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:39:43.129 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:39:43.129 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:39:43.129 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.57427/ceph-mon.a.asok 2026-02-18T00:39:43.130 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T00:39:43.130 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.57427/ceph-mon.a.asok config get fsid 2026-02-18T00:39:43.185 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-18T00:39:43.185 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T00:39:43.185 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-18T00:39:43.185 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-18T00:39:43.185 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-18T00:39:43.185 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-18T00:39:43.185 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:39:43.185 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:39:43.185 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:39:43.185 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:39:43.186 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:39:43.186 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.57427/ceph-mon.a.asok 2026-02-18T00:39:43.186 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T00:39:43.187 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.57427/ceph-mon.a.asok config get mon_host 2026-02-18T00:39:43.240 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1199: test_get_primary: local osd=0 2026-02-18T00:39:43.240 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1200: test_get_primary: run_mgr td/ceph-helpers x 2026-02-18T00:39:43.240 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/ceph-helpers 2026-02-18T00:39:43.240 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-18T00:39:43.240 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-18T00:39:43.240 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-18T00:39:43.240 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/ceph-helpers/x 2026-02-18T00:39:43.240 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-18T00:39:43.350 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-18T00:39:43.350 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:39:43.350 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:39:43.350 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:39:43.350 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:39:43.350 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:39:43.351 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.57427/$cluster-$name.asok' 2026-02-18T00:39:43.351 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-18T00:39:43.352 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/ceph-helpers/x '--log-file=td/ceph-helpers/$name.log' '--admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' --run-dir=td/ceph-helpers '--pid-file=td/ceph-helpers/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-18T00:39:43.370 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1201: test_get_primary: run_osd td/ceph-helpers 0 2026-02-18T00:39:43.370 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/ceph-helpers 2026-02-18T00:39:43.370 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T00:39:43.370 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-18T00:39:43.370 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T00:39:43.370 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/ceph-helpers/0 2026-02-18T00:39:43.370 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--cluster ceph --fsid=863c4e35-ceb0-4172-b7b2-c3ff099e05a2 --auth-supported=none --mon-host=127.0.0.1:7109 ' 2026-02-18T00:39:43.370 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T00:39:43.370 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T00:39:43.370 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T00:39:43.370 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/ceph-helpers/0' 2026-02-18T00:39:43.370 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/ceph-helpers/0/journal' 2026-02-18T00:39:43.370 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T00:39:43.370 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-18T00:39:43.370 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/ceph-helpers' 2026-02-18T00:39:43.371 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T00:39:43.371 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:39:43.371 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:39:43.371 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:39:43.371 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:39:43.371 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:39:43.371 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.57427/$cluster-$name.asok' 2026-02-18T00:39:43.372 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' 2026-02-18T00:39:43.372 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T00:39:43.372 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T00:39:43.372 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T00:39:43.372 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/ceph-helpers/$name.log' 2026-02-18T00:39:43.372 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/ceph-helpers/$name.pid' 2026-02-18T00:39:43.372 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T00:39:43.372 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T00:39:43.372 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T00:39:43.372 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T00:39:43.372 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T00:39:43.372 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-18T00:39:43.372 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/ceph-helpers/0 2026-02-18T00:39:43.373 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T00:39:43.374 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=64c10cfe-586f-418e-975a-1bf361bd1ffb 2026-02-18T00:39:43.374 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 64c10cfe-586f-418e-975a-1bf361bd1ffb' 2026-02-18T00:39:43.374 INFO:tasks.workunit.client.0.trial069.stdout:add osd0 64c10cfe-586f-418e-975a-1bf361bd1ffb 2026-02-18T00:39:43.374 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T00:39:43.385 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQBPCpVpOjl/FhAAHTNSA9y59y44lqJ+2Thr/w== 2026-02-18T00:39:43.385 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQBPCpVpOjl/FhAAHTNSA9y59y44lqJ+2Thr/w=="}' 2026-02-18T00:39:43.385 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 64c10cfe-586f-418e-975a-1bf361bd1ffb -i td/ceph-helpers/0/new.json 2026-02-18T00:39:43.501 INFO:tasks.workunit.client.0.trial069.stdout:0 2026-02-18T00:39:43.508 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/ceph-helpers/0/new.json 2026-02-18T00:39:43.510 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --cluster ceph --fsid=863c4e35-ceb0-4172-b7b2-c3ff099e05a2 --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/0 --osd-journal=td/ceph-helpers/0/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQBPCpVpOjl/FhAAHTNSA9y59y44lqJ+2Thr/w== --osd-uuid 64c10cfe-586f-418e-975a-1bf361bd1ffb 2026-02-18T00:39:43.525 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:39:43.515+0000 7fa73bb8ba40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:39:43.527 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:39:43.519+0000 7fa73bb8ba40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:39:43.528 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:39:43.519+0000 7fa73bb8ba40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:39:43.529 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:39:43.519+0000 7fa73bb8ba40 -1 bdev(0x55b3f25e4c00 td/ceph-helpers/0/block) open stat got: (1) Operation not permitted 2026-02-18T00:39:43.529 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:39:43.519+0000 7fa73bb8ba40 -1 bluestore(td/ceph-helpers/0) _read_fsid unparsable uuid 2026-02-18T00:39:44.255 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/ceph-helpers/0/keyring 2026-02-18T00:39:44.255 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T00:39:44.256 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-18T00:39:44.256 INFO:tasks.workunit.client.0.trial069.stdout:adding osd0 key to auth repository 2026-02-18T00:39:44.257 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/ceph-helpers/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T00:39:44.375 INFO:tasks.workunit.client.0.trial069.stdout:start osd.0 2026-02-18T00:39:44.376 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-18T00:39:44.376 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --cluster ceph --fsid=863c4e35-ceb0-4172-b7b2-c3ff099e05a2 --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/0 --osd-journal=td/ceph-helpers/0/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T00:39:44.376 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T00:39:44.376 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T00:39:44.376 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T00:39:44.401 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:39:44.390+0000 7fd7a1ef0a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:39:44.403 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:39:44.394+0000 7fd7a1ef0a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:39:44.404 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:39:44.394+0000 7fd7a1ef0a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:39:44.484 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-18T00:39:44.484 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:39:44.484 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-18T00:39:44.484 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:39:44.484 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:39:44.484 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:39:44.484 INFO:tasks.workunit.client.0.trial069.stdout:0 2026-02-18T00:39:44.485 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:39:44.485 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:39:44.485 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T00:39:44.592 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:39:44.777 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:39:44.766+0000 7fd7a1ef0a40 -1 Falling back to public interface 2026-02-18T00:39:45.594 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:39:45.594 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:39:45.594 INFO:tasks.workunit.client.0.trial069.stdout:1 2026-02-18T00:39:45.595 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T00:39:45.595 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:39:45.595 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T00:39:45.702 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:39:45.816 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:39:45.806+0000 7fd7a1ef0a40 -1 osd.0 0 log_to_monitors true 2026-02-18T00:39:46.703 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:39:46.704 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:39:46.704 INFO:tasks.workunit.client.0.trial069.stdout:2 2026-02-18T00:39:46.705 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-18T00:39:46.705 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:39:46.705 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T00:39:46.916 INFO:tasks.workunit.client.0.trial069.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/3493003593,v1:127.0.0.1:6801/3493003593] [v2:127.0.0.1:6802/3493003593,v1:127.0.0.1:6803/3493003593] exists,up 64c10cfe-586f-418e-975a-1bf361bd1ffb 2026-02-18T00:39:46.917 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:39:46.917 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:39:46.917 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:39:46.917 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1202: test_get_primary: create_rbd_pool 2026-02-18T00:39:46.917 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:526: create_rbd_pool: ceph osd pool delete rbd rbd --yes-i-really-really-mean-it 2026-02-18T00:39:47.115 INFO:tasks.workunit.client.0.trial069.stderr:pool 'rbd' does not exist 2026-02-18T00:39:47.124 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:527: create_rbd_pool: create_pool rbd 4 2026-02-18T00:39:47.125 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create rbd 4 2026-02-18T00:39:47.359 INFO:tasks.workunit.client.0.trial069.stderr:pool 'rbd' already exists 2026-02-18T00:39:47.369 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-18T00:39:48.370 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:528: create_rbd_pool: rbd pool init rbd 2026-02-18T00:39:48.650 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1203: test_get_primary: wait_for_clean 2026-02-18T00:39:48.650 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-18T00:39:48.650 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-18T00:39:48.650 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-18T00:39:48.650 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-18T00:39:48.651 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-18T00:39:48.651 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-18T00:39:48.651 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-18T00:39:48.651 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-18T00:39:48.651 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-18T00:39:48.749 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-18T00:39:48.749 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-18T00:39:48.749 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-18T00:39:48.749 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-18T00:39:48.749 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-18T00:39:48.750 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-18T00:39:48.963 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids=0 2026-02-18T00:39:48.964 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-18T00:39:48.964 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:39:48.964 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-18T00:39:49.040 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836483 2026-02-18T00:39:49.040 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836483 2026-02-18T00:39:49.040 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836483' 2026-02-18T00:39:49.040 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:39:49.041 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836483 2026-02-18T00:39:49.041 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:39:49.042 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-18T00:39:49.043 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-21474836483 2026-02-18T00:39:49.043 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:39:49.044 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=21474836483 2026-02-18T00:39:49.044 INFO:tasks.workunit.client.0.trial069.stdout:waiting osd.0 seq 21474836483 2026-02-18T00:39:49.044 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 21474836483' 2026-02-18T00:39:49.044 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T00:39:49.258 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 21474836481 -lt 21474836483 2026-02-18T00:39:49.258 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-18T00:39:50.259 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-18T00:39:50.260 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T00:39:50.471 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 21474836483 -lt 21474836483 2026-02-18T00:39:50.472 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-18T00:39:50.472 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T00:39:50.472 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T00:39:50.747 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 4 == 0 2026-02-18T00:39:50.747 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-18T00:39:50.747 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-18T00:39:50.747 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-18T00:39:50.748 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-18T00:39:50.748 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-18T00:39:50.748 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-18T00:39:50.748 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-18T00:39:50.966 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=4 2026-02-18T00:39:50.967 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-18T00:39:50.967 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T00:39:50.967 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T00:39:51.246 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 4 = 4 2026-02-18T00:39:51.246 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-18T00:39:51.246 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-18T00:39:51.246 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1204: test_get_primary: get_primary rbd GROUP 2026-02-18T00:39:51.246 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1187: get_primary: local poolname=rbd 2026-02-18T00:39:51.247 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1188: get_primary: local objectname=GROUP 2026-02-18T00:39:51.247 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1190: get_primary: ceph --format json osd map rbd GROUP 2026-02-18T00:39:51.247 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1191: get_primary: jq .acting_primary 2026-02-18T00:39:51.455 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1204: test_get_primary: test 0 = 0 2026-02-18T00:39:51.455 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1205: test_get_primary: teardown td/ceph-helpers 2026-02-18T00:39:51.455 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/ceph-helpers 2026-02-18T00:39:51.455 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T00:39:51.455 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/ceph-helpers KILL 2026-02-18T00:39:51.455 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:39:51.455 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:39:51.456 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:39:51.456 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:39:51.456 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:39:51.563 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:39:51.563 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T00:39:51.564 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T00:39:51.564 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T00:39:51.565 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T00:39:51.565 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T00:39:51.565 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T00:39:51.566 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:39:51.566 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T00:39:51.567 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T00:39:51.567 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:39:51.568 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T00:39:51.569 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T00:39:51.569 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/ceph-helpers 2026-02-18T00:39:51.573 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T00:39:51.573 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:39:51.573 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:39:51.573 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.57427 2026-02-18T00:39:51.574 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T00:39:51.574 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T00:39:51.575 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2426: run_tests: for func in $funcs 2026-02-18T00:39:51.575 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2427: run_tests: test_get_timeout_delays td/ceph-helpers 2026-02-18T00:39:51.575 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1621: test_get_timeout_delays: get_timeout_delays 1 2026-02-18T00:39:51.576 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-18T00:39:51.576 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-18T00:39:51.576 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-18T00:39:51.576 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-18T00:39:51.576 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-18T00:39:51.588 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1621: test_get_timeout_delays: test '1 ' = '1 ' 2026-02-18T00:39:51.589 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1622: test_get_timeout_delays: get_timeout_delays 5 2026-02-18T00:39:51.589 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-18T00:39:51.590 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-18T00:39:51.590 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-18T00:39:51.590 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-18T00:39:51.590 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-18T00:39:51.610 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1622: test_get_timeout_delays: test '1 2 2 ' = '1 2 2 ' 2026-02-18T00:39:51.611 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1623: test_get_timeout_delays: get_timeout_delays 6 2026-02-18T00:39:51.611 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-18T00:39:51.612 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-18T00:39:51.612 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-18T00:39:51.612 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-18T00:39:51.613 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-18T00:39:51.636 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1623: test_get_timeout_delays: test '1 2 3 ' = '1 2 3 ' 2026-02-18T00:39:51.637 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1624: test_get_timeout_delays: get_timeout_delays 7 2026-02-18T00:39:51.638 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-18T00:39:51.638 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-18T00:39:51.638 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-18T00:39:51.638 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-18T00:39:51.638 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-18T00:39:51.668 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1624: test_get_timeout_delays: test '1 2 4 ' = '1 2 4 ' 2026-02-18T00:39:51.669 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1625: test_get_timeout_delays: get_timeout_delays 8 2026-02-18T00:39:51.669 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-18T00:39:51.670 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-18T00:39:51.670 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-18T00:39:51.670 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-18T00:39:51.670 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-18T00:39:51.703 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1625: test_get_timeout_delays: test '1 2 4 1 ' = '1 2 4 1 ' 2026-02-18T00:39:51.703 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1626: test_get_timeout_delays: get_timeout_delays 1 .1 2026-02-18T00:39:51.704 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-18T00:39:51.704 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-18T00:39:51.704 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-18T00:39:51.704 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-18T00:39:51.704 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-18T00:39:51.737 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1626: test_get_timeout_delays: test '0.1 0.2 0.4 0.3 ' = '0.1 0.2 0.4 0.3 ' 2026-02-18T00:39:51.738 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1627: test_get_timeout_delays: get_timeout_delays 1.5 .1 2026-02-18T00:39:51.739 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-18T00:39:51.739 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-18T00:39:51.739 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-18T00:39:51.739 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-18T00:39:51.739 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-18T00:39:51.770 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1627: test_get_timeout_delays: test '0.1 0.2 0.4 0.8 ' = '0.1 0.2 0.4 0.8 ' 2026-02-18T00:39:51.771 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1628: test_get_timeout_delays: get_timeout_delays 5 .1 2026-02-18T00:39:51.771 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-18T00:39:51.771 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-18T00:39:51.771 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-18T00:39:51.771 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-18T00:39:51.772 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-18T00:39:51.821 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1628: test_get_timeout_delays: test '0.1 0.2 0.4 0.8 1.6 1.9 ' = '0.1 0.2 0.4 0.8 1.6 1.9 ' 2026-02-18T00:39:51.821 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1629: test_get_timeout_delays: get_timeout_delays 6 .1 2026-02-18T00:39:51.822 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-18T00:39:51.823 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-18T00:39:51.823 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-18T00:39:51.823 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-18T00:39:51.823 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-18T00:39:51.864 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1629: test_get_timeout_delays: test '0.1 0.2 0.4 0.8 1.6 2.9 ' = '0.1 0.2 0.4 0.8 1.6 2.9 ' 2026-02-18T00:39:51.864 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1630: test_get_timeout_delays: get_timeout_delays 6.3 .1 2026-02-18T00:39:51.865 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-18T00:39:51.865 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-18T00:39:51.865 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-18T00:39:51.865 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-18T00:39:51.865 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-18T00:39:51.907 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1630: test_get_timeout_delays: test '0.1 0.2 0.4 0.8 1.6 3.2 ' = '0.1 0.2 0.4 0.8 1.6 3.2 ' 2026-02-18T00:39:51.907 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1631: test_get_timeout_delays: get_timeout_delays 20 .1 2026-02-18T00:39:51.908 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-18T00:39:51.908 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-18T00:39:51.908 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-18T00:39:51.908 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-18T00:39:51.908 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-18T00:39:51.976 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1631: test_get_timeout_delays: test '0.1 0.2 0.4 0.8 1.6 3.2 6.4 7.3 ' = '0.1 0.2 0.4 0.8 1.6 3.2 6.4 7.3 ' 2026-02-18T00:39:51.977 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1632: test_get_timeout_delays: get_timeout_delays 300 .1 0 2026-02-18T00:39:51.977 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-18T00:39:51.977 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-18T00:39:51.978 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-18T00:39:51.978 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-18T00:39:51.978 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-18T00:39:52.057 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1632: test_get_timeout_delays: test '0.1 0.2 0.4 0.8 1.6 3.2 6.4 12.8 25.6 51.2 102.4 95.3 ' = '0.1 0.2 0.4 0.8 1.6 3.2 6.4 12.8 25.6 51.2 102.4 95.3 ' 2026-02-18T00:39:52.058 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1633: test_get_timeout_delays: get_timeout_delays 300 .1 10 2026-02-18T00:39:52.059 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-18T00:39:52.059 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-18T00:39:52.059 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-18T00:39:52.059 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-18T00:39:52.059 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-18T00:39:52.368 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1633: test_get_timeout_delays: test '0.1 0.2 0.4 0.8 1.6 3.2 6.4 10 10 10 10 10 10 10 10 10 10 10 10 10 10 10 10 10 10 10 10 10 10 10 10 10 10 10 10 7.3 ' = '0.1 0.2 0.4 0.8 1.6 3.2 6.4 10 10 10 10 10 10 10 10 10 10 10 10 10 10 10 10 10 10 10 10 10 10 10 10 10 10 10 10 7.3 ' 2026-02-18T00:39:52.368 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2426: run_tests: for func in $funcs 2026-02-18T00:39:52.369 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2427: run_tests: test_is_clean td/ceph-helpers 2026-02-18T00:39:52.369 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1552: test_is_clean: local dir=td/ceph-helpers 2026-02-18T00:39:52.369 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1554: test_is_clean: setup td/ceph-helpers 2026-02-18T00:39:52.369 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/ceph-helpers 2026-02-18T00:39:52.369 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/ceph-helpers 2026-02-18T00:39:52.369 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/ceph-helpers 2026-02-18T00:39:52.369 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T00:39:52.369 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/ceph-helpers KILL 2026-02-18T00:39:52.369 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:39:52.369 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:39:52.369 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:39:52.369 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:39:52.370 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:39:52.370 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:39:52.371 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T00:39:52.371 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T00:39:52.372 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T00:39:52.373 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T00:39:52.373 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T00:39:52.373 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T00:39:52.374 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:39:52.375 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T00:39:52.375 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T00:39:52.375 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:39:52.376 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T00:39:52.377 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T00:39:52.377 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/ceph-helpers 2026-02-18T00:39:52.378 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T00:39:52.378 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:39:52.378 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:39:52.379 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.57427 2026-02-18T00:39:52.380 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T00:39:52.380 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T00:39:52.380 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/ceph-helpers 2026-02-18T00:39:52.381 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-18T00:39:52.381 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:39:52.381 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:39:52.381 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.57427 2026-02-18T00:39:52.384 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-18T00:39:52.384 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-18T00:39:52.385 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-18T00:39:52.385 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/ceph-helpers 1' TERM HUP INT 2026-02-18T00:39:52.385 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1555: test_is_clean: run_mon td/ceph-helpers a --osd_pool_default_size=1 --mon_allow_pool_size_one=true 2026-02-18T00:39:52.385 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/ceph-helpers 2026-02-18T00:39:52.385 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-18T00:39:52.385 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-18T00:39:52.385 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-18T00:39:52.385 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/ceph-helpers/a 2026-02-18T00:39:52.385 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/ceph-helpers/a --run-dir=td/ceph-helpers --osd_pool_default_size=1 --mon_allow_pool_size_one=true 2026-02-18T00:39:52.407 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-18T00:39:52.407 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:39:52.407 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:39:52.407 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:39:52.407 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:39:52.407 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:39:52.407 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.57427/$cluster-$name.asok' 2026-02-18T00:39:52.408 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/ceph-helpers/a '--log-file=td/ceph-helpers/$name.log' '--admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' --mon-cluster-log-file=td/ceph-helpers/log --run-dir=td/ceph-helpers '--pid-file=td/ceph-helpers/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --osd_pool_default_size=1 --mon_allow_pool_size_one=true 2026-02-18T00:39:52.434 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-18T00:39:52.435 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-18T00:39:52.435 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T00:39:52.435 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-18T00:39:52.435 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-18T00:39:52.435 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-18T00:39:52.436 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-18T00:39:52.437 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:39:52.437 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:39:52.437 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:39:52.437 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:39:52.437 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:39:52.437 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.57427/ceph-mon.a.asok 2026-02-18T00:39:52.437 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T00:39:52.437 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.57427/ceph-mon.a.asok config get fsid 2026-02-18T00:39:52.491 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-18T00:39:52.491 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T00:39:52.491 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-18T00:39:52.491 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-18T00:39:52.492 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-18T00:39:52.493 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-18T00:39:52.493 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:39:52.493 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:39:52.493 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:39:52.493 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:39:52.493 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:39:52.493 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.57427/ceph-mon.a.asok 2026-02-18T00:39:52.493 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T00:39:52.493 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.57427/ceph-mon.a.asok config get mon_host 2026-02-18T00:39:52.547 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1556: test_is_clean: run_mgr td/ceph-helpers x 2026-02-18T00:39:52.547 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/ceph-helpers 2026-02-18T00:39:52.547 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-18T00:39:52.547 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-18T00:39:52.547 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-18T00:39:52.548 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/ceph-helpers/x 2026-02-18T00:39:52.548 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-18T00:39:52.662 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-18T00:39:52.662 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:39:52.662 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:39:52.662 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:39:52.663 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:39:52.663 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:39:52.663 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.57427/$cluster-$name.asok' 2026-02-18T00:39:52.663 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-18T00:39:52.664 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/ceph-helpers/x '--log-file=td/ceph-helpers/$name.log' '--admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' --run-dir=td/ceph-helpers '--pid-file=td/ceph-helpers/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-18T00:39:52.683 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1557: test_is_clean: run_osd td/ceph-helpers 0 2026-02-18T00:39:52.683 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/ceph-helpers 2026-02-18T00:39:52.683 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T00:39:52.683 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-18T00:39:52.683 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T00:39:52.684 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/ceph-helpers/0 2026-02-18T00:39:52.684 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--cluster ceph --fsid=863c4e35-ceb0-4172-b7b2-c3ff099e05a2 --auth-supported=none --mon-host=127.0.0.1:7109 ' 2026-02-18T00:39:52.684 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T00:39:52.684 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T00:39:52.684 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T00:39:52.684 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/ceph-helpers/0' 2026-02-18T00:39:52.684 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/ceph-helpers/0/journal' 2026-02-18T00:39:52.684 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T00:39:52.684 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-18T00:39:52.684 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/ceph-helpers' 2026-02-18T00:39:52.684 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T00:39:52.685 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:39:52.685 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:39:52.685 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:39:52.685 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:39:52.685 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:39:52.685 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.57427/$cluster-$name.asok' 2026-02-18T00:39:52.685 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' 2026-02-18T00:39:52.685 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T00:39:52.685 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T00:39:52.685 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T00:39:52.685 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/ceph-helpers/$name.log' 2026-02-18T00:39:52.686 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/ceph-helpers/$name.pid' 2026-02-18T00:39:52.686 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T00:39:52.686 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T00:39:52.686 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T00:39:52.686 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T00:39:52.686 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T00:39:52.686 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-18T00:39:52.686 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/ceph-helpers/0 2026-02-18T00:39:52.686 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T00:39:52.686 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=92271605-22ef-4d47-b051-904324513482 2026-02-18T00:39:52.687 INFO:tasks.workunit.client.0.trial069.stdout:add osd0 92271605-22ef-4d47-b051-904324513482 2026-02-18T00:39:52.687 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 92271605-22ef-4d47-b051-904324513482' 2026-02-18T00:39:52.688 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T00:39:52.695 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQBYCpVp1KPkKBAAE7fBwON9AcF5aZXmMRaJkg== 2026-02-18T00:39:52.695 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQBYCpVp1KPkKBAAE7fBwON9AcF5aZXmMRaJkg=="}' 2026-02-18T00:39:52.695 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 92271605-22ef-4d47-b051-904324513482 -i td/ceph-helpers/0/new.json 2026-02-18T00:39:52.811 INFO:tasks.workunit.client.0.trial069.stdout:0 2026-02-18T00:39:52.819 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/ceph-helpers/0/new.json 2026-02-18T00:39:52.820 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --cluster ceph --fsid=863c4e35-ceb0-4172-b7b2-c3ff099e05a2 --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/0 --osd-journal=td/ceph-helpers/0/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQBYCpVp1KPkKBAAE7fBwON9AcF5aZXmMRaJkg== --osd-uuid 92271605-22ef-4d47-b051-904324513482 2026-02-18T00:39:52.837 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:39:52.826+0000 7f9c8cb24a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:39:52.838 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:39:52.826+0000 7f9c8cb24a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:39:52.839 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:39:52.826+0000 7f9c8cb24a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:39:52.839 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:39:52.826+0000 7f9c8cb24a40 -1 bdev(0x55e2fc5a2c00 td/ceph-helpers/0/block) open stat got: (1) Operation not permitted 2026-02-18T00:39:52.840 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:39:52.826+0000 7f9c8cb24a40 -1 bluestore(td/ceph-helpers/0) _read_fsid unparsable uuid 2026-02-18T00:39:53.560 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/ceph-helpers/0/keyring 2026-02-18T00:39:53.560 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T00:39:53.561 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-18T00:39:53.561 INFO:tasks.workunit.client.0.trial069.stdout:adding osd0 key to auth repository 2026-02-18T00:39:53.562 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/ceph-helpers/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T00:39:53.682 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-18T00:39:53.682 INFO:tasks.workunit.client.0.trial069.stdout:start osd.0 2026-02-18T00:39:53.683 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --cluster ceph --fsid=863c4e35-ceb0-4172-b7b2-c3ff099e05a2 --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/0 --osd-journal=td/ceph-helpers/0/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T00:39:53.683 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T00:39:53.683 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T00:39:53.683 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T00:39:53.706 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:39:53.694+0000 7fb266532a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:39:53.708 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:39:53.698+0000 7fb266532a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:39:53.710 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:39:53.698+0000 7fb266532a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:39:53.790 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-18T00:39:53.791 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:39:53.791 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-18T00:39:53.791 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:39:53.791 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:39:53.791 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:39:53.791 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:39:53.791 INFO:tasks.workunit.client.0.trial069.stdout:0 2026-02-18T00:39:53.792 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:39:53.792 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T00:39:53.898 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:39:54.113 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:39:54.102+0000 7fb266532a40 -1 Falling back to public interface 2026-02-18T00:39:54.899 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:39:54.899 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:39:54.900 INFO:tasks.workunit.client.0.trial069.stdout:1 2026-02-18T00:39:54.900 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T00:39:54.901 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:39:54.901 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T00:39:55.005 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:39:55.154 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:39:55.142+0000 7fb266532a40 -1 osd.0 0 log_to_monitors true 2026-02-18T00:39:56.006 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:39:56.007 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:39:56.007 INFO:tasks.workunit.client.0.trial069.stdout:2 2026-02-18T00:39:56.008 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-18T00:39:56.008 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:39:56.008 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T00:39:56.215 INFO:tasks.workunit.client.0.trial069.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/945052258,v1:127.0.0.1:6801/945052258] [v2:127.0.0.1:6802/945052258,v1:127.0.0.1:6803/945052258] exists,up 92271605-22ef-4d47-b051-904324513482 2026-02-18T00:39:56.216 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:39:56.216 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:39:56.216 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:39:56.216 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1558: test_is_clean: create_rbd_pool 2026-02-18T00:39:56.216 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:526: create_rbd_pool: ceph osd pool delete rbd rbd --yes-i-really-really-mean-it 2026-02-18T00:39:56.416 INFO:tasks.workunit.client.0.trial069.stderr:pool 'rbd' does not exist 2026-02-18T00:39:56.425 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:527: create_rbd_pool: create_pool rbd 4 2026-02-18T00:39:56.425 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create rbd 4 2026-02-18T00:39:56.663 INFO:tasks.workunit.client.0.trial069.stderr:pool 'rbd' already exists 2026-02-18T00:39:56.674 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-18T00:39:57.675 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:528: create_rbd_pool: rbd pool init rbd 2026-02-18T00:39:57.955 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1559: test_is_clean: wait_for_clean 2026-02-18T00:39:57.955 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-18T00:39:57.955 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-18T00:39:57.955 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-18T00:39:57.956 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-18T00:39:57.956 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-18T00:39:57.957 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-18T00:39:57.957 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-18T00:39:57.957 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-18T00:39:57.957 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-18T00:39:58.056 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-18T00:39:58.056 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-18T00:39:58.056 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-18T00:39:58.056 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-18T00:39:58.056 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-18T00:39:58.056 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-18T00:39:58.275 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids=0 2026-02-18T00:39:58.275 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-18T00:39:58.275 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:39:58.275 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-18T00:39:58.353 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836483 2026-02-18T00:39:58.354 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836483 2026-02-18T00:39:58.354 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836483' 2026-02-18T00:39:58.354 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:39:58.355 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836483 2026-02-18T00:39:58.355 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:39:58.355 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-18T00:39:58.356 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-21474836483 2026-02-18T00:39:58.356 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:39:58.357 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=21474836483 2026-02-18T00:39:58.358 INFO:tasks.workunit.client.0.trial069.stdout:waiting osd.0 seq 21474836483 2026-02-18T00:39:58.358 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 21474836483' 2026-02-18T00:39:58.358 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T00:39:58.567 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 21474836481 -lt 21474836483 2026-02-18T00:39:58.567 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-18T00:39:59.568 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-18T00:39:59.569 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T00:39:59.778 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 21474836483 -lt 21474836483 2026-02-18T00:39:59.779 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-18T00:39:59.779 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T00:39:59.779 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T00:40:00.053 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 4 == 0 2026-02-18T00:40:00.054 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-18T00:40:00.054 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-18T00:40:00.054 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-18T00:40:00.054 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-18T00:40:00.054 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-18T00:40:00.054 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-18T00:40:00.054 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-18T00:40:00.271 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=4 2026-02-18T00:40:00.271 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-18T00:40:00.271 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T00:40:00.272 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T00:40:00.554 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 4 = 4 2026-02-18T00:40:00.554 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-18T00:40:00.554 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-18T00:40:00.554 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1560: test_is_clean: is_clean 2026-02-18T00:40:00.554 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1546: is_clean: get_num_pgs 2026-02-18T00:40:00.554 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T00:40:00.554 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T00:40:00.842 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1546: is_clean: num_pgs=4 2026-02-18T00:40:00.842 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1547: is_clean: test 4 '!=' 0 2026-02-18T00:40:00.842 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1548: is_clean: get_num_active_clean 2026-02-18T00:40:00.843 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-18T00:40:00.843 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-18T00:40:00.843 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-18T00:40:00.843 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-18T00:40:00.843 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-18T00:40:01.057 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1548: is_clean: test 4 = 4 2026-02-18T00:40:01.058 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1561: test_is_clean: teardown td/ceph-helpers 2026-02-18T00:40:01.058 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/ceph-helpers 2026-02-18T00:40:01.058 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T00:40:01.058 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/ceph-helpers KILL 2026-02-18T00:40:01.058 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:40:01.058 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:40:01.058 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:40:01.058 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:40:01.058 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:40:01.166 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:40:01.166 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T00:40:01.167 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T00:40:01.167 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T00:40:01.169 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T00:40:01.169 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T00:40:01.169 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T00:40:01.170 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:40:01.170 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T00:40:01.171 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T00:40:01.171 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:40:01.172 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T00:40:01.173 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T00:40:01.173 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/ceph-helpers 2026-02-18T00:40:01.177 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T00:40:01.177 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:40:01.177 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:40:01.177 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.57427 2026-02-18T00:40:01.179 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T00:40:01.180 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T00:40:01.180 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2426: run_tests: for func in $funcs 2026-02-18T00:40:01.180 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2427: run_tests: test_kill_daemon td/ceph-helpers 2026-02-18T00:40:01.180 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:266: test_kill_daemon: local dir=td/ceph-helpers 2026-02-18T00:40:01.180 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:267: test_kill_daemon: setup td/ceph-helpers 2026-02-18T00:40:01.180 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/ceph-helpers 2026-02-18T00:40:01.180 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/ceph-helpers 2026-02-18T00:40:01.180 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/ceph-helpers 2026-02-18T00:40:01.180 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T00:40:01.180 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/ceph-helpers KILL 2026-02-18T00:40:01.180 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:40:01.180 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:40:01.181 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:40:01.181 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:40:01.181 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:40:01.181 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:40:01.182 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T00:40:01.183 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T00:40:01.183 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T00:40:01.184 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T00:40:01.185 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T00:40:01.185 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T00:40:01.186 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:40:01.186 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T00:40:01.187 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T00:40:01.187 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:40:01.188 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T00:40:01.189 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T00:40:01.189 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/ceph-helpers 2026-02-18T00:40:01.190 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T00:40:01.190 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:40:01.190 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:40:01.191 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.57427 2026-02-18T00:40:01.192 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T00:40:01.192 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T00:40:01.192 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/ceph-helpers 2026-02-18T00:40:01.193 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-18T00:40:01.193 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:40:01.193 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:40:01.193 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.57427 2026-02-18T00:40:01.196 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-18T00:40:01.196 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-18T00:40:01.196 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-18T00:40:01.196 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/ceph-helpers 1' TERM HUP INT 2026-02-18T00:40:01.196 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:268: test_kill_daemon: run_mon td/ceph-helpers a --osd_pool_default_size=1 --mon_allow_pool_size_one=true 2026-02-18T00:40:01.196 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/ceph-helpers 2026-02-18T00:40:01.196 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-18T00:40:01.196 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-18T00:40:01.196 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-18T00:40:01.197 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/ceph-helpers/a 2026-02-18T00:40:01.197 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/ceph-helpers/a --run-dir=td/ceph-helpers --osd_pool_default_size=1 --mon_allow_pool_size_one=true 2026-02-18T00:40:01.217 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-18T00:40:01.217 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:40:01.217 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:40:01.217 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:40:01.217 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:40:01.217 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:40:01.217 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.57427/$cluster-$name.asok' 2026-02-18T00:40:01.218 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/ceph-helpers/a '--log-file=td/ceph-helpers/$name.log' '--admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' --mon-cluster-log-file=td/ceph-helpers/log --run-dir=td/ceph-helpers '--pid-file=td/ceph-helpers/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --osd_pool_default_size=1 --mon_allow_pool_size_one=true 2026-02-18T00:40:01.254 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-18T00:40:01.255 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-18T00:40:01.255 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T00:40:01.255 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-18T00:40:01.255 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-18T00:40:01.256 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-18T00:40:01.256 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-18T00:40:01.256 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:40:01.256 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:40:01.257 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:40:01.257 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:40:01.257 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:40:01.257 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.57427/ceph-mon.a.asok 2026-02-18T00:40:01.257 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T00:40:01.257 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.57427/ceph-mon.a.asok config get fsid 2026-02-18T00:40:01.312 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-18T00:40:01.312 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T00:40:01.312 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-18T00:40:01.312 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-18T00:40:01.312 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-18T00:40:01.313 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-18T00:40:01.313 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:40:01.313 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:40:01.313 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:40:01.314 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:40:01.314 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:40:01.314 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.57427/ceph-mon.a.asok 2026-02-18T00:40:01.314 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T00:40:01.314 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.57427/ceph-mon.a.asok config get mon_host 2026-02-18T00:40:01.367 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:269: test_kill_daemon: run_mgr td/ceph-helpers x 2026-02-18T00:40:01.367 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/ceph-helpers 2026-02-18T00:40:01.367 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-18T00:40:01.367 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-18T00:40:01.367 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-18T00:40:01.367 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/ceph-helpers/x 2026-02-18T00:40:01.367 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-18T00:40:01.476 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-18T00:40:01.477 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:40:01.477 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:40:01.477 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:40:01.477 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:40:01.477 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:40:01.477 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.57427/$cluster-$name.asok' 2026-02-18T00:40:01.478 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-18T00:40:01.478 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/ceph-helpers/x '--log-file=td/ceph-helpers/$name.log' '--admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' --run-dir=td/ceph-helpers '--pid-file=td/ceph-helpers/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-18T00:40:01.497 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:270: test_kill_daemon: run_osd td/ceph-helpers 0 2026-02-18T00:40:01.497 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/ceph-helpers 2026-02-18T00:40:01.497 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T00:40:01.497 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-18T00:40:01.497 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T00:40:01.498 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/ceph-helpers/0 2026-02-18T00:40:01.498 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--cluster ceph --fsid=863c4e35-ceb0-4172-b7b2-c3ff099e05a2 --auth-supported=none --mon-host=127.0.0.1:7109 ' 2026-02-18T00:40:01.498 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T00:40:01.498 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T00:40:01.498 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T00:40:01.498 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/ceph-helpers/0' 2026-02-18T00:40:01.498 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/ceph-helpers/0/journal' 2026-02-18T00:40:01.498 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T00:40:01.498 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-18T00:40:01.498 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/ceph-helpers' 2026-02-18T00:40:01.498 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T00:40:01.498 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:40:01.498 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:40:01.498 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:40:01.498 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:40:01.498 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:40:01.498 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.57427/$cluster-$name.asok' 2026-02-18T00:40:01.499 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' 2026-02-18T00:40:01.499 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T00:40:01.499 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T00:40:01.499 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T00:40:01.499 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/ceph-helpers/$name.log' 2026-02-18T00:40:01.499 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/ceph-helpers/$name.pid' 2026-02-18T00:40:01.499 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T00:40:01.499 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T00:40:01.499 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T00:40:01.499 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T00:40:01.499 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T00:40:01.499 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-18T00:40:01.499 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/ceph-helpers/0 2026-02-18T00:40:01.500 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T00:40:01.501 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=aab3373c-e767-477f-87a6-72b1fba5213b 2026-02-18T00:40:01.501 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 aab3373c-e767-477f-87a6-72b1fba5213b' 2026-02-18T00:40:01.501 INFO:tasks.workunit.client.0.trial069.stdout:add osd0 aab3373c-e767-477f-87a6-72b1fba5213b 2026-02-18T00:40:01.501 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T00:40:01.512 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQBhCpVpuRwFHhAAn7X5540j23z3bKOo/SNfsA== 2026-02-18T00:40:01.513 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQBhCpVpuRwFHhAAn7X5540j23z3bKOo/SNfsA=="}' 2026-02-18T00:40:01.513 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new aab3373c-e767-477f-87a6-72b1fba5213b -i td/ceph-helpers/0/new.json 2026-02-18T00:40:01.623 INFO:tasks.workunit.client.0.trial069.stdout:0 2026-02-18T00:40:01.631 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/ceph-helpers/0/new.json 2026-02-18T00:40:01.632 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --cluster ceph --fsid=863c4e35-ceb0-4172-b7b2-c3ff099e05a2 --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/0 --osd-journal=td/ceph-helpers/0/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQBhCpVpuRwFHhAAn7X5540j23z3bKOo/SNfsA== --osd-uuid aab3373c-e767-477f-87a6-72b1fba5213b 2026-02-18T00:40:01.649 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:40:01.638+0000 7fb8b6ce1a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:40:01.650 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:40:01.638+0000 7fb8b6ce1a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:40:01.651 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:40:01.638+0000 7fb8b6ce1a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:40:01.652 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:40:01.642+0000 7fb8b6ce1a40 -1 bdev(0x565474f5ec00 td/ceph-helpers/0/block) open stat got: (1) Operation not permitted 2026-02-18T00:40:01.652 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:40:01.642+0000 7fb8b6ce1a40 -1 bluestore(td/ceph-helpers/0) _read_fsid unparsable uuid 2026-02-18T00:40:02.376 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/ceph-helpers/0/keyring 2026-02-18T00:40:02.376 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T00:40:02.377 INFO:tasks.workunit.client.0.trial069.stdout:adding osd0 key to auth repository 2026-02-18T00:40:02.377 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-18T00:40:02.377 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/ceph-helpers/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T00:40:02.502 INFO:tasks.workunit.client.0.trial069.stdout:start osd.0 2026-02-18T00:40:02.503 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-18T00:40:02.503 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --cluster ceph --fsid=863c4e35-ceb0-4172-b7b2-c3ff099e05a2 --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/0 --osd-journal=td/ceph-helpers/0/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T00:40:02.503 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T00:40:02.503 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T00:40:02.503 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T00:40:02.526 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:40:02.514+0000 7f09e8be9a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:40:02.528 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:40:02.518+0000 7f09e8be9a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:40:02.529 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:40:02.518+0000 7f09e8be9a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:40:02.608 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-18T00:40:02.609 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:40:02.609 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-18T00:40:02.609 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:40:02.609 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:40:02.609 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:40:02.609 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:40:02.609 INFO:tasks.workunit.client.0.trial069.stdout:0 2026-02-18T00:40:02.610 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:40:02.610 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T00:40:02.716 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:40:02.910 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:40:02.898+0000 7f09e8be9a40 -1 Falling back to public interface 2026-02-18T00:40:03.717 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:40:03.718 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:40:03.718 INFO:tasks.workunit.client.0.trial069.stdout:1 2026-02-18T00:40:03.719 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T00:40:03.719 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:40:03.719 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T00:40:03.822 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:40:03.943 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:40:03.930+0000 7f09e8be9a40 -1 osd.0 0 log_to_monitors true 2026-02-18T00:40:04.824 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:40:04.824 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:40:04.825 INFO:tasks.workunit.client.0.trial069.stdout:2 2026-02-18T00:40:04.825 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-18T00:40:04.825 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:40:04.826 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T00:40:05.032 INFO:tasks.workunit.client.0.trial069.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/2182969385,v1:127.0.0.1:6801/2182969385] [v2:127.0.0.1:6802/2182969385,v1:127.0.0.1:6803/2182969385] exists,up aab3373c-e767-477f-87a6-72b1fba5213b 2026-02-18T00:40:05.033 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:40:05.034 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:40:05.034 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:40:05.034 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:272: test_kill_daemon: name_prefix=osd 2026-02-18T00:40:05.034 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:273: test_kill_daemon: find td/ceph-helpers 2026-02-18T00:40:05.034 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:273: test_kill_daemon: grep 'osd[^/]*\.pid' 2026-02-18T00:40:05.035 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:273: test_kill_daemon: for pidfile in $(find $dir 2>/dev/null | grep $name_prefix'[^/]*\.pid') 2026-02-18T00:40:05.036 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:280: test_kill_daemon: kill_daemon td/ceph-helpers/osd.0.pid 0 1 2026-02-18T00:40:05.036 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:246: kill_daemon: cat td/ceph-helpers/osd.0.pid 2026-02-18T00:40:05.037 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:246: kill_daemon: local pid=98595 2026-02-18T00:40:05.038 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:247: kill_daemon: local send_signal=0 2026-02-18T00:40:05.038 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:248: kill_daemon: local delays=1 2026-02-18T00:40:05.038 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:249: kill_daemon: local exit_code=1 2026-02-18T00:40:05.038 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:252: kill_daemon: for try in $delays 0 2026-02-18T00:40:05.038 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:253: kill_daemon: kill -0 98595 2026-02-18T00:40:05.038 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:254: kill_daemon: exit_code=1 2026-02-18T00:40:05.038 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:259: kill_daemon: send_signal=0 2026-02-18T00:40:05.038 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:260: kill_daemon: sleep 1 2026-02-18T00:40:06.039 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:252: kill_daemon: for try in $delays 0 2026-02-18T00:40:06.039 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:253: kill_daemon: kill -0 98595 2026-02-18T00:40:06.040 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:254: kill_daemon: exit_code=1 2026-02-18T00:40:06.040 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:259: kill_daemon: send_signal=0 2026-02-18T00:40:06.040 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:260: kill_daemon: sleep 0 2026-02-18T00:40:06.041 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:262: kill_daemon: return 1 2026-02-18T00:40:06.041 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:284: test_kill_daemon: kill_daemon td/ceph-helpers/osd.0.pid TERM 2026-02-18T00:40:06.041 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:246: kill_daemon: cat td/ceph-helpers/osd.0.pid 2026-02-18T00:40:06.042 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:246: kill_daemon: local pid=98595 2026-02-18T00:40:06.042 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:247: kill_daemon: local send_signal=TERM 2026-02-18T00:40:06.042 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:248: kill_daemon: local 'delays=0.1 0.2 1 1 1 2 3 5 5 5 10 10 20 60 60 60 120' 2026-02-18T00:40:06.043 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:249: kill_daemon: local exit_code=1 2026-02-18T00:40:06.043 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:252: kill_daemon: for try in $delays 0 2026-02-18T00:40:06.043 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:253: kill_daemon: kill -TERM 98595 2026-02-18T00:40:06.043 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:254: kill_daemon: exit_code=1 2026-02-18T00:40:06.043 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:259: kill_daemon: send_signal=0 2026-02-18T00:40:06.043 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:260: kill_daemon: sleep 0.1 2026-02-18T00:40:06.144 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:252: kill_daemon: for try in $delays 0 2026-02-18T00:40:06.144 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:253: kill_daemon: kill -0 98595 2026-02-18T00:40:06.144 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:254: kill_daemon: exit_code=1 2026-02-18T00:40:06.144 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:259: kill_daemon: send_signal=0 2026-02-18T00:40:06.144 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:260: kill_daemon: sleep 0.2 2026-02-18T00:40:06.344 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:252: kill_daemon: for try in $delays 0 2026-02-18T00:40:06.344 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:253: kill_daemon: kill -0 98595 2026-02-18T00:40:06.344 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:256: kill_daemon: exit_code=0 2026-02-18T00:40:06.344 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:257: kill_daemon: break 2026-02-18T00:40:06.344 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:262: kill_daemon: return 0 2026-02-18T00:40:06.344 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:287: test_kill_daemon: name_prefix=mgr 2026-02-18T00:40:06.345 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:288: test_kill_daemon: find td/ceph-helpers 2026-02-18T00:40:06.345 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:288: test_kill_daemon: grep 'mgr[^/]*\.pid' 2026-02-18T00:40:06.347 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:288: test_kill_daemon: for pidfile in $(find $dir 2>/dev/null | grep $name_prefix'[^/]*\.pid') 2026-02-18T00:40:06.347 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:292: test_kill_daemon: kill_daemon td/ceph-helpers/mgr.x.pid TERM 2026-02-18T00:40:06.348 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:246: kill_daemon: cat td/ceph-helpers/mgr.x.pid 2026-02-18T00:40:06.349 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:246: kill_daemon: local pid=97739 2026-02-18T00:40:06.349 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:247: kill_daemon: local send_signal=TERM 2026-02-18T00:40:06.349 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:248: kill_daemon: local 'delays=0.1 0.2 1 1 1 2 3 5 5 5 10 10 20 60 60 60 120' 2026-02-18T00:40:06.349 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:249: kill_daemon: local exit_code=1 2026-02-18T00:40:06.349 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:252: kill_daemon: for try in $delays 0 2026-02-18T00:40:06.350 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:253: kill_daemon: kill -TERM 97739 2026-02-18T00:40:06.350 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:254: kill_daemon: exit_code=1 2026-02-18T00:40:06.350 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:259: kill_daemon: send_signal=0 2026-02-18T00:40:06.350 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:260: kill_daemon: sleep 0.1 2026-02-18T00:40:06.452 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:252: kill_daemon: for try in $delays 0 2026-02-18T00:40:06.452 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:253: kill_daemon: kill -0 97739 2026-02-18T00:40:06.453 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:256: kill_daemon: exit_code=0 2026-02-18T00:40:06.453 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:257: kill_daemon: break 2026-02-18T00:40:06.453 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:262: kill_daemon: return 0 2026-02-18T00:40:06.453 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:295: test_kill_daemon: name_prefix=mon 2026-02-18T00:40:06.453 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:296: test_kill_daemon: find td/ceph-helpers 2026-02-18T00:40:06.453 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:296: test_kill_daemon: grep 'mon[^/]*\.pid' 2026-02-18T00:40:06.454 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:296: test_kill_daemon: for pidfile in $(find $dir 2>/dev/null | grep $name_prefix'[^/]*\.pid') 2026-02-18T00:40:06.454 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:300: test_kill_daemon: kill_daemon td/ceph-helpers/mon.a.pid TERM 2026-02-18T00:40:06.455 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:246: kill_daemon: cat td/ceph-helpers/mon.a.pid 2026-02-18T00:40:06.456 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:246: kill_daemon: local pid=97654 2026-02-18T00:40:06.456 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:247: kill_daemon: local send_signal=TERM 2026-02-18T00:40:06.456 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:248: kill_daemon: local 'delays=0.1 0.2 1 1 1 2 3 5 5 5 10 10 20 60 60 60 120' 2026-02-18T00:40:06.456 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:249: kill_daemon: local exit_code=1 2026-02-18T00:40:06.456 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:252: kill_daemon: for try in $delays 0 2026-02-18T00:40:06.456 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:253: kill_daemon: kill -TERM 97654 2026-02-18T00:40:06.457 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:254: kill_daemon: exit_code=1 2026-02-18T00:40:06.457 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:259: kill_daemon: send_signal=0 2026-02-18T00:40:06.457 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:260: kill_daemon: sleep 0.1 2026-02-18T00:40:06.557 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:252: kill_daemon: for try in $delays 0 2026-02-18T00:40:06.557 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:253: kill_daemon: kill -0 97654 2026-02-18T00:40:06.557 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:254: kill_daemon: exit_code=1 2026-02-18T00:40:06.557 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:259: kill_daemon: send_signal=0 2026-02-18T00:40:06.557 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:260: kill_daemon: sleep 0.2 2026-02-18T00:40:06.758 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:252: kill_daemon: for try in $delays 0 2026-02-18T00:40:06.758 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:253: kill_daemon: kill -0 97654 2026-02-18T00:40:06.758 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:256: kill_daemon: exit_code=0 2026-02-18T00:40:06.758 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:257: kill_daemon: break 2026-02-18T00:40:06.758 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:262: kill_daemon: return 0 2026-02-18T00:40:06.758 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:301: test_kill_daemon: timeout 5 ceph status 2026-02-18T00:40:11.764 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:304: test_kill_daemon: teardown td/ceph-helpers 2026-02-18T00:40:11.764 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/ceph-helpers 2026-02-18T00:40:11.765 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T00:40:11.765 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/ceph-helpers KILL 2026-02-18T00:40:11.765 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:40:11.765 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:40:11.765 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:40:11.765 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:40:11.765 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:40:11.770 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:40:11.770 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T00:40:11.771 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T00:40:11.772 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T00:40:11.773 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T00:40:11.773 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T00:40:11.773 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T00:40:11.774 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:40:11.774 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T00:40:11.775 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T00:40:11.775 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:40:11.776 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T00:40:11.777 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T00:40:11.777 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/ceph-helpers 2026-02-18T00:40:11.780 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T00:40:11.780 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:40:11.780 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:40:11.780 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.57427 2026-02-18T00:40:11.783 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T00:40:11.783 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T00:40:11.783 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2426: run_tests: for func in $funcs 2026-02-18T00:40:11.783 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2427: run_tests: test_kill_daemons td/ceph-helpers 2026-02-18T00:40:11.783 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:357: test_kill_daemons: local dir=td/ceph-helpers 2026-02-18T00:40:11.783 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:358: test_kill_daemons: setup td/ceph-helpers 2026-02-18T00:40:11.783 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/ceph-helpers 2026-02-18T00:40:11.783 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/ceph-helpers 2026-02-18T00:40:11.783 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/ceph-helpers 2026-02-18T00:40:11.784 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T00:40:11.784 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/ceph-helpers KILL 2026-02-18T00:40:11.784 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:40:11.784 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:40:11.784 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:40:11.784 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:40:11.784 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:40:11.785 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:40:11.785 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T00:40:11.786 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T00:40:11.786 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T00:40:11.787 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T00:40:11.787 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T00:40:11.788 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T00:40:11.789 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:40:11.789 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T00:40:11.789 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T00:40:11.790 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:40:11.791 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T00:40:11.792 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T00:40:11.792 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/ceph-helpers 2026-02-18T00:40:11.793 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T00:40:11.793 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:40:11.793 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:40:11.793 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.57427 2026-02-18T00:40:11.794 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T00:40:11.794 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T00:40:11.794 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/ceph-helpers 2026-02-18T00:40:11.796 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-18T00:40:11.796 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:40:11.796 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:40:11.796 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.57427 2026-02-18T00:40:11.797 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-18T00:40:11.799 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-18T00:40:11.799 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-18T00:40:11.799 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/ceph-helpers 1' TERM HUP INT 2026-02-18T00:40:11.799 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:359: test_kill_daemons: run_mon td/ceph-helpers a --osd_pool_default_size=1 --mon_allow_pool_size_one=true 2026-02-18T00:40:11.799 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/ceph-helpers 2026-02-18T00:40:11.799 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-18T00:40:11.799 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-18T00:40:11.799 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-18T00:40:11.799 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/ceph-helpers/a 2026-02-18T00:40:11.799 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/ceph-helpers/a --run-dir=td/ceph-helpers --osd_pool_default_size=1 --mon_allow_pool_size_one=true 2026-02-18T00:40:11.820 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-18T00:40:11.820 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:40:11.820 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:40:11.820 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:40:11.820 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:40:11.821 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:40:11.821 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.57427/$cluster-$name.asok' 2026-02-18T00:40:11.821 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/ceph-helpers/a '--log-file=td/ceph-helpers/$name.log' '--admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' --mon-cluster-log-file=td/ceph-helpers/log --run-dir=td/ceph-helpers '--pid-file=td/ceph-helpers/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --osd_pool_default_size=1 --mon_allow_pool_size_one=true 2026-02-18T00:40:11.847 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-18T00:40:11.848 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-18T00:40:11.849 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T00:40:11.849 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-18T00:40:11.849 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-18T00:40:11.849 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-18T00:40:11.850 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-18T00:40:11.850 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:40:11.850 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:40:11.851 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:40:11.851 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:40:11.851 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:40:11.851 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.57427/ceph-mon.a.asok 2026-02-18T00:40:11.851 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T00:40:11.851 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.57427/ceph-mon.a.asok config get fsid 2026-02-18T00:40:11.906 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-18T00:40:11.906 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T00:40:11.906 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-18T00:40:11.906 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-18T00:40:11.906 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-18T00:40:11.907 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-18T00:40:11.908 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:40:11.908 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:40:11.908 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:40:11.908 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:40:11.908 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:40:11.908 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.57427/ceph-mon.a.asok 2026-02-18T00:40:11.908 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T00:40:11.908 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.57427/ceph-mon.a.asok config get mon_host 2026-02-18T00:40:11.963 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:360: test_kill_daemons: run_mgr td/ceph-helpers x 2026-02-18T00:40:11.963 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/ceph-helpers 2026-02-18T00:40:11.963 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-18T00:40:11.963 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-18T00:40:11.963 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-18T00:40:11.963 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/ceph-helpers/x 2026-02-18T00:40:11.963 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-18T00:40:12.076 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-18T00:40:12.076 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:40:12.076 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:40:12.076 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:40:12.076 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:40:12.076 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:40:12.076 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.57427/$cluster-$name.asok' 2026-02-18T00:40:12.077 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-18T00:40:12.078 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/ceph-helpers/x '--log-file=td/ceph-helpers/$name.log' '--admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' --run-dir=td/ceph-helpers '--pid-file=td/ceph-helpers/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-18T00:40:12.098 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:361: test_kill_daemons: run_osd td/ceph-helpers 0 2026-02-18T00:40:12.099 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/ceph-helpers 2026-02-18T00:40:12.099 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T00:40:12.099 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-18T00:40:12.099 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T00:40:12.099 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/ceph-helpers/0 2026-02-18T00:40:12.099 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--cluster ceph --fsid=863c4e35-ceb0-4172-b7b2-c3ff099e05a2 --auth-supported=none --mon-host=127.0.0.1:7109 ' 2026-02-18T00:40:12.099 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T00:40:12.099 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T00:40:12.099 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T00:40:12.099 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/ceph-helpers/0' 2026-02-18T00:40:12.100 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/ceph-helpers/0/journal' 2026-02-18T00:40:12.100 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T00:40:12.100 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-18T00:40:12.100 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/ceph-helpers' 2026-02-18T00:40:12.100 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T00:40:12.100 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:40:12.100 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:40:12.100 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:40:12.100 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:40:12.100 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:40:12.101 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.57427/$cluster-$name.asok' 2026-02-18T00:40:12.101 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' 2026-02-18T00:40:12.101 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T00:40:12.101 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T00:40:12.101 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T00:40:12.101 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/ceph-helpers/$name.log' 2026-02-18T00:40:12.101 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/ceph-helpers/$name.pid' 2026-02-18T00:40:12.101 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T00:40:12.101 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T00:40:12.101 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T00:40:12.101 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T00:40:12.102 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T00:40:12.102 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-18T00:40:12.102 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/ceph-helpers/0 2026-02-18T00:40:12.102 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T00:40:12.102 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=24586afa-8f09-4dc1-af58-7a713257eb59 2026-02-18T00:40:12.103 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 24586afa-8f09-4dc1-af58-7a713257eb59' 2026-02-18T00:40:12.103 INFO:tasks.workunit.client.0.trial069.stdout:add osd0 24586afa-8f09-4dc1-af58-7a713257eb59 2026-02-18T00:40:12.103 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T00:40:12.111 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQBsCpVptTUMBhAApZtuCHp9ZvItkjMuMdfgew== 2026-02-18T00:40:12.111 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQBsCpVptTUMBhAApZtuCHp9ZvItkjMuMdfgew=="}' 2026-02-18T00:40:12.111 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 24586afa-8f09-4dc1-af58-7a713257eb59 -i td/ceph-helpers/0/new.json 2026-02-18T00:40:12.220 INFO:tasks.workunit.client.0.trial069.stdout:0 2026-02-18T00:40:12.227 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/ceph-helpers/0/new.json 2026-02-18T00:40:12.228 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --cluster ceph --fsid=863c4e35-ceb0-4172-b7b2-c3ff099e05a2 --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/0 --osd-journal=td/ceph-helpers/0/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQBsCpVptTUMBhAApZtuCHp9ZvItkjMuMdfgew== --osd-uuid 24586afa-8f09-4dc1-af58-7a713257eb59 2026-02-18T00:40:12.245 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:40:12.234+0000 7fd2d5daea40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:40:12.246 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:40:12.234+0000 7fd2d5daea40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:40:12.247 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:40:12.234+0000 7fd2d5daea40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:40:12.248 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:40:12.234+0000 7fd2d5daea40 -1 bdev(0x55c1ec36ec00 td/ceph-helpers/0/block) open stat got: (1) Operation not permitted 2026-02-18T00:40:12.248 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:40:12.234+0000 7fd2d5daea40 -1 bluestore(td/ceph-helpers/0) _read_fsid unparsable uuid 2026-02-18T00:40:13.008 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/ceph-helpers/0/keyring 2026-02-18T00:40:13.008 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T00:40:13.009 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-18T00:40:13.009 INFO:tasks.workunit.client.0.trial069.stdout:adding osd0 key to auth repository 2026-02-18T00:40:13.009 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/ceph-helpers/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T00:40:13.125 INFO:tasks.workunit.client.0.trial069.stdout:start osd.0 2026-02-18T00:40:13.126 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-18T00:40:13.126 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --cluster ceph --fsid=863c4e35-ceb0-4172-b7b2-c3ff099e05a2 --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/0 --osd-journal=td/ceph-helpers/0/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T00:40:13.126 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T00:40:13.126 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T00:40:13.126 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T00:40:13.140 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:40:13.126+0000 7efca3d99a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:40:13.141 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:40:13.130+0000 7efca3d99a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:40:13.142 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:40:13.130+0000 7efca3d99a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:40:13.249 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-18T00:40:13.250 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:40:13.250 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-18T00:40:13.250 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:40:13.250 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:40:13.250 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:40:13.250 INFO:tasks.workunit.client.0.trial069.stdout:0 2026-02-18T00:40:13.251 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:40:13.251 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:40:13.251 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T00:40:13.359 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:40:13.622 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:40:13.610+0000 7efca3d99a40 -1 Falling back to public interface 2026-02-18T00:40:14.360 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:40:14.360 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:40:14.361 INFO:tasks.workunit.client.0.trial069.stdout:1 2026-02-18T00:40:14.361 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T00:40:14.362 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:40:14.362 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T00:40:14.572 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:40:14.586 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:40:14.574+0000 7efca3d99a40 -1 osd.0 0 log_to_monitors true 2026-02-18T00:40:15.573 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:40:15.574 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:40:15.574 INFO:tasks.workunit.client.0.trial069.stdout:2 2026-02-18T00:40:15.575 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-18T00:40:15.575 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:40:15.575 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T00:40:15.791 INFO:tasks.workunit.client.0.trial069.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/432891819,v1:127.0.0.1:6801/432891819] [v2:127.0.0.1:6802/432891819,v1:127.0.0.1:6803/432891819] exists,up 24586afa-8f09-4dc1-af58-7a713257eb59 2026-02-18T00:40:15.792 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:40:15.793 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:40:15.793 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:40:15.793 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:368: test_kill_daemons: kill_daemons td/ceph-helpers 0 osd 1 2026-02-18T00:40:15.793 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:40:15.793 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:40:15.793 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:40:15.793 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:40:15.793 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:40:16.800 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 1 2026-02-18T00:40:16.801 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:372: test_kill_daemons: kill_daemons td/ceph-helpers TERM osd 2026-02-18T00:40:16.802 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:40:16.802 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:40:16.802 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:40:16.802 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:40:16.802 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:40:17.111 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:40:17.111 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:376: test_kill_daemons: kill_daemons td/ceph-helpers TERM mgr 2026-02-18T00:40:17.111 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:40:17.111 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:40:17.111 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:40:17.112 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:40:17.112 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:40:17.218 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:40:17.218 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:380: test_kill_daemons: kill_daemons td/ceph-helpers TERM 2026-02-18T00:40:17.218 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:40:17.219 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:40:17.219 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:40:17.219 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:40:17.219 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:40:17.527 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:40:17.527 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:381: test_kill_daemons: timeout 5 ceph status 2026-02-18T00:40:22.533 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:382: test_kill_daemons: teardown td/ceph-helpers 2026-02-18T00:40:22.533 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/ceph-helpers 2026-02-18T00:40:22.533 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T00:40:22.533 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/ceph-helpers KILL 2026-02-18T00:40:22.533 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:40:22.533 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:40:22.534 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:40:22.534 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:40:22.534 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:40:22.539 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:40:22.539 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T00:40:22.540 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T00:40:22.541 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T00:40:22.542 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T00:40:22.542 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T00:40:22.542 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T00:40:22.543 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:40:22.543 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T00:40:22.544 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T00:40:22.544 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:40:22.545 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T00:40:22.546 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T00:40:22.546 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/ceph-helpers 2026-02-18T00:40:22.549 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T00:40:22.549 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:40:22.549 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:40:22.550 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.57427 2026-02-18T00:40:22.552 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T00:40:22.552 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T00:40:22.552 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2426: run_tests: for func in $funcs 2026-02-18T00:40:22.552 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2427: run_tests: test_objectstore_tool td/ceph-helpers 2026-02-18T00:40:22.552 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1298: test_objectstore_tool: local dir=td/ceph-helpers 2026-02-18T00:40:22.552 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1300: test_objectstore_tool: setup td/ceph-helpers 2026-02-18T00:40:22.552 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/ceph-helpers 2026-02-18T00:40:22.553 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/ceph-helpers 2026-02-18T00:40:22.553 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/ceph-helpers 2026-02-18T00:40:22.553 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T00:40:22.553 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/ceph-helpers KILL 2026-02-18T00:40:22.553 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:40:22.553 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:40:22.553 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:40:22.553 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:40:22.553 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:40:22.554 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:40:22.554 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T00:40:22.555 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T00:40:22.555 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T00:40:22.556 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T00:40:22.557 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T00:40:22.557 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T00:40:22.558 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:40:22.558 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T00:40:22.559 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T00:40:22.559 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:40:22.560 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T00:40:22.561 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T00:40:22.561 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/ceph-helpers 2026-02-18T00:40:22.562 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T00:40:22.562 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:40:22.562 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:40:22.563 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.57427 2026-02-18T00:40:22.563 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T00:40:22.564 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T00:40:22.564 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/ceph-helpers 2026-02-18T00:40:22.565 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-18T00:40:22.565 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:40:22.565 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:40:22.565 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.57427 2026-02-18T00:40:22.567 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-18T00:40:22.568 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-18T00:40:22.568 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-18T00:40:22.568 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/ceph-helpers 1' TERM HUP INT 2026-02-18T00:40:22.568 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1301: test_objectstore_tool: run_mon td/ceph-helpers a --osd_pool_default_size=1 --mon_allow_pool_size_one=true 2026-02-18T00:40:22.568 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/ceph-helpers 2026-02-18T00:40:22.569 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-18T00:40:22.569 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-18T00:40:22.569 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-18T00:40:22.569 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/ceph-helpers/a 2026-02-18T00:40:22.569 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/ceph-helpers/a --run-dir=td/ceph-helpers --osd_pool_default_size=1 --mon_allow_pool_size_one=true 2026-02-18T00:40:22.590 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-18T00:40:22.590 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:40:22.590 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:40:22.590 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:40:22.590 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:40:22.591 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:40:22.591 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.57427/$cluster-$name.asok' 2026-02-18T00:40:22.591 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/ceph-helpers/a '--log-file=td/ceph-helpers/$name.log' '--admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' --mon-cluster-log-file=td/ceph-helpers/log --run-dir=td/ceph-helpers '--pid-file=td/ceph-helpers/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --osd_pool_default_size=1 --mon_allow_pool_size_one=true 2026-02-18T00:40:22.619 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-18T00:40:22.620 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-18T00:40:22.621 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T00:40:22.621 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-18T00:40:22.621 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-18T00:40:22.622 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-18T00:40:22.622 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-18T00:40:22.622 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:40:22.622 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:40:22.622 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:40:22.622 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:40:22.623 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:40:22.623 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.57427/ceph-mon.a.asok 2026-02-18T00:40:22.623 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T00:40:22.623 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.57427/ceph-mon.a.asok config get fsid 2026-02-18T00:40:22.678 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-18T00:40:22.679 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T00:40:22.679 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-18T00:40:22.679 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-18T00:40:22.679 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-18T00:40:22.680 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-18T00:40:22.680 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:40:22.680 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:40:22.680 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:40:22.680 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:40:22.680 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:40:22.681 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.57427/ceph-mon.a.asok 2026-02-18T00:40:22.681 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T00:40:22.681 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.57427/ceph-mon.a.asok config get mon_host 2026-02-18T00:40:22.735 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: test_objectstore_tool: local osd=0 2026-02-18T00:40:22.736 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: test_objectstore_tool: run_mgr td/ceph-helpers x 2026-02-18T00:40:22.736 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/ceph-helpers 2026-02-18T00:40:22.736 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-18T00:40:22.736 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-18T00:40:22.736 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-18T00:40:22.736 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/ceph-helpers/x 2026-02-18T00:40:22.736 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-18T00:40:22.849 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-18T00:40:22.850 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:40:22.850 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:40:22.850 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:40:22.850 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:40:22.850 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:40:22.850 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.57427/$cluster-$name.asok' 2026-02-18T00:40:22.850 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-18T00:40:22.851 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/ceph-helpers/x '--log-file=td/ceph-helpers/$name.log' '--admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' --run-dir=td/ceph-helpers '--pid-file=td/ceph-helpers/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-18T00:40:22.871 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: test_objectstore_tool: run_osd td/ceph-helpers 0 2026-02-18T00:40:22.871 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/ceph-helpers 2026-02-18T00:40:22.871 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T00:40:22.872 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-18T00:40:22.872 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T00:40:22.872 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/ceph-helpers/0 2026-02-18T00:40:22.872 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--cluster ceph --fsid=863c4e35-ceb0-4172-b7b2-c3ff099e05a2 --auth-supported=none --mon-host=127.0.0.1:7109 ' 2026-02-18T00:40:22.872 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T00:40:22.872 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T00:40:22.872 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T00:40:22.872 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/ceph-helpers/0' 2026-02-18T00:40:22.872 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/ceph-helpers/0/journal' 2026-02-18T00:40:22.872 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T00:40:22.872 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-18T00:40:22.872 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/ceph-helpers' 2026-02-18T00:40:22.873 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T00:40:22.873 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:40:22.873 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:40:22.873 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:40:22.873 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:40:22.873 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:40:22.873 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.57427/$cluster-$name.asok' 2026-02-18T00:40:22.873 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' 2026-02-18T00:40:22.873 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T00:40:22.873 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T00:40:22.873 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T00:40:22.873 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/ceph-helpers/$name.log' 2026-02-18T00:40:22.873 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/ceph-helpers/$name.pid' 2026-02-18T00:40:22.874 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T00:40:22.874 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T00:40:22.874 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T00:40:22.874 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T00:40:22.874 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T00:40:22.874 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-18T00:40:22.874 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/ceph-helpers/0 2026-02-18T00:40:22.875 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T00:40:22.875 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=db9e3c65-51d3-488e-9d11-2154aaad5bf0 2026-02-18T00:40:22.875 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 db9e3c65-51d3-488e-9d11-2154aaad5bf0' 2026-02-18T00:40:22.875 INFO:tasks.workunit.client.0.trial069.stdout:add osd0 db9e3c65-51d3-488e-9d11-2154aaad5bf0 2026-02-18T00:40:22.876 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T00:40:22.885 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQB2CpVp4FIvNBAAzkavJsaHKhGrTszjXS3Ltw== 2026-02-18T00:40:22.885 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQB2CpVp4FIvNBAAzkavJsaHKhGrTszjXS3Ltw=="}' 2026-02-18T00:40:22.885 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new db9e3c65-51d3-488e-9d11-2154aaad5bf0 -i td/ceph-helpers/0/new.json 2026-02-18T00:40:22.995 INFO:tasks.workunit.client.0.trial069.stdout:0 2026-02-18T00:40:23.003 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/ceph-helpers/0/new.json 2026-02-18T00:40:23.004 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --cluster ceph --fsid=863c4e35-ceb0-4172-b7b2-c3ff099e05a2 --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/0 --osd-journal=td/ceph-helpers/0/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQB2CpVp4FIvNBAAzkavJsaHKhGrTszjXS3Ltw== --osd-uuid db9e3c65-51d3-488e-9d11-2154aaad5bf0 2026-02-18T00:40:23.020 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:40:23.009+0000 7fa0d3e8ba40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:40:23.022 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:40:23.009+0000 7fa0d3e8ba40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:40:23.022 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:40:23.009+0000 7fa0d3e8ba40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:40:23.023 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:40:23.009+0000 7fa0d3e8ba40 -1 bdev(0x5607a53fec00 td/ceph-helpers/0/block) open stat got: (1) Operation not permitted 2026-02-18T00:40:23.023 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:40:23.009+0000 7fa0d3e8ba40 -1 bluestore(td/ceph-helpers/0) _read_fsid unparsable uuid 2026-02-18T00:40:23.852 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/ceph-helpers/0/keyring 2026-02-18T00:40:23.852 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T00:40:23.853 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-18T00:40:23.854 INFO:tasks.workunit.client.0.trial069.stdout:adding osd0 key to auth repository 2026-02-18T00:40:23.854 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/ceph-helpers/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T00:40:23.971 INFO:tasks.workunit.client.0.trial069.stdout:start osd.0 2026-02-18T00:40:23.971 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-18T00:40:23.971 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --cluster ceph --fsid=863c4e35-ceb0-4172-b7b2-c3ff099e05a2 --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/0 --osd-journal=td/ceph-helpers/0/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T00:40:23.971 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T00:40:23.971 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T00:40:23.972 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T00:40:23.996 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:40:23.981+0000 7fade45eea40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:40:23.998 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:40:23.985+0000 7fade45eea40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:40:23.999 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:40:23.985+0000 7fade45eea40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:40:24.082 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-18T00:40:24.083 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:40:24.083 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-18T00:40:24.083 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:40:24.083 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:40:24.083 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:40:24.083 INFO:tasks.workunit.client.0.trial069.stdout:0 2026-02-18T00:40:24.084 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:40:24.084 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:40:24.084 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T00:40:24.191 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:40:24.366 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:40:24.353+0000 7fade45eea40 -1 Falling back to public interface 2026-02-18T00:40:25.193 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:40:25.193 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:40:25.193 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T00:40:25.193 INFO:tasks.workunit.client.0.trial069.stdout:1 2026-02-18T00:40:25.193 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:40:25.193 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T00:40:25.365 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:40:25.353+0000 7fade45eea40 -1 osd.0 0 log_to_monitors true 2026-02-18T00:40:25.416 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:40:26.418 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:40:26.418 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:40:26.418 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-18T00:40:26.419 INFO:tasks.workunit.client.0.trial069.stdout:2 2026-02-18T00:40:26.419 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:40:26.420 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T00:40:26.631 INFO:tasks.workunit.client.0.trial069.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/1044454770,v1:127.0.0.1:6801/1044454770] [v2:127.0.0.1:6802/1044454770,v1:127.0.0.1:6803/1044454770] exists,up db9e3c65-51d3-488e-9d11-2154aaad5bf0 2026-02-18T00:40:26.631 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:40:26.632 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:40:26.632 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:40:26.632 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: test_objectstore_tool: create_rbd_pool 2026-02-18T00:40:26.632 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:526: create_rbd_pool: ceph osd pool delete rbd rbd --yes-i-really-really-mean-it 2026-02-18T00:40:26.841 INFO:tasks.workunit.client.0.trial069.stderr:pool 'rbd' does not exist 2026-02-18T00:40:26.851 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:527: create_rbd_pool: create_pool rbd 4 2026-02-18T00:40:26.851 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create rbd 4 2026-02-18T00:40:27.131 INFO:tasks.workunit.client.0.trial069.stderr:pool 'rbd' already exists 2026-02-18T00:40:27.141 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-18T00:40:28.142 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:528: create_rbd_pool: rbd pool init rbd 2026-02-18T00:40:28.421 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: test_objectstore_tool: wait_for_clean 2026-02-18T00:40:28.421 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-18T00:40:28.421 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-18T00:40:28.421 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-18T00:40:28.421 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-18T00:40:28.422 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-18T00:40:28.422 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-18T00:40:28.422 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-18T00:40:28.422 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-18T00:40:28.422 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-18T00:40:28.525 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-18T00:40:28.525 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-18T00:40:28.526 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-18T00:40:28.526 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-18T00:40:28.526 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-18T00:40:28.526 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-18T00:40:28.733 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids=0 2026-02-18T00:40:28.734 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-18T00:40:28.734 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:40:28.734 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-18T00:40:28.813 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836483 2026-02-18T00:40:28.813 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836483 2026-02-18T00:40:28.814 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836483' 2026-02-18T00:40:28.814 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:40:28.814 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836483 2026-02-18T00:40:28.814 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:40:28.815 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-18T00:40:28.816 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-21474836483 2026-02-18T00:40:28.816 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:40:28.817 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=21474836483 2026-02-18T00:40:28.817 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 21474836483' 2026-02-18T00:40:28.818 INFO:tasks.workunit.client.0.trial069.stdout:waiting osd.0 seq 21474836483 2026-02-18T00:40:28.818 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T00:40:29.025 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 21474836481 -lt 21474836483 2026-02-18T00:40:29.025 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-18T00:40:30.025 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-18T00:40:30.026 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T00:40:30.239 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 21474836483 -lt 21474836483 2026-02-18T00:40:30.240 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-18T00:40:30.241 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T00:40:30.241 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T00:40:30.524 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 4 == 0 2026-02-18T00:40:30.525 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-18T00:40:30.525 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-18T00:40:30.525 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-18T00:40:30.525 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-18T00:40:30.525 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-18T00:40:30.525 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-18T00:40:30.525 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-18T00:40:30.732 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=4 2026-02-18T00:40:30.732 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-18T00:40:30.732 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T00:40:30.732 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T00:40:31.010 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 4 = 4 2026-02-18T00:40:31.010 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-18T00:40:31.010 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-18T00:40:31.010 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1307: test_objectstore_tool: rados --pool rbd put GROUP /etc/group 2026-02-18T00:40:31.032 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1308: test_objectstore_tool: objectstore_tool td/ceph-helpers 0 GROUP get-bytes 2026-02-18T00:40:31.032 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/ceph-helpers 2026-02-18T00:40:31.032 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-18T00:40:31.032 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=0 2026-02-18T00:40:31.032 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-18T00:40:31.032 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/ceph-helpers 0 GROUP get-bytes 2026-02-18T00:40:31.032 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/ceph-helpers 2026-02-18T00:40:31.033 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-18T00:40:31.033 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=0 2026-02-18T00:40:31.033 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-18T00:40:31.033 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/ceph-helpers TERM osd.0 2026-02-18T00:40:31.033 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1309: test_objectstore_tool: diff - /etc/group 2026-02-18T00:40:31.033 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:40:31.033 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:40:31.033 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:40:31.033 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:40:31.033 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:40:31.339 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:40:31.340 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/ceph-helpers 0 GROUP get-bytes 2026-02-18T00:40:31.340 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/ceph-helpers 2026-02-18T00:40:31.340 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-18T00:40:31.340 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=0 2026-02-18T00:40:31.340 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-18T00:40:31.340 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/ceph-helpers/0 2026-02-18T00:40:31.340 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/ceph-helpers/0 GROUP get-bytes 2026-02-18T00:40:31.503 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/ceph-helpers 0 2026-02-18T00:40:31.503 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/ceph-helpers 2026-02-18T00:40:31.503 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-18T00:40:31.503 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-18T00:40:31.503 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-18T00:40:31.503 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/ceph-helpers/0 2026-02-18T00:40:31.503 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--cluster ceph --fsid=863c4e35-ceb0-4172-b7b2-c3ff099e05a2 --auth-supported=none --mon-host=127.0.0.1:7109 ' 2026-02-18T00:40:31.503 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T00:40:31.504 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T00:40:31.504 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T00:40:31.504 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/ceph-helpers/0' 2026-02-18T00:40:31.504 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/ceph-helpers/0/journal' 2026-02-18T00:40:31.504 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-18T00:40:31.504 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-18T00:40:31.504 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/ceph-helpers' 2026-02-18T00:40:31.504 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-18T00:40:31.504 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:40:31.504 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:40:31.504 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:40:31.504 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:40:31.504 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:40:31.505 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.57427/$cluster-$name.asok' 2026-02-18T00:40:31.507 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' 2026-02-18T00:40:31.507 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-18T00:40:31.507 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/ceph-helpers/$name.log' 2026-02-18T00:40:31.507 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/ceph-helpers/$name.pid' 2026-02-18T00:40:31.507 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T00:40:31.507 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T00:40:31.507 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T00:40:31.507 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T00:40:31.507 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-18T00:40:31.507 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-18T00:40:31.507 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/ceph-helpers/0 2026-02-18T00:40:31.508 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-18T00:40:31.508 INFO:tasks.workunit.client.0.trial069.stderr:start osd.0 2026-02-18T00:40:31.508 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --cluster ceph --fsid=863c4e35-ceb0-4172-b7b2-c3ff099e05a2 --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/0 --osd-journal=td/ceph-helpers/0/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' --debug-osd=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T00:40:31.508 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/ceph-helpers/0/whoami 2026-02-18T00:40:31.508 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-18T00:40:31.508 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-18T00:40:31.508 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-18T00:40:31.508 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-18T00:40:31.520 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:40:31.505+0000 7fe6ab2c0a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:40:31.521 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:40:31.509+0000 7fe6ab2c0a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:40:31.522 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:40:31.509+0000 7fe6ab2c0a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:40:31.722 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-18T00:40:31.722 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:40:31.722 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-18T00:40:31.722 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:40:31.722 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:40:31.722 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:40:31.722 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:40:31.722 INFO:tasks.workunit.client.0.trial069.stderr:0 2026-02-18T00:40:31.723 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:40:31.723 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T00:40:31.934 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:40:31.934 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:40:31.921+0000 7fe6ab2c0a40 -1 Falling back to public interface 2026-02-18T00:40:32.622 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:40:32.609+0000 7fe6ab2c0a40 -1 osd.0 13 log_to_monitors true 2026-02-18T00:40:32.935 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:40:32.936 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:40:32.936 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T00:40:32.936 INFO:tasks.workunit.client.0.trial069.stderr:1 2026-02-18T00:40:32.936 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:40:32.936 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T00:40:33.144 INFO:tasks.workunit.client.0.trial069.stderr:osd.0 up in weight 1 up_from 17 up_thru 17 down_at 13 last_clean_interval [5,13) [v2:127.0.0.1:6800/1558413829,v1:127.0.0.1:6801/1558413829] [v2:127.0.0.1:6802/1558413829,v1:127.0.0.1:6803/1558413829] exists,up db9e3c65-51d3-488e-9d11-2154aaad5bf0 2026-02-18T00:40:33.145 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:40:33.145 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:40:33.145 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:40:33.145 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-18T00:40:33.145 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-18T00:40:33.145 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-18T00:40:33.145 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-18T00:40:33.145 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-18T00:40:33.146 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-18T00:40:33.146 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-18T00:40:33.146 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-18T00:40:33.146 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-18T00:40:33.146 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-18T00:40:33.238 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-18T00:40:33.239 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-18T00:40:33.239 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-18T00:40:33.239 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-18T00:40:33.239 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-18T00:40:33.239 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-18T00:40:33.453 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids=0 2026-02-18T00:40:33.453 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-18T00:40:33.454 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:40:33.454 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-18T00:40:33.529 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=73014444035 2026-02-18T00:40:33.529 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 73014444035 2026-02-18T00:40:33.529 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-73014444035' 2026-02-18T00:40:33.530 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:40:33.530 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-73014444035 2026-02-18T00:40:33.530 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:40:33.531 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-18T00:40:33.532 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-73014444035 2026-02-18T00:40:33.532 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:40:33.533 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=73014444035 2026-02-18T00:40:33.533 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 73014444035' 2026-02-18T00:40:33.533 INFO:tasks.workunit.client.0.trial069.stderr:waiting osd.0 seq 73014444035 2026-02-18T00:40:33.534 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T00:40:33.750 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 1 -lt 73014444035 2026-02-18T00:40:33.750 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-18T00:40:34.751 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-18T00:40:34.751 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T00:40:34.962 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 1 -lt 73014444035 2026-02-18T00:40:34.962 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-18T00:40:35.964 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-18T00:40:35.965 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T00:40:36.174 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 73014444035 -lt 73014444035 2026-02-18T00:40:36.175 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-18T00:40:36.175 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T00:40:36.175 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T00:40:36.458 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 4 == 0 2026-02-18T00:40:36.458 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-18T00:40:36.459 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-18T00:40:36.459 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-18T00:40:36.459 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-18T00:40:36.459 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-18T00:40:36.459 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-18T00:40:36.459 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-18T00:40:36.669 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=4 2026-02-18T00:40:36.669 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-18T00:40:36.670 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T00:40:36.670 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T00:40:36.954 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 4 = 4 2026-02-18T00:40:36.954 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-18T00:40:36.954 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-18T00:40:36.956 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1310: test_objectstore_tool: objectstore_tool td/ceph-helpers 0 NOTEXISTS get-bytes 2026-02-18T00:40:36.956 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/ceph-helpers 2026-02-18T00:40:36.956 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-18T00:40:36.956 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=0 2026-02-18T00:40:36.956 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-18T00:40:36.957 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/ceph-helpers 0 NOTEXISTS get-bytes 2026-02-18T00:40:36.957 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/ceph-helpers 2026-02-18T00:40:36.957 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-18T00:40:36.957 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=0 2026-02-18T00:40:36.957 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-18T00:40:36.957 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/ceph-helpers TERM osd.0 2026-02-18T00:40:36.957 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:40:36.957 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:40:36.957 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:40:36.957 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:40:36.957 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:40:37.264 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:40:37.264 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/ceph-helpers 0 NOTEXISTS get-bytes 2026-02-18T00:40:37.264 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/ceph-helpers 2026-02-18T00:40:37.264 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-18T00:40:37.264 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=0 2026-02-18T00:40:37.265 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-18T00:40:37.265 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/ceph-helpers/0 2026-02-18T00:40:37.265 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/ceph-helpers/0 NOTEXISTS get-bytes 2026-02-18T00:40:37.335 INFO:tasks.workunit.client.0.trial069.stderr:No object id 'NOTEXISTS' found or invalid JSON specified 2026-02-18T00:40:37.437 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1256: _objectstore_tool_nodown: return 1 2026-02-18T00:40:37.437 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: return 1 2026-02-18T00:40:37.437 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: return 1 2026-02-18T00:40:37.437 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1311: test_objectstore_tool: teardown td/ceph-helpers 2026-02-18T00:40:37.437 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/ceph-helpers 2026-02-18T00:40:37.437 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T00:40:37.437 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/ceph-helpers KILL 2026-02-18T00:40:37.437 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:40:37.438 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:40:37.438 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:40:37.438 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:40:37.438 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:40:37.546 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:40:37.546 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T00:40:37.547 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T00:40:37.547 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T00:40:37.549 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T00:40:37.549 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T00:40:37.549 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T00:40:37.550 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:40:37.550 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T00:40:37.551 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T00:40:37.551 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:40:37.552 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T00:40:37.553 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T00:40:37.553 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/ceph-helpers 2026-02-18T00:40:37.559 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T00:40:37.559 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:40:37.559 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:40:37.560 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.57427 2026-02-18T00:40:37.562 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T00:40:37.562 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T00:40:37.563 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2426: run_tests: for func in $funcs 2026-02-18T00:40:37.563 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2427: run_tests: test_pg_schedule_scrub td/ceph-helpers 2026-02-18T00:40:37.563 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1987: test_pg_schedule_scrub: local dir=td/ceph-helpers 2026-02-18T00:40:37.563 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1989: test_pg_schedule_scrub: setup td/ceph-helpers 2026-02-18T00:40:37.563 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/ceph-helpers 2026-02-18T00:40:37.563 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/ceph-helpers 2026-02-18T00:40:37.563 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/ceph-helpers 2026-02-18T00:40:37.563 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T00:40:37.563 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/ceph-helpers KILL 2026-02-18T00:40:37.563 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:40:37.563 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:40:37.564 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:40:37.564 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:40:37.564 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:40:37.565 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:40:37.565 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T00:40:37.565 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T00:40:37.565 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T00:40:37.567 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T00:40:37.567 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T00:40:37.567 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T00:40:37.568 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:40:37.568 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T00:40:37.569 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T00:40:37.569 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:40:37.570 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T00:40:37.571 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T00:40:37.571 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/ceph-helpers 2026-02-18T00:40:37.572 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T00:40:37.572 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:40:37.573 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:40:37.573 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.57427 2026-02-18T00:40:37.574 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T00:40:37.574 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T00:40:37.574 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/ceph-helpers 2026-02-18T00:40:37.575 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-18T00:40:37.575 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:40:37.575 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:40:37.575 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.57427 2026-02-18T00:40:37.577 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-18T00:40:37.578 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-18T00:40:37.578 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-18T00:40:37.578 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/ceph-helpers 1' TERM HUP INT 2026-02-18T00:40:37.578 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1990: test_pg_schedule_scrub: run_mon td/ceph-helpers a --osd_pool_default_size=1 --mon_allow_pool_size_one=true 2026-02-18T00:40:37.578 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/ceph-helpers 2026-02-18T00:40:37.578 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-18T00:40:37.578 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-18T00:40:37.578 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-18T00:40:37.578 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/ceph-helpers/a 2026-02-18T00:40:37.579 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/ceph-helpers/a --run-dir=td/ceph-helpers --osd_pool_default_size=1 --mon_allow_pool_size_one=true 2026-02-18T00:40:37.601 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-18T00:40:37.601 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:40:37.601 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:40:37.601 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:40:37.601 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:40:37.601 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:40:37.601 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.57427/$cluster-$name.asok' 2026-02-18T00:40:37.602 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/ceph-helpers/a '--log-file=td/ceph-helpers/$name.log' '--admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' --mon-cluster-log-file=td/ceph-helpers/log --run-dir=td/ceph-helpers '--pid-file=td/ceph-helpers/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --osd_pool_default_size=1 --mon_allow_pool_size_one=true 2026-02-18T00:40:37.630 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-18T00:40:37.631 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-18T00:40:37.631 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T00:40:37.631 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-18T00:40:37.631 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-18T00:40:37.631 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-18T00:40:37.632 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-18T00:40:37.633 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:40:37.633 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:40:37.633 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:40:37.633 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:40:37.633 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:40:37.633 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.57427/ceph-mon.a.asok 2026-02-18T00:40:37.633 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T00:40:37.633 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.57427/ceph-mon.a.asok config get fsid 2026-02-18T00:40:37.690 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-18T00:40:37.690 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T00:40:37.690 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-18T00:40:37.690 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-18T00:40:37.690 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-18T00:40:37.691 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-18T00:40:37.691 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:40:37.691 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:40:37.691 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:40:37.691 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:40:37.691 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:40:37.691 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.57427/ceph-mon.a.asok 2026-02-18T00:40:37.692 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T00:40:37.692 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.57427/ceph-mon.a.asok config get mon_host 2026-02-18T00:40:37.746 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1991: test_pg_schedule_scrub: run_mgr td/ceph-helpers x --mgr_stats_period=1 2026-02-18T00:40:37.746 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/ceph-helpers 2026-02-18T00:40:37.746 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-18T00:40:37.746 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-18T00:40:37.746 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-18T00:40:37.746 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/ceph-helpers/x 2026-02-18T00:40:37.746 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-18T00:40:37.862 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-18T00:40:37.862 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:40:37.862 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:40:37.862 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:40:37.862 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:40:37.863 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:40:37.863 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.57427/$cluster-$name.asok' 2026-02-18T00:40:37.864 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-18T00:40:37.864 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/ceph-helpers/x '--log-file=td/ceph-helpers/$name.log' '--admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' --run-dir=td/ceph-helpers '--pid-file=td/ceph-helpers/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr --mgr_stats_period=1 2026-02-18T00:40:37.883 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1992: test_pg_schedule_scrub: run_osd td/ceph-helpers 0 2026-02-18T00:40:37.883 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/ceph-helpers 2026-02-18T00:40:37.883 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T00:40:37.883 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-18T00:40:37.883 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T00:40:37.883 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/ceph-helpers/0 2026-02-18T00:40:37.883 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--cluster ceph --fsid=863c4e35-ceb0-4172-b7b2-c3ff099e05a2 --auth-supported=none --mon-host=127.0.0.1:7109 ' 2026-02-18T00:40:37.884 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T00:40:37.884 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T00:40:37.884 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T00:40:37.884 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/ceph-helpers/0' 2026-02-18T00:40:37.884 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/ceph-helpers/0/journal' 2026-02-18T00:40:37.884 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T00:40:37.884 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-18T00:40:37.884 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/ceph-helpers' 2026-02-18T00:40:37.884 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T00:40:37.885 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:40:37.885 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:40:37.885 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:40:37.885 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:40:37.885 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:40:37.885 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.57427/$cluster-$name.asok' 2026-02-18T00:40:37.885 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' 2026-02-18T00:40:37.885 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T00:40:37.885 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T00:40:37.886 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T00:40:37.886 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/ceph-helpers/$name.log' 2026-02-18T00:40:37.886 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/ceph-helpers/$name.pid' 2026-02-18T00:40:37.886 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T00:40:37.886 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T00:40:37.886 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T00:40:37.886 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T00:40:37.886 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T00:40:37.886 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-18T00:40:37.886 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/ceph-helpers/0 2026-02-18T00:40:37.887 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T00:40:37.887 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=2944c09a-7c0d-4efe-84c1-4c6cc5d0a4ae 2026-02-18T00:40:37.888 INFO:tasks.workunit.client.0.trial069.stdout:add osd0 2944c09a-7c0d-4efe-84c1-4c6cc5d0a4ae 2026-02-18T00:40:37.888 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 2944c09a-7c0d-4efe-84c1-4c6cc5d0a4ae' 2026-02-18T00:40:37.889 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T00:40:37.895 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQCFCpVpLH/GNBAA6yn6GuxU4f+zbIl1vSXoyA== 2026-02-18T00:40:37.895 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQCFCpVpLH/GNBAA6yn6GuxU4f+zbIl1vSXoyA=="}' 2026-02-18T00:40:37.895 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 2944c09a-7c0d-4efe-84c1-4c6cc5d0a4ae -i td/ceph-helpers/0/new.json 2026-02-18T00:40:38.006 INFO:tasks.workunit.client.0.trial069.stdout:0 2026-02-18T00:40:38.013 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/ceph-helpers/0/new.json 2026-02-18T00:40:38.014 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --cluster ceph --fsid=863c4e35-ceb0-4172-b7b2-c3ff099e05a2 --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/0 --osd-journal=td/ceph-helpers/0/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCFCpVpLH/GNBAA6yn6GuxU4f+zbIl1vSXoyA== --osd-uuid 2944c09a-7c0d-4efe-84c1-4c6cc5d0a4ae 2026-02-18T00:40:38.031 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:40:38.017+0000 7fc9d096ea40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:40:38.032 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:40:38.017+0000 7fc9d096ea40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:40:38.033 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:40:38.021+0000 7fc9d096ea40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:40:38.033 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:40:38.021+0000 7fc9d096ea40 -1 bdev(0x55648efbec00 td/ceph-helpers/0/block) open stat got: (1) Operation not permitted 2026-02-18T00:40:38.034 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:40:38.021+0000 7fc9d096ea40 -1 bluestore(td/ceph-helpers/0) _read_fsid unparsable uuid 2026-02-18T00:40:38.804 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/ceph-helpers/0/keyring 2026-02-18T00:40:38.805 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T00:40:38.805 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-18T00:40:38.806 INFO:tasks.workunit.client.0.trial069.stdout:adding osd0 key to auth repository 2026-02-18T00:40:38.806 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/ceph-helpers/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T00:40:38.929 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-18T00:40:38.930 INFO:tasks.workunit.client.0.trial069.stdout:start osd.0 2026-02-18T00:40:38.931 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --cluster ceph --fsid=863c4e35-ceb0-4172-b7b2-c3ff099e05a2 --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/0 --osd-journal=td/ceph-helpers/0/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T00:40:38.931 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T00:40:38.931 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T00:40:38.931 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T00:40:38.954 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:40:38.941+0000 7f33af929a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:40:38.956 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:40:38.941+0000 7f33af929a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:40:38.957 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:40:38.945+0000 7f33af929a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:40:39.040 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-18T00:40:39.040 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:40:39.040 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-18T00:40:39.040 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:40:39.040 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:40:39.041 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:40:39.041 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:40:39.041 INFO:tasks.workunit.client.0.trial069.stdout:0 2026-02-18T00:40:39.041 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:40:39.041 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T00:40:39.149 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:40:39.354 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:40:39.341+0000 7f33af929a40 -1 Falling back to public interface 2026-02-18T00:40:40.151 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:40:40.151 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:40:40.151 INFO:tasks.workunit.client.0.trial069.stdout:1 2026-02-18T00:40:40.151 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T00:40:40.152 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:40:40.152 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T00:40:40.339 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:40:40.325+0000 7f33af929a40 -1 osd.0 0 log_to_monitors true 2026-02-18T00:40:40.368 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:40:41.370 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:40:41.370 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:40:41.370 INFO:tasks.workunit.client.0.trial069.stdout:2 2026-02-18T00:40:41.370 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-18T00:40:41.370 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:40:41.370 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T00:40:41.589 INFO:tasks.workunit.client.0.trial069.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/2352167637,v1:127.0.0.1:6801/2352167637] [v2:127.0.0.1:6802/2352167637,v1:127.0.0.1:6803/2352167637] exists,up 2944c09a-7c0d-4efe-84c1-4c6cc5d0a4ae 2026-02-18T00:40:41.589 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:40:41.590 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:40:41.590 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:40:41.590 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1993: test_pg_schedule_scrub: create_rbd_pool 2026-02-18T00:40:41.590 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:526: create_rbd_pool: ceph osd pool delete rbd rbd --yes-i-really-really-mean-it 2026-02-18T00:40:41.788 INFO:tasks.workunit.client.0.trial069.stderr:pool 'rbd' does not exist 2026-02-18T00:40:41.798 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:527: create_rbd_pool: create_pool rbd 4 2026-02-18T00:40:41.799 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create rbd 4 2026-02-18T00:40:42.043 INFO:tasks.workunit.client.0.trial069.stderr:pool 'rbd' already exists 2026-02-18T00:40:42.053 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-18T00:40:43.055 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:528: create_rbd_pool: rbd pool init rbd 2026-02-18T00:40:43.335 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1994: test_pg_schedule_scrub: wait_for_clean 2026-02-18T00:40:43.335 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-18T00:40:43.335 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-18T00:40:43.336 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-18T00:40:43.336 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-18T00:40:43.336 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-18T00:40:43.337 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-18T00:40:43.337 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-18T00:40:43.337 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-18T00:40:43.337 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-18T00:40:43.442 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-18T00:40:43.443 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-18T00:40:43.443 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-18T00:40:43.443 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-18T00:40:43.443 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-18T00:40:43.443 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-18T00:40:43.667 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids=0 2026-02-18T00:40:43.667 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-18T00:40:43.667 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:40:43.667 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-18T00:40:43.745 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836485 2026-02-18T00:40:43.746 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836485 2026-02-18T00:40:43.746 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836485' 2026-02-18T00:40:43.746 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:40:43.746 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836485 2026-02-18T00:40:43.746 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:40:43.747 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-18T00:40:43.748 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-21474836485 2026-02-18T00:40:43.748 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:40:43.749 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=21474836485 2026-02-18T00:40:43.749 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 21474836485' 2026-02-18T00:40:43.749 INFO:tasks.workunit.client.0.trial069.stdout:waiting osd.0 seq 21474836485 2026-02-18T00:40:43.750 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T00:40:43.959 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 21474836481 -lt 21474836485 2026-02-18T00:40:43.959 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-18T00:40:44.961 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-18T00:40:44.961 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T00:40:45.175 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 21474836485 -lt 21474836485 2026-02-18T00:40:45.175 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-18T00:40:45.176 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T00:40:45.176 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T00:40:45.462 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 4 == 0 2026-02-18T00:40:45.463 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-18T00:40:45.463 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-18T00:40:45.463 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-18T00:40:45.463 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-18T00:40:45.463 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-18T00:40:45.463 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-18T00:40:45.463 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-18T00:40:45.673 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=4 2026-02-18T00:40:45.673 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-18T00:40:45.673 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T00:40:45.674 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T00:40:45.961 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 4 = 4 2026-02-18T00:40:45.961 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-18T00:40:45.962 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-18T00:40:45.962 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1995: test_pg_schedule_scrub: pg_schedule_scrub 1.0 2026-02-18T00:40:45.962 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1969: pg_schedule_scrub: local pgid=1.0 2026-02-18T00:40:45.962 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1971: pg_schedule_scrub: wait_for_pg_clean 1.0 2026-02-18T00:40:45.962 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1702: wait_for_pg_clean: local pg_id=1.0 2026-02-18T00:40:45.962 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1703: wait_for_pg_clean: get_timeout_delays 90 1 3 2026-02-18T00:40:45.962 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-18T00:40:45.962 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-18T00:40:45.962 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-18T00:40:45.962 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-18T00:40:45.962 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-18T00:40:46.224 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1703: wait_for_pg_clean: delays=('1' '2' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3') 2026-02-18T00:40:46.224 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1703: wait_for_pg_clean: local -a delays 2026-02-18T00:40:46.224 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1704: wait_for_pg_clean: local -i loop=0 2026-02-18T00:40:46.224 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1706: wait_for_pg_clean: flush_pg_stats 2026-02-18T00:40:46.224 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-18T00:40:46.224 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-18T00:40:46.439 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids=0 2026-02-18T00:40:46.440 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-18T00:40:46.440 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:40:46.440 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-18T00:40:46.517 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836490 2026-02-18T00:40:46.517 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836490 2026-02-18T00:40:46.517 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836490' 2026-02-18T00:40:46.517 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:40:46.518 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836490 2026-02-18T00:40:46.518 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:40:46.519 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-18T00:40:46.519 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-21474836490 2026-02-18T00:40:46.519 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:40:46.521 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=21474836490 2026-02-18T00:40:46.521 INFO:tasks.workunit.client.0.trial069.stdout:waiting osd.0 seq 21474836490 2026-02-18T00:40:46.521 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 21474836490' 2026-02-18T00:40:46.521 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T00:40:46.730 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 21474836487 -lt 21474836490 2026-02-18T00:40:46.731 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-18T00:40:47.731 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-18T00:40:47.732 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T00:40:47.946 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 21474836487 -lt 21474836490 2026-02-18T00:40:47.946 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-18T00:40:48.947 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-18T00:40:48.948 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T00:40:49.158 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 21474836491 -lt 21474836490 2026-02-18T00:40:49.158 INFO:tasks.workunit.client.0.trial069.stdout:#---------- 1.0 loop 0 2026-02-18T00:40:49.159 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1708: wait_for_pg_clean: true 2026-02-18T00:40:49.159 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1709: wait_for_pg_clean: echo '#---------- 1.0 loop 0' 2026-02-18T00:40:49.159 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1710: wait_for_pg_clean: is_pg_clean 1.0 2026-02-18T00:40:49.159 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1572: is_pg_clean: local pgid=1.0 2026-02-18T00:40:49.160 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1573: is_pg_clean: local pg_state 2026-02-18T00:40:49.160 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: ceph pg 1.0 query 2026-02-18T00:40:49.160 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: jq -r '.state ' 2026-02-18T00:40:49.237 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: pg_state=active+clean 2026-02-18T00:40:49.237 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1575: is_pg_clean: [[ active+clean == \a\c\t\i\v\e\+\c\l\e\a\n* ]] 2026-02-18T00:40:49.237 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1710: wait_for_pg_clean: break 2026-02-18T00:40:49.237 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1719: wait_for_pg_clean: return 0 2026-02-18T00:40:49.237 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1972: pg_schedule_scrub: get_last_scrub_stamp 1.0 2026-02-18T00:40:49.237 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-18T00:40:49.237 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-18T00:40:49.237 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-18T00:40:49.237 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-18T00:40:49.444 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1972: pg_schedule_scrub: local last_scrub=2026-02-18T00:40:41.980829+0000 2026-02-18T00:40:49.445 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1973: pg_schedule_scrub: ceph tell 1.0 schedule-scrub 2026-02-18T00:40:49.517 INFO:tasks.workunit.client.0.trial069.stdout:{ 2026-02-18T00:40:49.517 INFO:tasks.workunit.client.0.trial069.stdout: "deep": false, 2026-02-18T00:40:49.517 INFO:tasks.workunit.client.0.trial069.stdout: "must": false, 2026-02-18T00:40:49.517 INFO:tasks.workunit.client.0.trial069.stdout: "stamp": "2026-02-15T12:40:49.507330+0000" 2026-02-18T00:40:49.517 INFO:tasks.workunit.client.0.trial069.stdout:} 2026-02-18T00:40:49.525 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1974: pg_schedule_scrub: wait_for_scrub 1.0 2026-02-18T00:40:41.980829+0000 2026-02-18T00:40:49.525 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2063: wait_for_scrub: local pgid=1.0 2026-02-18T00:40:49.525 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2064: wait_for_scrub: local last_scrub=2026-02-18T00:40:41.980829+0000 2026-02-18T00:40:49.525 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2065: wait_for_scrub: local sname=last_scrub_stamp 2026-02-18T00:40:49.525 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i=0 )) 2026-02-18T00:40:49.525 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-18T00:40:49.525 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-18T00:40:49.525 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-18T00:40:49.525 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-18T00:40:49.525 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-18T00:40:49.526 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-18T00:40:49.732 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-18T00:40:41.980829+0000 '>' 2026-02-18T00:40:41.980829+0000 2026-02-18T00:40:49.733 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-18T00:40:50.734 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-18T00:40:50.734 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-18T00:40:50.735 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-18T00:40:50.735 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-18T00:40:50.735 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-18T00:40:50.735 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-18T00:40:50.735 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-18T00:40:50.941 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-18T00:40:41.980829+0000 '>' 2026-02-18T00:40:41.980829+0000 2026-02-18T00:40:50.941 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-18T00:40:51.942 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-18T00:40:51.943 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-18T00:40:51.943 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-18T00:40:51.943 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-18T00:40:51.943 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-18T00:40:51.943 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-18T00:40:51.944 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-18T00:40:52.168 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-18T00:40:51.127399+0000 '>' 2026-02-18T00:40:41.980829+0000 2026-02-18T00:40:52.168 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: wait_for_scrub: return 0 2026-02-18T00:40:52.168 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1996: test_pg_schedule_scrub: teardown td/ceph-helpers 2026-02-18T00:40:52.168 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/ceph-helpers 2026-02-18T00:40:52.168 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T00:40:52.168 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/ceph-helpers KILL 2026-02-18T00:40:52.168 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:40:52.168 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:40:52.168 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:40:52.168 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:40:52.168 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:40:52.275 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:40:52.275 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T00:40:52.276 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T00:40:52.276 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T00:40:52.278 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T00:40:52.278 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T00:40:52.278 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T00:40:52.279 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:40:52.279 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T00:40:52.279 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T00:40:52.280 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:40:52.280 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T00:40:52.281 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T00:40:52.281 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/ceph-helpers 2026-02-18T00:40:52.285 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T00:40:52.285 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:40:52.285 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:40:52.285 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.57427 2026-02-18T00:40:52.287 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T00:40:52.287 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T00:40:52.287 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2426: run_tests: for func in $funcs 2026-02-18T00:40:52.287 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2427: run_tests: test_pg_scrub td/ceph-helpers 2026-02-18T00:40:52.287 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1941: test_pg_scrub: local dir=td/ceph-helpers 2026-02-18T00:40:52.287 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1943: test_pg_scrub: setup td/ceph-helpers 2026-02-18T00:40:52.287 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/ceph-helpers 2026-02-18T00:40:52.287 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/ceph-helpers 2026-02-18T00:40:52.287 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/ceph-helpers 2026-02-18T00:40:52.287 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T00:40:52.287 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/ceph-helpers KILL 2026-02-18T00:40:52.288 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:40:52.288 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:40:52.288 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:40:52.288 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:40:52.288 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:40:52.290 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:40:52.290 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T00:40:52.290 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T00:40:52.291 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T00:40:52.292 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T00:40:52.292 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T00:40:52.292 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T00:40:52.294 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:40:52.295 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T00:40:52.295 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T00:40:52.295 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:40:52.295 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T00:40:52.297 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T00:40:52.297 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/ceph-helpers 2026-02-18T00:40:52.298 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T00:40:52.298 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:40:52.298 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:40:52.298 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.57427 2026-02-18T00:40:52.299 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T00:40:52.299 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T00:40:52.300 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/ceph-helpers 2026-02-18T00:40:52.301 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-18T00:40:52.301 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:40:52.301 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:40:52.301 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.57427 2026-02-18T00:40:52.302 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-18T00:40:52.303 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-18T00:40:52.303 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-18T00:40:52.304 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/ceph-helpers 1' TERM HUP INT 2026-02-18T00:40:52.304 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1944: test_pg_scrub: run_mon td/ceph-helpers a --osd_pool_default_size=1 --mon_allow_pool_size_one=true 2026-02-18T00:40:52.304 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/ceph-helpers 2026-02-18T00:40:52.304 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-18T00:40:52.304 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-18T00:40:52.304 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-18T00:40:52.304 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/ceph-helpers/a 2026-02-18T00:40:52.304 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/ceph-helpers/a --run-dir=td/ceph-helpers --osd_pool_default_size=1 --mon_allow_pool_size_one=true 2026-02-18T00:40:52.325 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-18T00:40:52.325 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:40:52.325 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:40:52.325 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:40:52.325 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:40:52.326 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:40:52.326 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.57427/$cluster-$name.asok' 2026-02-18T00:40:52.326 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/ceph-helpers/a '--log-file=td/ceph-helpers/$name.log' '--admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' --mon-cluster-log-file=td/ceph-helpers/log --run-dir=td/ceph-helpers '--pid-file=td/ceph-helpers/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --osd_pool_default_size=1 --mon_allow_pool_size_one=true 2026-02-18T00:40:52.353 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-18T00:40:52.354 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-18T00:40:52.354 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T00:40:52.355 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-18T00:40:52.355 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-18T00:40:52.356 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-18T00:40:52.356 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-18T00:40:52.356 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:40:52.357 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:40:52.357 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:40:52.357 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:40:52.357 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:40:52.357 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.57427/ceph-mon.a.asok 2026-02-18T00:40:52.357 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T00:40:52.357 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.57427/ceph-mon.a.asok config get fsid 2026-02-18T00:40:52.410 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-18T00:40:52.410 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T00:40:52.410 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-18T00:40:52.410 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-18T00:40:52.410 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-18T00:40:52.411 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-18T00:40:52.411 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:40:52.411 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:40:52.412 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:40:52.412 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:40:52.412 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:40:52.412 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.57427/ceph-mon.a.asok 2026-02-18T00:40:52.412 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T00:40:52.412 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.57427/ceph-mon.a.asok config get mon_host 2026-02-18T00:40:52.465 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1945: test_pg_scrub: run_mgr td/ceph-helpers x 2026-02-18T00:40:52.465 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/ceph-helpers 2026-02-18T00:40:52.465 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-18T00:40:52.465 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-18T00:40:52.465 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-18T00:40:52.465 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/ceph-helpers/x 2026-02-18T00:40:52.465 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-18T00:40:52.574 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-18T00:40:52.574 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:40:52.574 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:40:52.574 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:40:52.574 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:40:52.574 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:40:52.575 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.57427/$cluster-$name.asok' 2026-02-18T00:40:52.575 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-18T00:40:52.576 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/ceph-helpers/x '--log-file=td/ceph-helpers/$name.log' '--admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' --run-dir=td/ceph-helpers '--pid-file=td/ceph-helpers/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-18T00:40:52.596 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1946: test_pg_scrub: run_osd td/ceph-helpers 0 2026-02-18T00:40:52.596 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/ceph-helpers 2026-02-18T00:40:52.596 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T00:40:52.596 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-18T00:40:52.596 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T00:40:52.596 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/ceph-helpers/0 2026-02-18T00:40:52.596 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--cluster ceph --fsid=863c4e35-ceb0-4172-b7b2-c3ff099e05a2 --auth-supported=none --mon-host=127.0.0.1:7109 ' 2026-02-18T00:40:52.596 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T00:40:52.596 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T00:40:52.596 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T00:40:52.596 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/ceph-helpers/0' 2026-02-18T00:40:52.596 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/ceph-helpers/0/journal' 2026-02-18T00:40:52.596 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T00:40:52.596 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-18T00:40:52.596 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/ceph-helpers' 2026-02-18T00:40:52.596 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T00:40:52.596 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:40:52.596 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:40:52.596 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:40:52.596 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:40:52.596 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:40:52.597 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.57427/$cluster-$name.asok' 2026-02-18T00:40:52.597 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' 2026-02-18T00:40:52.597 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T00:40:52.597 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T00:40:52.597 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T00:40:52.597 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/ceph-helpers/$name.log' 2026-02-18T00:40:52.597 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/ceph-helpers/$name.pid' 2026-02-18T00:40:52.597 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T00:40:52.597 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T00:40:52.597 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T00:40:52.597 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T00:40:52.597 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T00:40:52.597 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-18T00:40:52.597 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/ceph-helpers/0 2026-02-18T00:40:52.598 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T00:40:52.599 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=ea77aa56-ee71-4dfd-b1df-6d2e5fb75946 2026-02-18T00:40:52.599 INFO:tasks.workunit.client.0.trial069.stdout:add osd0 ea77aa56-ee71-4dfd-b1df-6d2e5fb75946 2026-02-18T00:40:52.599 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 ea77aa56-ee71-4dfd-b1df-6d2e5fb75946' 2026-02-18T00:40:52.599 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T00:40:52.611 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQCUCpVpqRvUIxAAXp4fxVD/Uv1M702NPBiwlw== 2026-02-18T00:40:52.611 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQCUCpVpqRvUIxAAXp4fxVD/Uv1M702NPBiwlw=="}' 2026-02-18T00:40:52.611 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new ea77aa56-ee71-4dfd-b1df-6d2e5fb75946 -i td/ceph-helpers/0/new.json 2026-02-18T00:40:52.725 INFO:tasks.workunit.client.0.trial069.stdout:0 2026-02-18T00:40:52.733 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/ceph-helpers/0/new.json 2026-02-18T00:40:52.734 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --cluster ceph --fsid=863c4e35-ceb0-4172-b7b2-c3ff099e05a2 --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/0 --osd-journal=td/ceph-helpers/0/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCUCpVpqRvUIxAAXp4fxVD/Uv1M702NPBiwlw== --osd-uuid ea77aa56-ee71-4dfd-b1df-6d2e5fb75946 2026-02-18T00:40:52.751 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:40:52.737+0000 7f74d07cca40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:40:52.752 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:40:52.737+0000 7f74d07cca40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:40:52.753 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:40:52.741+0000 7f74d07cca40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:40:52.754 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:40:52.741+0000 7f74d07cca40 -1 bdev(0x557186f9cc00 td/ceph-helpers/0/block) open stat got: (1) Operation not permitted 2026-02-18T00:40:52.754 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:40:52.741+0000 7f74d07cca40 -1 bluestore(td/ceph-helpers/0) _read_fsid unparsable uuid 2026-02-18T00:40:53.477 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/ceph-helpers/0/keyring 2026-02-18T00:40:53.477 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T00:40:53.478 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-18T00:40:53.478 INFO:tasks.workunit.client.0.trial069.stdout:adding osd0 key to auth repository 2026-02-18T00:40:53.479 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/ceph-helpers/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T00:40:53.598 INFO:tasks.workunit.client.0.trial069.stdout:start osd.0 2026-02-18T00:40:53.599 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-18T00:40:53.599 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --cluster ceph --fsid=863c4e35-ceb0-4172-b7b2-c3ff099e05a2 --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/0 --osd-journal=td/ceph-helpers/0/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T00:40:53.599 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T00:40:53.599 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T00:40:53.599 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T00:40:53.621 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:40:53.609+0000 7f31c91d4a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:40:53.623 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:40:53.609+0000 7f31c91d4a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:40:53.624 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:40:53.609+0000 7f31c91d4a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:40:53.707 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-18T00:40:53.707 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:40:53.707 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-18T00:40:53.707 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:40:53.708 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:40:53.708 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:40:53.708 INFO:tasks.workunit.client.0.trial069.stdout:0 2026-02-18T00:40:53.709 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:40:53.709 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:40:53.709 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T00:40:53.813 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:40:53.991 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:40:53.977+0000 7f31c91d4a40 -1 Falling back to public interface 2026-02-18T00:40:54.679 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:40:54.665+0000 7f31c91d4a40 -1 osd.0 0 log_to_monitors true 2026-02-18T00:40:54.815 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:40:54.815 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:40:54.815 INFO:tasks.workunit.client.0.trial069.stdout:1 2026-02-18T00:40:54.815 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T00:40:54.815 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:40:54.816 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T00:40:54.926 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:40:55.928 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:40:55.928 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:40:55.928 INFO:tasks.workunit.client.0.trial069.stdout:2 2026-02-18T00:40:55.929 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-18T00:40:55.929 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:40:55.929 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T00:40:56.147 INFO:tasks.workunit.client.0.trial069.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/2446608286,v1:127.0.0.1:6801/2446608286] [v2:127.0.0.1:6802/2446608286,v1:127.0.0.1:6803/2446608286] exists,up ea77aa56-ee71-4dfd-b1df-6d2e5fb75946 2026-02-18T00:40:56.148 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:40:56.148 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:40:56.148 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:40:56.148 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1947: test_pg_scrub: create_rbd_pool 2026-02-18T00:40:56.148 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:526: create_rbd_pool: ceph osd pool delete rbd rbd --yes-i-really-really-mean-it 2026-02-18T00:40:56.348 INFO:tasks.workunit.client.0.trial069.stderr:pool 'rbd' does not exist 2026-02-18T00:40:56.357 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:527: create_rbd_pool: create_pool rbd 4 2026-02-18T00:40:56.357 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create rbd 4 2026-02-18T00:40:56.632 INFO:tasks.workunit.client.0.trial069.stderr:pool 'rbd' already exists 2026-02-18T00:40:56.641 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-18T00:40:57.642 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:528: create_rbd_pool: rbd pool init rbd 2026-02-18T00:40:57.960 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1948: test_pg_scrub: wait_for_clean 2026-02-18T00:40:57.960 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-18T00:40:57.960 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-18T00:40:57.960 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-18T00:40:57.960 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-18T00:40:57.961 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-18T00:40:57.961 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-18T00:40:57.961 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-18T00:40:57.961 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-18T00:40:57.962 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-18T00:40:58.065 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-18T00:40:58.066 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-18T00:40:58.066 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-18T00:40:58.066 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-18T00:40:58.066 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-18T00:40:58.066 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-18T00:40:58.279 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids=0 2026-02-18T00:40:58.279 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-18T00:40:58.279 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:40:58.280 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-18T00:40:58.359 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836483 2026-02-18T00:40:58.359 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836483 2026-02-18T00:40:58.359 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836483' 2026-02-18T00:40:58.359 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:40:58.360 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836483 2026-02-18T00:40:58.360 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:40:58.360 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-18T00:40:58.361 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-21474836483 2026-02-18T00:40:58.361 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:40:58.362 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=21474836483 2026-02-18T00:40:58.363 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 21474836483' 2026-02-18T00:40:58.363 INFO:tasks.workunit.client.0.trial069.stdout:waiting osd.0 seq 21474836483 2026-02-18T00:40:58.363 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T00:40:58.575 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 21474836481 -lt 21474836483 2026-02-18T00:40:58.575 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-18T00:40:59.576 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-18T00:40:59.576 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T00:40:59.791 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 21474836483 -lt 21474836483 2026-02-18T00:40:59.792 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-18T00:40:59.793 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T00:40:59.793 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T00:41:00.079 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 4 == 0 2026-02-18T00:41:00.079 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-18T00:41:00.080 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-18T00:41:00.080 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-18T00:41:00.080 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-18T00:41:00.081 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-18T00:41:00.081 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-18T00:41:00.081 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-18T00:41:00.291 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=4 2026-02-18T00:41:00.291 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-18T00:41:00.292 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T00:41:00.292 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T00:41:00.578 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 4 = 4 2026-02-18T00:41:00.578 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-18T00:41:00.578 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-18T00:41:00.579 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1949: test_pg_scrub: pg_scrub 1.0 2026-02-18T00:41:00.579 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1923: pg_scrub: local pgid=1.0 2026-02-18T00:41:00.579 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1925: pg_scrub: wait_for_pg_clean 1.0 2026-02-18T00:41:00.579 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1702: wait_for_pg_clean: local pg_id=1.0 2026-02-18T00:41:00.579 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1703: wait_for_pg_clean: get_timeout_delays 90 1 3 2026-02-18T00:41:00.579 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-18T00:41:00.579 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-18T00:41:00.579 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-18T00:41:00.579 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-18T00:41:00.579 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-18T00:41:00.835 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1703: wait_for_pg_clean: delays=('1' '2' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3') 2026-02-18T00:41:00.835 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1703: wait_for_pg_clean: local -a delays 2026-02-18T00:41:00.835 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1704: wait_for_pg_clean: local -i loop=0 2026-02-18T00:41:00.836 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1706: wait_for_pg_clean: flush_pg_stats 2026-02-18T00:41:00.836 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-18T00:41:00.836 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-18T00:41:01.052 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids=0 2026-02-18T00:41:01.052 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-18T00:41:01.052 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:41:01.052 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-18T00:41:01.132 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836486 2026-02-18T00:41:01.132 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836486 2026-02-18T00:41:01.132 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836486' 2026-02-18T00:41:01.132 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:41:01.133 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836486 2026-02-18T00:41:01.133 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:41:01.134 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-18T00:41:01.134 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-21474836486 2026-02-18T00:41:01.134 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:41:01.135 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=21474836486 2026-02-18T00:41:01.135 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 21474836486' 2026-02-18T00:41:01.136 INFO:tasks.workunit.client.0.trial069.stdout:waiting osd.0 seq 21474836486 2026-02-18T00:41:01.136 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T00:41:01.360 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 21474836483 -lt 21474836486 2026-02-18T00:41:01.361 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-18T00:41:02.361 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-18T00:41:02.362 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T00:41:02.576 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 21474836483 -lt 21474836486 2026-02-18T00:41:02.576 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-18T00:41:03.577 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-18T00:41:03.578 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T00:41:03.794 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 21474836486 -lt 21474836486 2026-02-18T00:41:03.795 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1708: wait_for_pg_clean: true 2026-02-18T00:41:03.795 INFO:tasks.workunit.client.0.trial069.stdout:#---------- 1.0 loop 0 2026-02-18T00:41:03.796 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1709: wait_for_pg_clean: echo '#---------- 1.0 loop 0' 2026-02-18T00:41:03.796 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1710: wait_for_pg_clean: is_pg_clean 1.0 2026-02-18T00:41:03.796 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1572: is_pg_clean: local pgid=1.0 2026-02-18T00:41:03.796 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1573: is_pg_clean: local pg_state 2026-02-18T00:41:03.796 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: ceph pg 1.0 query 2026-02-18T00:41:03.796 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: jq -r '.state ' 2026-02-18T00:41:03.878 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: pg_state=active+clean 2026-02-18T00:41:03.879 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1575: is_pg_clean: [[ active+clean == \a\c\t\i\v\e\+\c\l\e\a\n* ]] 2026-02-18T00:41:03.879 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1710: wait_for_pg_clean: break 2026-02-18T00:41:03.879 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1719: wait_for_pg_clean: return 0 2026-02-18T00:41:03.879 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1926: pg_scrub: get_last_scrub_stamp 1.0 2026-02-18T00:41:03.879 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-18T00:41:03.879 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-18T00:41:03.879 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-18T00:41:03.880 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-18T00:41:04.090 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1926: pg_scrub: local last_scrub=2026-02-18T00:40:56.567741+0000 2026-02-18T00:41:04.091 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1927: pg_scrub: ceph pg scrub 1.0 2026-02-18T00:41:04.288 INFO:tasks.workunit.client.0.trial069.stderr:instructing pg 1.0 on osd.0 to scrub 2026-02-18T00:41:04.298 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1928: pg_scrub: wait_for_scrub 1.0 2026-02-18T00:40:56.567741+0000 2026-02-18T00:41:04.298 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2063: wait_for_scrub: local pgid=1.0 2026-02-18T00:41:04.298 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2064: wait_for_scrub: local last_scrub=2026-02-18T00:40:56.567741+0000 2026-02-18T00:41:04.299 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2065: wait_for_scrub: local sname=last_scrub_stamp 2026-02-18T00:41:04.299 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i=0 )) 2026-02-18T00:41:04.299 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-18T00:41:04.299 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-18T00:41:04.299 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-18T00:41:04.299 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-18T00:41:04.299 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-18T00:41:04.299 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-18T00:41:04.513 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-18T00:40:56.567741+0000 '>' 2026-02-18T00:40:56.567741+0000 2026-02-18T00:41:04.513 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-18T00:41:05.514 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-18T00:41:05.514 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-18T00:41:05.515 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-18T00:41:05.515 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-18T00:41:05.516 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-18T00:41:05.516 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-18T00:41:05.516 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-18T00:41:05.727 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-18T00:40:56.567741+0000 '>' 2026-02-18T00:40:56.567741+0000 2026-02-18T00:41:05.728 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-18T00:41:06.729 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-18T00:41:06.729 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-18T00:41:06.729 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-18T00:41:06.729 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-18T00:41:06.729 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-18T00:41:06.730 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-18T00:41:06.730 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-18T00:41:06.941 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-18T00:41:04.721162+0000 '>' 2026-02-18T00:40:56.567741+0000 2026-02-18T00:41:06.941 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: wait_for_scrub: return 0 2026-02-18T00:41:06.942 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1950: test_pg_scrub: kill_daemons td/ceph-helpers KILL osd 2026-02-18T00:41:06.942 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:41:06.942 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:41:06.942 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:41:06.942 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:41:06.942 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:41:07.048 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:41:07.049 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1951: test_pg_scrub: TIMEOUT=2 2026-02-18T00:41:07.049 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1951: test_pg_scrub: pg_scrub 1.0 2026-02-18T00:41:07.049 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1923: pg_scrub: local pgid=1.0 2026-02-18T00:41:07.049 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1925: pg_scrub: wait_for_pg_clean 1.0 2026-02-18T00:41:07.049 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1702: wait_for_pg_clean: local pg_id=1.0 2026-02-18T00:41:07.049 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1703: wait_for_pg_clean: get_timeout_delays 90 1 3 2026-02-18T00:41:07.050 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-18T00:41:07.050 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-18T00:41:07.050 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-18T00:41:07.050 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-18T00:41:07.050 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-18T00:41:07.307 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1703: wait_for_pg_clean: delays=('1' '2' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3') 2026-02-18T00:41:07.308 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1703: wait_for_pg_clean: local -a delays 2026-02-18T00:41:07.308 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1704: wait_for_pg_clean: local -i loop=0 2026-02-18T00:41:07.308 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1706: wait_for_pg_clean: flush_pg_stats 2026-02-18T00:41:07.308 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=2 2026-02-18T00:41:07.308 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-18T00:41:07.526 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids=0 2026-02-18T00:41:07.527 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-18T00:41:07.527 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:41:07.527 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-18T00:55:57.404 INFO:tasks.workunit.client.0.trial069.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-18T00:55:57.404 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq= 2026-02-18T00:55:57.404 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z '' 2026-02-18T00:55:57.404 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2261: flush_pg_stats: continue 2026-02-18T00:55:57.404 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1708: wait_for_pg_clean: true 2026-02-18T00:55:57.404 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1709: wait_for_pg_clean: echo '#---------- 1.0 loop 0' 2026-02-18T00:55:57.405 INFO:tasks.workunit.client.0.trial069.stdout:#---------- 1.0 loop 0 2026-02-18T00:55:57.405 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1710: wait_for_pg_clean: is_pg_clean 1.0 2026-02-18T00:55:57.406 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1572: is_pg_clean: local pgid=1.0 2026-02-18T00:55:57.406 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1573: is_pg_clean: local pg_state 2026-02-18T00:55:57.406 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: ceph pg 1.0 query 2026-02-18T00:55:57.406 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: jq -r '.state ' 2026-02-18T00:55:57.485 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: pg_state= 2026-02-18T00:55:57.485 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1575: is_pg_clean: [[ '' == \a\c\t\i\v\e\+\c\l\e\a\n* ]] 2026-02-18T00:55:57.485 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1711: wait_for_pg_clean: (( 0 >= 31 )) 2026-02-18T00:55:57.485 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1716: wait_for_pg_clean: sleep 1 2026-02-18T00:55:58.486 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1717: wait_for_pg_clean: loop+=1 2026-02-18T00:55:58.487 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1708: wait_for_pg_clean: true 2026-02-18T00:55:58.487 INFO:tasks.workunit.client.0.trial069.stdout:#---------- 1.0 loop 1 2026-02-18T00:55:58.488 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1709: wait_for_pg_clean: echo '#---------- 1.0 loop 1' 2026-02-18T00:55:58.488 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1710: wait_for_pg_clean: is_pg_clean 1.0 2026-02-18T00:55:58.488 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1572: is_pg_clean: local pgid=1.0 2026-02-18T00:55:58.488 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1573: is_pg_clean: local pg_state 2026-02-18T00:55:58.488 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: ceph pg 1.0 query 2026-02-18T00:55:58.488 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: jq -r '.state ' 2026-02-18T00:55:58.572 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: pg_state= 2026-02-18T00:55:58.572 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1575: is_pg_clean: [[ '' == \a\c\t\i\v\e\+\c\l\e\a\n* ]] 2026-02-18T00:55:58.572 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1711: wait_for_pg_clean: (( 1 >= 31 )) 2026-02-18T00:55:58.572 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1716: wait_for_pg_clean: sleep 2 2026-02-18T00:56:00.574 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1717: wait_for_pg_clean: loop+=1 2026-02-18T00:56:00.574 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1708: wait_for_pg_clean: true 2026-02-18T00:56:00.574 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1709: wait_for_pg_clean: echo '#---------- 1.0 loop 2' 2026-02-18T00:56:00.574 INFO:tasks.workunit.client.0.trial069.stdout:#---------- 1.0 loop 2 2026-02-18T00:56:00.575 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1710: wait_for_pg_clean: is_pg_clean 1.0 2026-02-18T00:56:00.575 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1572: is_pg_clean: local pgid=1.0 2026-02-18T00:56:00.575 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1573: is_pg_clean: local pg_state 2026-02-18T00:56:00.575 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: ceph pg 1.0 query 2026-02-18T00:56:00.575 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: jq -r '.state ' 2026-02-18T00:56:00.658 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: pg_state= 2026-02-18T00:56:00.658 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1575: is_pg_clean: [[ '' == \a\c\t\i\v\e\+\c\l\e\a\n* ]] 2026-02-18T00:56:00.659 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1711: wait_for_pg_clean: (( 2 >= 31 )) 2026-02-18T00:56:00.659 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1716: wait_for_pg_clean: sleep 3 2026-02-18T00:56:03.659 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1717: wait_for_pg_clean: loop+=1 2026-02-18T00:56:03.660 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1708: wait_for_pg_clean: true 2026-02-18T00:56:03.660 INFO:tasks.workunit.client.0.trial069.stdout:#---------- 1.0 loop 3 2026-02-18T00:56:03.661 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1709: wait_for_pg_clean: echo '#---------- 1.0 loop 3' 2026-02-18T00:56:03.661 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1710: wait_for_pg_clean: is_pg_clean 1.0 2026-02-18T00:56:03.661 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1572: is_pg_clean: local pgid=1.0 2026-02-18T00:56:03.661 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1573: is_pg_clean: local pg_state 2026-02-18T00:56:03.661 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: ceph pg 1.0 query 2026-02-18T00:56:03.661 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: jq -r '.state ' 2026-02-18T00:56:03.746 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: pg_state= 2026-02-18T00:56:03.747 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1575: is_pg_clean: [[ '' == \a\c\t\i\v\e\+\c\l\e\a\n* ]] 2026-02-18T00:56:03.747 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1711: wait_for_pg_clean: (( 3 >= 31 )) 2026-02-18T00:56:03.747 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1716: wait_for_pg_clean: sleep 3 2026-02-18T00:56:06.747 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1717: wait_for_pg_clean: loop+=1 2026-02-18T00:56:06.747 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1708: wait_for_pg_clean: true 2026-02-18T00:56:06.748 INFO:tasks.workunit.client.0.trial069.stdout:#---------- 1.0 loop 4 2026-02-18T00:56:06.748 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1709: wait_for_pg_clean: echo '#---------- 1.0 loop 4' 2026-02-18T00:56:06.749 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1710: wait_for_pg_clean: is_pg_clean 1.0 2026-02-18T00:56:06.749 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1572: is_pg_clean: local pgid=1.0 2026-02-18T00:56:06.749 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1573: is_pg_clean: local pg_state 2026-02-18T00:56:06.749 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: ceph pg 1.0 query 2026-02-18T00:56:06.749 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: jq -r '.state ' 2026-02-18T00:56:06.829 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: pg_state= 2026-02-18T00:56:06.829 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1575: is_pg_clean: [[ '' == \a\c\t\i\v\e\+\c\l\e\a\n* ]] 2026-02-18T00:56:06.829 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1711: wait_for_pg_clean: (( 4 >= 31 )) 2026-02-18T00:56:06.830 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1716: wait_for_pg_clean: sleep 3 2026-02-18T00:56:09.830 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1717: wait_for_pg_clean: loop+=1 2026-02-18T00:56:09.830 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1708: wait_for_pg_clean: true 2026-02-18T00:56:09.831 INFO:tasks.workunit.client.0.trial069.stdout:#---------- 1.0 loop 5 2026-02-18T00:56:09.832 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1709: wait_for_pg_clean: echo '#---------- 1.0 loop 5' 2026-02-18T00:56:09.832 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1710: wait_for_pg_clean: is_pg_clean 1.0 2026-02-18T00:56:09.832 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1572: is_pg_clean: local pgid=1.0 2026-02-18T00:56:09.832 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1573: is_pg_clean: local pg_state 2026-02-18T00:56:09.832 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: ceph pg 1.0 query 2026-02-18T00:56:09.832 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: jq -r '.state ' 2026-02-18T00:56:09.913 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: pg_state= 2026-02-18T00:56:09.913 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1575: is_pg_clean: [[ '' == \a\c\t\i\v\e\+\c\l\e\a\n* ]] 2026-02-18T00:56:09.913 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1711: wait_for_pg_clean: (( 5 >= 31 )) 2026-02-18T00:56:09.913 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1716: wait_for_pg_clean: sleep 3 2026-02-18T00:56:12.914 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1717: wait_for_pg_clean: loop+=1 2026-02-18T00:56:12.914 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1708: wait_for_pg_clean: true 2026-02-18T00:56:12.914 INFO:tasks.workunit.client.0.trial069.stdout:#---------- 1.0 loop 6 2026-02-18T00:56:12.915 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1709: wait_for_pg_clean: echo '#---------- 1.0 loop 6' 2026-02-18T00:56:12.915 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1710: wait_for_pg_clean: is_pg_clean 1.0 2026-02-18T00:56:12.916 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1572: is_pg_clean: local pgid=1.0 2026-02-18T00:56:12.916 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1573: is_pg_clean: local pg_state 2026-02-18T00:56:12.916 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: ceph pg 1.0 query 2026-02-18T00:56:12.916 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: jq -r '.state ' 2026-02-18T00:56:12.997 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: pg_state= 2026-02-18T00:56:12.998 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1575: is_pg_clean: [[ '' == \a\c\t\i\v\e\+\c\l\e\a\n* ]] 2026-02-18T00:56:12.998 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1711: wait_for_pg_clean: (( 6 >= 31 )) 2026-02-18T00:56:12.998 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1716: wait_for_pg_clean: sleep 3 2026-02-18T00:56:15.998 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1717: wait_for_pg_clean: loop+=1 2026-02-18T00:56:15.998 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1708: wait_for_pg_clean: true 2026-02-18T00:56:15.999 INFO:tasks.workunit.client.0.trial069.stdout:#---------- 1.0 loop 7 2026-02-18T00:56:16.000 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1709: wait_for_pg_clean: echo '#---------- 1.0 loop 7' 2026-02-18T00:56:16.000 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1710: wait_for_pg_clean: is_pg_clean 1.0 2026-02-18T00:56:16.000 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1572: is_pg_clean: local pgid=1.0 2026-02-18T00:56:16.000 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1573: is_pg_clean: local pg_state 2026-02-18T00:56:16.000 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: ceph pg 1.0 query 2026-02-18T00:56:16.000 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: jq -r '.state ' 2026-02-18T00:56:16.081 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: pg_state= 2026-02-18T00:56:16.081 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1575: is_pg_clean: [[ '' == \a\c\t\i\v\e\+\c\l\e\a\n* ]] 2026-02-18T00:56:16.082 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1711: wait_for_pg_clean: (( 7 >= 31 )) 2026-02-18T00:56:16.082 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1716: wait_for_pg_clean: sleep 3 2026-02-18T00:56:19.082 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1717: wait_for_pg_clean: loop+=1 2026-02-18T00:56:19.083 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1708: wait_for_pg_clean: true 2026-02-18T00:56:19.083 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1709: wait_for_pg_clean: echo '#---------- 1.0 loop 8' 2026-02-18T00:56:19.083 INFO:tasks.workunit.client.0.trial069.stdout:#---------- 1.0 loop 8 2026-02-18T00:56:19.083 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1710: wait_for_pg_clean: is_pg_clean 1.0 2026-02-18T00:56:19.083 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1572: is_pg_clean: local pgid=1.0 2026-02-18T00:56:19.083 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1573: is_pg_clean: local pg_state 2026-02-18T00:56:19.083 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: ceph pg 1.0 query 2026-02-18T00:56:19.083 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: jq -r '.state ' 2026-02-18T00:56:19.165 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: pg_state= 2026-02-18T00:56:19.165 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1575: is_pg_clean: [[ '' == \a\c\t\i\v\e\+\c\l\e\a\n* ]] 2026-02-18T00:56:19.165 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1711: wait_for_pg_clean: (( 8 >= 31 )) 2026-02-18T00:56:19.165 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1716: wait_for_pg_clean: sleep 3 2026-02-18T00:56:22.166 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1717: wait_for_pg_clean: loop+=1 2026-02-18T00:56:22.166 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1708: wait_for_pg_clean: true 2026-02-18T00:56:22.166 INFO:tasks.workunit.client.0.trial069.stdout:#---------- 1.0 loop 9 2026-02-18T00:56:22.166 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1709: wait_for_pg_clean: echo '#---------- 1.0 loop 9' 2026-02-18T00:56:22.166 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1710: wait_for_pg_clean: is_pg_clean 1.0 2026-02-18T00:56:22.166 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1572: is_pg_clean: local pgid=1.0 2026-02-18T00:56:22.167 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1573: is_pg_clean: local pg_state 2026-02-18T00:56:22.167 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: ceph pg 1.0 query 2026-02-18T00:56:22.167 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: jq -r '.state ' 2026-02-18T00:56:22.248 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: pg_state= 2026-02-18T00:56:22.248 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1575: is_pg_clean: [[ '' == \a\c\t\i\v\e\+\c\l\e\a\n* ]] 2026-02-18T00:56:22.248 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1711: wait_for_pg_clean: (( 9 >= 31 )) 2026-02-18T00:56:22.248 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1716: wait_for_pg_clean: sleep 3 2026-02-18T00:56:25.250 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1717: wait_for_pg_clean: loop+=1 2026-02-18T00:56:25.250 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1708: wait_for_pg_clean: true 2026-02-18T00:56:25.250 INFO:tasks.workunit.client.0.trial069.stdout:#---------- 1.0 loop 10 2026-02-18T00:56:25.251 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1709: wait_for_pg_clean: echo '#---------- 1.0 loop 10' 2026-02-18T00:56:25.252 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1710: wait_for_pg_clean: is_pg_clean 1.0 2026-02-18T00:56:25.252 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1572: is_pg_clean: local pgid=1.0 2026-02-18T00:56:25.252 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1573: is_pg_clean: local pg_state 2026-02-18T00:56:25.252 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: ceph pg 1.0 query 2026-02-18T00:56:25.252 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: jq -r '.state ' 2026-02-18T00:56:25.332 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: pg_state= 2026-02-18T00:56:25.332 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1575: is_pg_clean: [[ '' == \a\c\t\i\v\e\+\c\l\e\a\n* ]] 2026-02-18T00:56:25.332 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1711: wait_for_pg_clean: (( 10 >= 31 )) 2026-02-18T00:56:25.332 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1716: wait_for_pg_clean: sleep 3 2026-02-18T00:56:28.334 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1717: wait_for_pg_clean: loop+=1 2026-02-18T00:56:28.334 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1708: wait_for_pg_clean: true 2026-02-18T00:56:28.334 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1709: wait_for_pg_clean: echo '#---------- 1.0 loop 11' 2026-02-18T00:56:28.334 INFO:tasks.workunit.client.0.trial069.stdout:#---------- 1.0 loop 11 2026-02-18T00:56:28.335 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1710: wait_for_pg_clean: is_pg_clean 1.0 2026-02-18T00:56:28.335 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1572: is_pg_clean: local pgid=1.0 2026-02-18T00:56:28.335 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1573: is_pg_clean: local pg_state 2026-02-18T00:56:28.335 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: ceph pg 1.0 query 2026-02-18T00:56:28.335 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: jq -r '.state ' 2026-02-18T00:56:28.416 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: pg_state= 2026-02-18T00:56:28.416 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1575: is_pg_clean: [[ '' == \a\c\t\i\v\e\+\c\l\e\a\n* ]] 2026-02-18T00:56:28.416 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1711: wait_for_pg_clean: (( 11 >= 31 )) 2026-02-18T00:56:28.416 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1716: wait_for_pg_clean: sleep 3 2026-02-18T00:56:31.416 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1717: wait_for_pg_clean: loop+=1 2026-02-18T00:56:31.416 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1708: wait_for_pg_clean: true 2026-02-18T00:56:31.417 INFO:tasks.workunit.client.0.trial069.stdout:#---------- 1.0 loop 12 2026-02-18T00:56:31.417 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1709: wait_for_pg_clean: echo '#---------- 1.0 loop 12' 2026-02-18T00:56:31.417 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1710: wait_for_pg_clean: is_pg_clean 1.0 2026-02-18T00:56:31.417 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1572: is_pg_clean: local pgid=1.0 2026-02-18T00:56:31.417 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1573: is_pg_clean: local pg_state 2026-02-18T00:56:31.417 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: ceph pg 1.0 query 2026-02-18T00:56:31.417 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: jq -r '.state ' 2026-02-18T00:56:31.504 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: pg_state= 2026-02-18T00:56:31.504 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1575: is_pg_clean: [[ '' == \a\c\t\i\v\e\+\c\l\e\a\n* ]] 2026-02-18T00:56:31.504 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1711: wait_for_pg_clean: (( 12 >= 31 )) 2026-02-18T00:56:31.504 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1716: wait_for_pg_clean: sleep 3 2026-02-18T00:56:34.505 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1717: wait_for_pg_clean: loop+=1 2026-02-18T00:56:34.505 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1708: wait_for_pg_clean: true 2026-02-18T00:56:34.505 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1709: wait_for_pg_clean: echo '#---------- 1.0 loop 13' 2026-02-18T00:56:34.505 INFO:tasks.workunit.client.0.trial069.stdout:#---------- 1.0 loop 13 2026-02-18T00:56:34.505 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1710: wait_for_pg_clean: is_pg_clean 1.0 2026-02-18T00:56:34.505 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1572: is_pg_clean: local pgid=1.0 2026-02-18T00:56:34.505 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1573: is_pg_clean: local pg_state 2026-02-18T00:56:34.505 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: ceph pg 1.0 query 2026-02-18T00:56:34.506 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: jq -r '.state ' 2026-02-18T00:56:34.589 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: pg_state= 2026-02-18T00:56:34.589 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1575: is_pg_clean: [[ '' == \a\c\t\i\v\e\+\c\l\e\a\n* ]] 2026-02-18T00:56:34.589 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1711: wait_for_pg_clean: (( 13 >= 31 )) 2026-02-18T00:56:34.589 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1716: wait_for_pg_clean: sleep 3 2026-02-18T00:56:37.590 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1717: wait_for_pg_clean: loop+=1 2026-02-18T00:56:37.590 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1708: wait_for_pg_clean: true 2026-02-18T00:56:37.590 INFO:tasks.workunit.client.0.trial069.stdout:#---------- 1.0 loop 14 2026-02-18T00:56:37.591 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1709: wait_for_pg_clean: echo '#---------- 1.0 loop 14' 2026-02-18T00:56:37.591 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1710: wait_for_pg_clean: is_pg_clean 1.0 2026-02-18T00:56:37.591 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1572: is_pg_clean: local pgid=1.0 2026-02-18T00:56:37.591 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1573: is_pg_clean: local pg_state 2026-02-18T00:56:37.591 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: ceph pg 1.0 query 2026-02-18T00:56:37.591 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: jq -r '.state ' 2026-02-18T00:56:37.678 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: pg_state= 2026-02-18T00:56:37.678 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1575: is_pg_clean: [[ '' == \a\c\t\i\v\e\+\c\l\e\a\n* ]] 2026-02-18T00:56:37.678 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1711: wait_for_pg_clean: (( 14 >= 31 )) 2026-02-18T00:56:37.678 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1716: wait_for_pg_clean: sleep 3 2026-02-18T00:56:40.679 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1717: wait_for_pg_clean: loop+=1 2026-02-18T00:56:40.679 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1708: wait_for_pg_clean: true 2026-02-18T00:56:40.679 INFO:tasks.workunit.client.0.trial069.stdout:#---------- 1.0 loop 15 2026-02-18T00:56:40.680 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1709: wait_for_pg_clean: echo '#---------- 1.0 loop 15' 2026-02-18T00:56:40.680 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1710: wait_for_pg_clean: is_pg_clean 1.0 2026-02-18T00:56:40.680 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1572: is_pg_clean: local pgid=1.0 2026-02-18T00:56:40.680 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1573: is_pg_clean: local pg_state 2026-02-18T00:56:40.680 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: ceph pg 1.0 query 2026-02-18T00:56:40.680 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: jq -r '.state ' 2026-02-18T00:56:40.762 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: pg_state= 2026-02-18T00:56:40.762 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1575: is_pg_clean: [[ '' == \a\c\t\i\v\e\+\c\l\e\a\n* ]] 2026-02-18T00:56:40.763 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1711: wait_for_pg_clean: (( 15 >= 31 )) 2026-02-18T00:56:40.763 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1716: wait_for_pg_clean: sleep 3 2026-02-18T00:56:43.763 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1717: wait_for_pg_clean: loop+=1 2026-02-18T00:56:43.763 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1708: wait_for_pg_clean: true 2026-02-18T00:56:43.763 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1709: wait_for_pg_clean: echo '#---------- 1.0 loop 16' 2026-02-18T00:56:43.764 INFO:tasks.workunit.client.0.trial069.stdout:#---------- 1.0 loop 16 2026-02-18T00:56:43.764 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1710: wait_for_pg_clean: is_pg_clean 1.0 2026-02-18T00:56:43.764 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1572: is_pg_clean: local pgid=1.0 2026-02-18T00:56:43.765 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1573: is_pg_clean: local pg_state 2026-02-18T00:56:43.765 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: ceph pg 1.0 query 2026-02-18T00:56:43.765 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: jq -r '.state ' 2026-02-18T00:56:43.846 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: pg_state= 2026-02-18T00:56:43.846 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1575: is_pg_clean: [[ '' == \a\c\t\i\v\e\+\c\l\e\a\n* ]] 2026-02-18T00:56:43.846 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1711: wait_for_pg_clean: (( 16 >= 31 )) 2026-02-18T00:56:43.846 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1716: wait_for_pg_clean: sleep 3 2026-02-18T00:56:46.846 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1717: wait_for_pg_clean: loop+=1 2026-02-18T00:56:46.847 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1708: wait_for_pg_clean: true 2026-02-18T00:56:46.847 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1709: wait_for_pg_clean: echo '#---------- 1.0 loop 17' 2026-02-18T00:56:46.847 INFO:tasks.workunit.client.0.trial069.stdout:#---------- 1.0 loop 17 2026-02-18T00:56:46.848 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1710: wait_for_pg_clean: is_pg_clean 1.0 2026-02-18T00:56:46.848 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1572: is_pg_clean: local pgid=1.0 2026-02-18T00:56:46.848 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1573: is_pg_clean: local pg_state 2026-02-18T00:56:46.848 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: ceph pg 1.0 query 2026-02-18T00:56:46.848 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: jq -r '.state ' 2026-02-18T00:56:46.932 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: pg_state= 2026-02-18T00:56:46.932 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1575: is_pg_clean: [[ '' == \a\c\t\i\v\e\+\c\l\e\a\n* ]] 2026-02-18T00:56:46.932 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1711: wait_for_pg_clean: (( 17 >= 31 )) 2026-02-18T00:56:46.932 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1716: wait_for_pg_clean: sleep 3 2026-02-18T00:56:49.933 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1717: wait_for_pg_clean: loop+=1 2026-02-18T00:56:49.933 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1708: wait_for_pg_clean: true 2026-02-18T00:56:49.934 INFO:tasks.workunit.client.0.trial069.stdout:#---------- 1.0 loop 18 2026-02-18T00:56:49.934 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1709: wait_for_pg_clean: echo '#---------- 1.0 loop 18' 2026-02-18T00:56:49.935 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1710: wait_for_pg_clean: is_pg_clean 1.0 2026-02-18T00:56:49.935 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1572: is_pg_clean: local pgid=1.0 2026-02-18T00:56:49.935 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1573: is_pg_clean: local pg_state 2026-02-18T00:56:49.935 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: ceph pg 1.0 query 2026-02-18T00:56:49.935 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: jq -r '.state ' 2026-02-18T00:56:50.014 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: pg_state= 2026-02-18T00:56:50.014 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1575: is_pg_clean: [[ '' == \a\c\t\i\v\e\+\c\l\e\a\n* ]] 2026-02-18T00:56:50.015 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1711: wait_for_pg_clean: (( 18 >= 31 )) 2026-02-18T00:56:50.015 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1716: wait_for_pg_clean: sleep 3 2026-02-18T00:56:53.015 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1717: wait_for_pg_clean: loop+=1 2026-02-18T00:56:53.016 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1708: wait_for_pg_clean: true 2026-02-18T00:56:53.016 INFO:tasks.workunit.client.0.trial069.stdout:#---------- 1.0 loop 19 2026-02-18T00:56:53.017 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1709: wait_for_pg_clean: echo '#---------- 1.0 loop 19' 2026-02-18T00:56:53.017 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1710: wait_for_pg_clean: is_pg_clean 1.0 2026-02-18T00:56:53.017 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1572: is_pg_clean: local pgid=1.0 2026-02-18T00:56:53.017 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1573: is_pg_clean: local pg_state 2026-02-18T00:56:53.017 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: ceph pg 1.0 query 2026-02-18T00:56:53.017 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: jq -r '.state ' 2026-02-18T00:56:53.101 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: pg_state= 2026-02-18T00:56:53.101 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1575: is_pg_clean: [[ '' == \a\c\t\i\v\e\+\c\l\e\a\n* ]] 2026-02-18T00:56:53.101 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1711: wait_for_pg_clean: (( 19 >= 31 )) 2026-02-18T00:56:53.101 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1716: wait_for_pg_clean: sleep 3 2026-02-18T00:56:56.102 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1717: wait_for_pg_clean: loop+=1 2026-02-18T00:56:56.102 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1708: wait_for_pg_clean: true 2026-02-18T00:56:56.103 INFO:tasks.workunit.client.0.trial069.stdout:#---------- 1.0 loop 20 2026-02-18T00:56:56.103 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1709: wait_for_pg_clean: echo '#---------- 1.0 loop 20' 2026-02-18T00:56:56.104 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1710: wait_for_pg_clean: is_pg_clean 1.0 2026-02-18T00:56:56.104 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1572: is_pg_clean: local pgid=1.0 2026-02-18T00:56:56.104 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1573: is_pg_clean: local pg_state 2026-02-18T00:56:56.104 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: ceph pg 1.0 query 2026-02-18T00:56:56.104 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: jq -r '.state ' 2026-02-18T00:56:56.186 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: pg_state= 2026-02-18T00:56:56.186 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1575: is_pg_clean: [[ '' == \a\c\t\i\v\e\+\c\l\e\a\n* ]] 2026-02-18T00:56:56.186 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1711: wait_for_pg_clean: (( 20 >= 31 )) 2026-02-18T00:56:56.186 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1716: wait_for_pg_clean: sleep 3 2026-02-18T00:56:59.187 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1717: wait_for_pg_clean: loop+=1 2026-02-18T00:56:59.187 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1708: wait_for_pg_clean: true 2026-02-18T00:56:59.187 INFO:tasks.workunit.client.0.trial069.stdout:#---------- 1.0 loop 21 2026-02-18T00:56:59.188 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1709: wait_for_pg_clean: echo '#---------- 1.0 loop 21' 2026-02-18T00:56:59.189 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1710: wait_for_pg_clean: is_pg_clean 1.0 2026-02-18T00:56:59.189 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1572: is_pg_clean: local pgid=1.0 2026-02-18T00:56:59.189 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1573: is_pg_clean: local pg_state 2026-02-18T00:56:59.189 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: ceph pg 1.0 query 2026-02-18T00:56:59.189 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: jq -r '.state ' 2026-02-18T00:56:59.270 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: pg_state= 2026-02-18T00:56:59.271 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1575: is_pg_clean: [[ '' == \a\c\t\i\v\e\+\c\l\e\a\n* ]] 2026-02-18T00:56:59.271 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1711: wait_for_pg_clean: (( 21 >= 31 )) 2026-02-18T00:56:59.271 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1716: wait_for_pg_clean: sleep 3 2026-02-18T00:57:02.271 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1717: wait_for_pg_clean: loop+=1 2026-02-18T00:57:02.271 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1708: wait_for_pg_clean: true 2026-02-18T00:57:02.271 INFO:tasks.workunit.client.0.trial069.stdout:#---------- 1.0 loop 22 2026-02-18T00:57:02.272 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1709: wait_for_pg_clean: echo '#---------- 1.0 loop 22' 2026-02-18T00:57:02.272 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1710: wait_for_pg_clean: is_pg_clean 1.0 2026-02-18T00:57:02.272 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1572: is_pg_clean: local pgid=1.0 2026-02-18T00:57:02.272 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1573: is_pg_clean: local pg_state 2026-02-18T00:57:02.272 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: ceph pg 1.0 query 2026-02-18T00:57:02.272 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: jq -r '.state ' 2026-02-18T00:57:02.359 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: pg_state= 2026-02-18T00:57:02.360 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1575: is_pg_clean: [[ '' == \a\c\t\i\v\e\+\c\l\e\a\n* ]] 2026-02-18T00:57:02.360 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1711: wait_for_pg_clean: (( 22 >= 31 )) 2026-02-18T00:57:02.360 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1716: wait_for_pg_clean: sleep 3 2026-02-18T00:57:05.361 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1717: wait_for_pg_clean: loop+=1 2026-02-18T00:57:05.361 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1708: wait_for_pg_clean: true 2026-02-18T00:57:05.361 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1709: wait_for_pg_clean: echo '#---------- 1.0 loop 23' 2026-02-18T00:57:05.361 INFO:tasks.workunit.client.0.trial069.stdout:#---------- 1.0 loop 23 2026-02-18T00:57:05.362 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1710: wait_for_pg_clean: is_pg_clean 1.0 2026-02-18T00:57:05.362 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1572: is_pg_clean: local pgid=1.0 2026-02-18T00:57:05.362 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1573: is_pg_clean: local pg_state 2026-02-18T00:57:05.362 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: ceph pg 1.0 query 2026-02-18T00:57:05.363 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: jq -r '.state ' 2026-02-18T00:57:05.448 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: pg_state= 2026-02-18T00:57:05.448 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1575: is_pg_clean: [[ '' == \a\c\t\i\v\e\+\c\l\e\a\n* ]] 2026-02-18T00:57:05.448 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1711: wait_for_pg_clean: (( 23 >= 31 )) 2026-02-18T00:57:05.448 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1716: wait_for_pg_clean: sleep 3 2026-02-18T00:57:08.448 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1717: wait_for_pg_clean: loop+=1 2026-02-18T00:57:08.448 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1708: wait_for_pg_clean: true 2026-02-18T00:57:08.448 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1709: wait_for_pg_clean: echo '#---------- 1.0 loop 24' 2026-02-18T00:57:08.449 INFO:tasks.workunit.client.0.trial069.stdout:#---------- 1.0 loop 24 2026-02-18T00:57:08.449 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1710: wait_for_pg_clean: is_pg_clean 1.0 2026-02-18T00:57:08.449 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1572: is_pg_clean: local pgid=1.0 2026-02-18T00:57:08.449 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1573: is_pg_clean: local pg_state 2026-02-18T00:57:08.449 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: ceph pg 1.0 query 2026-02-18T00:57:08.450 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: jq -r '.state ' 2026-02-18T00:57:08.533 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: pg_state= 2026-02-18T00:57:08.533 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1575: is_pg_clean: [[ '' == \a\c\t\i\v\e\+\c\l\e\a\n* ]] 2026-02-18T00:57:08.533 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1711: wait_for_pg_clean: (( 24 >= 31 )) 2026-02-18T00:57:08.533 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1716: wait_for_pg_clean: sleep 3 2026-02-18T00:57:11.535 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1717: wait_for_pg_clean: loop+=1 2026-02-18T00:57:11.535 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1708: wait_for_pg_clean: true 2026-02-18T00:57:11.535 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1709: wait_for_pg_clean: echo '#---------- 1.0 loop 25' 2026-02-18T00:57:11.535 INFO:tasks.workunit.client.0.trial069.stdout:#---------- 1.0 loop 25 2026-02-18T00:57:11.536 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1710: wait_for_pg_clean: is_pg_clean 1.0 2026-02-18T00:57:11.536 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1572: is_pg_clean: local pgid=1.0 2026-02-18T00:57:11.536 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1573: is_pg_clean: local pg_state 2026-02-18T00:57:11.536 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: ceph pg 1.0 query 2026-02-18T00:57:11.537 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: jq -r '.state ' 2026-02-18T00:57:11.620 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: pg_state= 2026-02-18T00:57:11.620 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1575: is_pg_clean: [[ '' == \a\c\t\i\v\e\+\c\l\e\a\n* ]] 2026-02-18T00:57:11.620 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1711: wait_for_pg_clean: (( 25 >= 31 )) 2026-02-18T00:57:11.620 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1716: wait_for_pg_clean: sleep 3 2026-02-18T00:57:14.621 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1717: wait_for_pg_clean: loop+=1 2026-02-18T00:57:14.621 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1708: wait_for_pg_clean: true 2026-02-18T00:57:14.621 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1709: wait_for_pg_clean: echo '#---------- 1.0 loop 26' 2026-02-18T00:57:14.622 INFO:tasks.workunit.client.0.trial069.stdout:#---------- 1.0 loop 26 2026-02-18T00:57:14.623 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1710: wait_for_pg_clean: is_pg_clean 1.0 2026-02-18T00:57:14.623 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1572: is_pg_clean: local pgid=1.0 2026-02-18T00:57:14.623 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1573: is_pg_clean: local pg_state 2026-02-18T00:57:14.623 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: ceph pg 1.0 query 2026-02-18T00:57:14.623 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: jq -r '.state ' 2026-02-18T00:57:14.709 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: pg_state= 2026-02-18T00:57:14.709 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1575: is_pg_clean: [[ '' == \a\c\t\i\v\e\+\c\l\e\a\n* ]] 2026-02-18T00:57:14.709 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1711: wait_for_pg_clean: (( 26 >= 31 )) 2026-02-18T00:57:14.709 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1716: wait_for_pg_clean: sleep 3 2026-02-18T00:57:17.709 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1717: wait_for_pg_clean: loop+=1 2026-02-18T00:57:17.709 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1708: wait_for_pg_clean: true 2026-02-18T00:57:17.709 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1709: wait_for_pg_clean: echo '#---------- 1.0 loop 27' 2026-02-18T00:57:17.709 INFO:tasks.workunit.client.0.trial069.stdout:#---------- 1.0 loop 27 2026-02-18T00:57:17.709 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1710: wait_for_pg_clean: is_pg_clean 1.0 2026-02-18T00:57:17.709 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1572: is_pg_clean: local pgid=1.0 2026-02-18T00:57:17.709 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1573: is_pg_clean: local pg_state 2026-02-18T00:57:17.710 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: ceph pg 1.0 query 2026-02-18T00:57:17.710 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: jq -r '.state ' 2026-02-18T00:57:17.792 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: pg_state= 2026-02-18T00:57:17.792 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1575: is_pg_clean: [[ '' == \a\c\t\i\v\e\+\c\l\e\a\n* ]] 2026-02-18T00:57:17.792 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1711: wait_for_pg_clean: (( 27 >= 31 )) 2026-02-18T00:57:17.792 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1716: wait_for_pg_clean: sleep 3 2026-02-18T00:57:20.794 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1717: wait_for_pg_clean: loop+=1 2026-02-18T00:57:20.794 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1708: wait_for_pg_clean: true 2026-02-18T00:57:20.794 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1709: wait_for_pg_clean: echo '#---------- 1.0 loop 28' 2026-02-18T00:57:20.794 INFO:tasks.workunit.client.0.trial069.stdout:#---------- 1.0 loop 28 2026-02-18T00:57:20.794 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1710: wait_for_pg_clean: is_pg_clean 1.0 2026-02-18T00:57:20.794 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1572: is_pg_clean: local pgid=1.0 2026-02-18T00:57:20.795 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1573: is_pg_clean: local pg_state 2026-02-18T00:57:20.795 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: ceph pg 1.0 query 2026-02-18T00:57:20.795 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: jq -r '.state ' 2026-02-18T00:57:20.875 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: pg_state= 2026-02-18T00:57:20.875 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1575: is_pg_clean: [[ '' == \a\c\t\i\v\e\+\c\l\e\a\n* ]] 2026-02-18T00:57:20.876 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1711: wait_for_pg_clean: (( 28 >= 31 )) 2026-02-18T00:57:20.876 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1716: wait_for_pg_clean: sleep 3 2026-02-18T00:57:23.877 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1717: wait_for_pg_clean: loop+=1 2026-02-18T00:57:23.877 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1708: wait_for_pg_clean: true 2026-02-18T00:57:23.877 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1709: wait_for_pg_clean: echo '#---------- 1.0 loop 29' 2026-02-18T00:57:23.878 INFO:tasks.workunit.client.0.trial069.stdout:#---------- 1.0 loop 29 2026-02-18T00:57:23.879 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1710: wait_for_pg_clean: is_pg_clean 1.0 2026-02-18T00:57:23.879 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1572: is_pg_clean: local pgid=1.0 2026-02-18T00:57:23.879 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1573: is_pg_clean: local pg_state 2026-02-18T00:57:23.879 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: ceph pg 1.0 query 2026-02-18T00:57:23.879 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: jq -r '.state ' 2026-02-18T00:57:23.961 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: pg_state= 2026-02-18T00:57:23.962 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1575: is_pg_clean: [[ '' == \a\c\t\i\v\e\+\c\l\e\a\n* ]] 2026-02-18T00:57:23.962 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1711: wait_for_pg_clean: (( 29 >= 31 )) 2026-02-18T00:57:23.962 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1716: wait_for_pg_clean: sleep 3 2026-02-18T00:57:26.963 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1717: wait_for_pg_clean: loop+=1 2026-02-18T00:57:26.963 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1708: wait_for_pg_clean: true 2026-02-18T00:57:26.963 INFO:tasks.workunit.client.0.trial069.stdout:#---------- 1.0 loop 30 2026-02-18T00:57:26.964 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1709: wait_for_pg_clean: echo '#---------- 1.0 loop 30' 2026-02-18T00:57:26.964 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1710: wait_for_pg_clean: is_pg_clean 1.0 2026-02-18T00:57:26.964 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1572: is_pg_clean: local pgid=1.0 2026-02-18T00:57:26.965 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1573: is_pg_clean: local pg_state 2026-02-18T00:57:26.965 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: ceph pg 1.0 query 2026-02-18T00:57:26.965 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: jq -r '.state ' 2026-02-18T00:57:27.045 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: pg_state= 2026-02-18T00:57:27.045 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1575: is_pg_clean: [[ '' == \a\c\t\i\v\e\+\c\l\e\a\n* ]] 2026-02-18T00:57:27.045 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1711: wait_for_pg_clean: (( 30 >= 31 )) 2026-02-18T00:57:27.045 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1716: wait_for_pg_clean: sleep 3 2026-02-18T00:57:30.046 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1717: wait_for_pg_clean: loop+=1 2026-02-18T00:57:30.047 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1708: wait_for_pg_clean: true 2026-02-18T00:57:30.047 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1709: wait_for_pg_clean: echo '#---------- 1.0 loop 31' 2026-02-18T00:57:30.047 INFO:tasks.workunit.client.0.trial069.stdout:#---------- 1.0 loop 31 2026-02-18T00:57:30.048 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1710: wait_for_pg_clean: is_pg_clean 1.0 2026-02-18T00:57:30.048 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1572: is_pg_clean: local pgid=1.0 2026-02-18T00:57:30.048 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1573: is_pg_clean: local pg_state 2026-02-18T00:57:30.048 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: ceph pg 1.0 query 2026-02-18T00:57:30.048 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: jq -r '.state ' 2026-02-18T00:57:30.130 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: pg_state= 2026-02-18T00:57:30.131 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1575: is_pg_clean: [[ '' == \a\c\t\i\v\e\+\c\l\e\a\n* ]] 2026-02-18T00:57:30.131 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1711: wait_for_pg_clean: (( 31 >= 31 )) 2026-02-18T00:57:30.131 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1712: wait_for_pg_clean: ceph report 2026-02-18T00:57:30.394 INFO:tasks.workunit.client.0.trial069.stdout:{ 2026-02-18T00:57:30.394 INFO:tasks.workunit.client.0.trial069.stdout: "cluster_fingerprint": "605068e5-619e-4eed-aed7-aaca7352056a", 2026-02-18T00:57:30.394 INFO:tasks.workunit.client.0.trial069.stdout: "version": "20.2.0-670-gadc19233", 2026-02-18T00:57:30.394 INFO:tasks.workunit.client.0.trial069.stdout: "commit": "adc1923395f2bcd6ae89b5d331d278364d1848ed", 2026-02-18T00:57:30.394 INFO:tasks.workunit.client.0.trial069.stdout: "timestamp": "2026-02-18T00:57:30.384852+0000", 2026-02-18T00:57:30.394 INFO:tasks.workunit.client.0.trial069.stdout: "tag": "", 2026-02-18T00:57:30.395 INFO:tasks.workunit.client.0.trial069.stdout: "health": { 2026-02-18T00:57:30.395 INFO:tasks.workunit.client.0.trial069.stdout: "status": "HEALTH_WARN", 2026-02-18T00:57:30.395 INFO:tasks.workunit.client.0.trial069.stdout: "checks": { 2026-02-18T00:57:30.395 INFO:tasks.workunit.client.0.trial069.stdout: "OSD_DOWN": { 2026-02-18T00:57:30.395 INFO:tasks.workunit.client.0.trial069.stdout: "severity": "HEALTH_WARN", 2026-02-18T00:57:30.395 INFO:tasks.workunit.client.0.trial069.stdout: "summary": { 2026-02-18T00:57:30.395 INFO:tasks.workunit.client.0.trial069.stdout: "message": "1 osds down", 2026-02-18T00:57:30.395 INFO:tasks.workunit.client.0.trial069.stdout: "count": 1 2026-02-18T00:57:30.395 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:57:30.395 INFO:tasks.workunit.client.0.trial069.stdout: "detail": [ 2026-02-18T00:57:30.395 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:57:30.395 INFO:tasks.workunit.client.0.trial069.stdout: "message": "osd.0 (root=default,host=trial069) is down" 2026-02-18T00:57:30.395 INFO:tasks.workunit.client.0.trial069.stdout: } 2026-02-18T00:57:30.395 INFO:tasks.workunit.client.0.trial069.stdout: ], 2026-02-18T00:57:30.395 INFO:tasks.workunit.client.0.trial069.stdout: "muted": false 2026-02-18T00:57:30.395 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:57:30.395 INFO:tasks.workunit.client.0.trial069.stdout: "OSD_HOST_DOWN": { 2026-02-18T00:57:30.396 INFO:tasks.workunit.client.0.trial069.stdout: "severity": "HEALTH_WARN", 2026-02-18T00:57:30.396 INFO:tasks.workunit.client.0.trial069.stdout: "summary": { 2026-02-18T00:57:30.396 INFO:tasks.workunit.client.0.trial069.stdout: "message": "1 host (1 osds) down", 2026-02-18T00:57:30.396 INFO:tasks.workunit.client.0.trial069.stdout: "count": 1 2026-02-18T00:57:30.396 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:57:30.396 INFO:tasks.workunit.client.0.trial069.stdout: "detail": [ 2026-02-18T00:57:30.396 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:57:30.396 INFO:tasks.workunit.client.0.trial069.stdout: "message": "host trial069 (root=default) (1 osds) is down" 2026-02-18T00:57:30.396 INFO:tasks.workunit.client.0.trial069.stdout: } 2026-02-18T00:57:30.396 INFO:tasks.workunit.client.0.trial069.stdout: ], 2026-02-18T00:57:30.396 INFO:tasks.workunit.client.0.trial069.stdout: "muted": false 2026-02-18T00:57:30.396 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:57:30.396 INFO:tasks.workunit.client.0.trial069.stdout: "OSD_ROOT_DOWN": { 2026-02-18T00:57:30.396 INFO:tasks.workunit.client.0.trial069.stdout: "severity": "HEALTH_WARN", 2026-02-18T00:57:30.396 INFO:tasks.workunit.client.0.trial069.stdout: "summary": { 2026-02-18T00:57:30.396 INFO:tasks.workunit.client.0.trial069.stdout: "message": "1 root (1 osds) down", 2026-02-18T00:57:30.396 INFO:tasks.workunit.client.0.trial069.stdout: "count": 1 2026-02-18T00:57:30.396 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:57:30.396 INFO:tasks.workunit.client.0.trial069.stdout: "detail": [ 2026-02-18T00:57:30.397 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:57:30.397 INFO:tasks.workunit.client.0.trial069.stdout: "message": "root default (1 osds) is down" 2026-02-18T00:57:30.397 INFO:tasks.workunit.client.0.trial069.stdout: } 2026-02-18T00:57:30.397 INFO:tasks.workunit.client.0.trial069.stdout: ], 2026-02-18T00:57:30.397 INFO:tasks.workunit.client.0.trial069.stdout: "muted": false 2026-02-18T00:57:30.397 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:57:30.397 INFO:tasks.workunit.client.0.trial069.stdout: "PG_AVAILABILITY": { 2026-02-18T00:57:30.397 INFO:tasks.workunit.client.0.trial069.stdout: "severity": "HEALTH_WARN", 2026-02-18T00:57:30.397 INFO:tasks.workunit.client.0.trial069.stdout: "summary": { 2026-02-18T00:57:30.397 INFO:tasks.workunit.client.0.trial069.stdout: "message": "Reduced data availability: 4 pgs stale", 2026-02-18T00:57:30.397 INFO:tasks.workunit.client.0.trial069.stdout: "count": 4 2026-02-18T00:57:30.397 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:57:30.397 INFO:tasks.workunit.client.0.trial069.stdout: "detail": [ 2026-02-18T00:57:30.397 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:57:30.397 INFO:tasks.workunit.client.0.trial069.stdout: "message": "pg 1.0 is stuck stale for 91s, current state stale+active+clean, last acting [0]" 2026-02-18T00:57:30.397 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:57:30.397 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:57:30.397 INFO:tasks.workunit.client.0.trial069.stdout: "message": "pg 1.1 is stuck stale for 91s, current state stale+active+clean, last acting [0]" 2026-02-18T00:57:30.397 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:57:30.398 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:57:30.398 INFO:tasks.workunit.client.0.trial069.stdout: "message": "pg 1.2 is stuck stale for 91s, current state stale+active+clean, last acting [0]" 2026-02-18T00:57:30.398 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:57:30.398 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:57:30.398 INFO:tasks.workunit.client.0.trial069.stdout: "message": "pg 1.3 is stuck stale for 91s, current state stale+active+clean, last acting [0]" 2026-02-18T00:57:30.398 INFO:tasks.workunit.client.0.trial069.stdout: } 2026-02-18T00:57:30.398 INFO:tasks.workunit.client.0.trial069.stdout: ], 2026-02-18T00:57:30.398 INFO:tasks.workunit.client.0.trial069.stdout: "muted": false 2026-02-18T00:57:30.398 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:57:30.398 INFO:tasks.workunit.client.0.trial069.stdout: "POOL_NO_REDUNDANCY": { 2026-02-18T00:57:30.398 INFO:tasks.workunit.client.0.trial069.stdout: "severity": "HEALTH_WARN", 2026-02-18T00:57:30.398 INFO:tasks.workunit.client.0.trial069.stdout: "summary": { 2026-02-18T00:57:30.398 INFO:tasks.workunit.client.0.trial069.stdout: "message": "1 pool(s) have no replicas configured", 2026-02-18T00:57:30.398 INFO:tasks.workunit.client.0.trial069.stdout: "count": 1 2026-02-18T00:57:30.398 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:57:30.398 INFO:tasks.workunit.client.0.trial069.stdout: "detail": [ 2026-02-18T00:57:30.398 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:57:30.398 INFO:tasks.workunit.client.0.trial069.stdout: "message": "pool 'rbd' has no replicas configured" 2026-02-18T00:57:30.398 INFO:tasks.workunit.client.0.trial069.stdout: } 2026-02-18T00:57:30.399 INFO:tasks.workunit.client.0.trial069.stdout: ], 2026-02-18T00:57:30.399 INFO:tasks.workunit.client.0.trial069.stdout: "muted": false 2026-02-18T00:57:30.399 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:57:30.399 INFO:tasks.workunit.client.0.trial069.stdout: "TOO_FEW_OSDS": { 2026-02-18T00:57:30.399 INFO:tasks.workunit.client.0.trial069.stdout: "severity": "HEALTH_WARN", 2026-02-18T00:57:30.399 INFO:tasks.workunit.client.0.trial069.stdout: "summary": { 2026-02-18T00:57:30.399 INFO:tasks.workunit.client.0.trial069.stdout: "message": "OSD count 1 < osd_pool_default_size 3", 2026-02-18T00:57:30.399 INFO:tasks.workunit.client.0.trial069.stdout: "count": 2 2026-02-18T00:57:30.399 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:57:30.399 INFO:tasks.workunit.client.0.trial069.stdout: "detail": [], 2026-02-18T00:57:30.399 INFO:tasks.workunit.client.0.trial069.stdout: "muted": false 2026-02-18T00:57:30.399 INFO:tasks.workunit.client.0.trial069.stdout: } 2026-02-18T00:57:30.399 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:57:30.399 INFO:tasks.workunit.client.0.trial069.stdout: "mutes": [] 2026-02-18T00:57:30.399 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:57:30.399 INFO:tasks.workunit.client.0.trial069.stdout: "monmap_first_committed": 1, 2026-02-18T00:57:30.399 INFO:tasks.workunit.client.0.trial069.stdout: "monmap_last_committed": 1, 2026-02-18T00:57:30.399 INFO:tasks.workunit.client.0.trial069.stdout: "monmap": { 2026-02-18T00:57:30.399 INFO:tasks.workunit.client.0.trial069.stdout: "epoch": 1, 2026-02-18T00:57:30.399 INFO:tasks.workunit.client.0.trial069.stdout: "fsid": "863c4e35-ceb0-4172-b7b2-c3ff099e05a2", 2026-02-18T00:57:30.400 INFO:tasks.workunit.client.0.trial069.stdout: "modified": "2026-02-18T00:40:52.307703Z", 2026-02-18T00:57:30.400 INFO:tasks.workunit.client.0.trial069.stdout: "created": "2026-02-18T00:40:52.307703Z", 2026-02-18T00:57:30.400 INFO:tasks.workunit.client.0.trial069.stdout: "min_mon_release": 20, 2026-02-18T00:57:30.400 INFO:tasks.workunit.client.0.trial069.stdout: "min_mon_release_name": "tentacle", 2026-02-18T00:57:30.400 INFO:tasks.workunit.client.0.trial069.stdout: "election_strategy": 1, 2026-02-18T00:57:30.400 INFO:tasks.workunit.client.0.trial069.stdout: "disallowed_leaders": "", 2026-02-18T00:57:30.400 INFO:tasks.workunit.client.0.trial069.stdout: "stretch_mode": false, 2026-02-18T00:57:30.400 INFO:tasks.workunit.client.0.trial069.stdout: "tiebreaker_mon": "", 2026-02-18T00:57:30.400 INFO:tasks.workunit.client.0.trial069.stdout: "removed_ranks": "", 2026-02-18T00:57:30.400 INFO:tasks.workunit.client.0.trial069.stdout: "features": { 2026-02-18T00:57:30.400 INFO:tasks.workunit.client.0.trial069.stdout: "persistent": [ 2026-02-18T00:57:30.400 INFO:tasks.workunit.client.0.trial069.stdout: "kraken", 2026-02-18T00:57:30.400 INFO:tasks.workunit.client.0.trial069.stdout: "luminous", 2026-02-18T00:57:30.400 INFO:tasks.workunit.client.0.trial069.stdout: "mimic", 2026-02-18T00:57:30.400 INFO:tasks.workunit.client.0.trial069.stdout: "osdmap-prune", 2026-02-18T00:57:30.400 INFO:tasks.workunit.client.0.trial069.stdout: "nautilus", 2026-02-18T00:57:30.400 INFO:tasks.workunit.client.0.trial069.stdout: "octopus", 2026-02-18T00:57:30.400 INFO:tasks.workunit.client.0.trial069.stdout: "pacific", 2026-02-18T00:57:30.400 INFO:tasks.workunit.client.0.trial069.stdout: "elector-pinging", 2026-02-18T00:57:30.400 INFO:tasks.workunit.client.0.trial069.stdout: "quincy", 2026-02-18T00:57:30.401 INFO:tasks.workunit.client.0.trial069.stdout: "reef", 2026-02-18T00:57:30.401 INFO:tasks.workunit.client.0.trial069.stdout: "squid", 2026-02-18T00:57:30.401 INFO:tasks.workunit.client.0.trial069.stdout: "tentacle", 2026-02-18T00:57:30.401 INFO:tasks.workunit.client.0.trial069.stdout: "nvmeof_beacon_diff" 2026-02-18T00:57:30.401 INFO:tasks.workunit.client.0.trial069.stdout: ], 2026-02-18T00:57:30.401 INFO:tasks.workunit.client.0.trial069.stdout: "optional": [] 2026-02-18T00:57:30.401 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:57:30.401 INFO:tasks.workunit.client.0.trial069.stdout: "mons": [ 2026-02-18T00:57:30.401 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:57:30.401 INFO:tasks.workunit.client.0.trial069.stdout: "rank": 0, 2026-02-18T00:57:30.401 INFO:tasks.workunit.client.0.trial069.stdout: "name": "a", 2026-02-18T00:57:30.401 INFO:tasks.workunit.client.0.trial069.stdout: "public_addrs": { 2026-02-18T00:57:30.401 INFO:tasks.workunit.client.0.trial069.stdout: "addrvec": [ 2026-02-18T00:57:30.401 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:57:30.401 INFO:tasks.workunit.client.0.trial069.stdout: "type": "v2", 2026-02-18T00:57:30.401 INFO:tasks.workunit.client.0.trial069.stdout: "addr": "127.0.0.1:7109", 2026-02-18T00:57:30.401 INFO:tasks.workunit.client.0.trial069.stdout: "nonce": 0 2026-02-18T00:57:30.401 INFO:tasks.workunit.client.0.trial069.stdout: } 2026-02-18T00:57:30.401 INFO:tasks.workunit.client.0.trial069.stdout: ] 2026-02-18T00:57:30.402 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:57:30.402 INFO:tasks.workunit.client.0.trial069.stdout: "addr": "127.0.0.1:7109/0", 2026-02-18T00:57:30.402 INFO:tasks.workunit.client.0.trial069.stdout: "public_addr": "127.0.0.1:7109/0", 2026-02-18T00:57:30.402 INFO:tasks.workunit.client.0.trial069.stdout: "priority": 0, 2026-02-18T00:57:30.402 INFO:tasks.workunit.client.0.trial069.stdout: "weight": 0, 2026-02-18T00:57:30.402 INFO:tasks.workunit.client.0.trial069.stdout: "crush_location": "{}" 2026-02-18T00:57:30.402 INFO:tasks.workunit.client.0.trial069.stdout: } 2026-02-18T00:57:30.402 INFO:tasks.workunit.client.0.trial069.stdout: ] 2026-02-18T00:57:30.402 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:57:30.402 INFO:tasks.workunit.client.0.trial069.stdout: "quorum": [ 2026-02-18T00:57:30.402 INFO:tasks.workunit.client.0.trial069.stdout: 0 2026-02-18T00:57:30.402 INFO:tasks.workunit.client.0.trial069.stdout: ], 2026-02-18T00:57:30.402 INFO:tasks.workunit.client.0.trial069.stdout: "osdmap": { 2026-02-18T00:57:30.402 INFO:tasks.workunit.client.0.trial069.stdout: "epoch": 13, 2026-02-18T00:57:30.402 INFO:tasks.workunit.client.0.trial069.stdout: "fsid": "863c4e35-ceb0-4172-b7b2-c3ff099e05a2", 2026-02-18T00:57:30.402 INFO:tasks.workunit.client.0.trial069.stdout: "created": "2026-02-18T00:40:52.389146+0000", 2026-02-18T00:57:30.402 INFO:tasks.workunit.client.0.trial069.stdout: "modified": "2026-02-18T00:55:57.383145+0000", 2026-02-18T00:57:30.402 INFO:tasks.workunit.client.0.trial069.stdout: "last_up_change": "2026-02-18T00:55:57.383145+0000", 2026-02-18T00:57:30.402 INFO:tasks.workunit.client.0.trial069.stdout: "last_in_change": "2026-02-18T00:40:52.693331+0000", 2026-02-18T00:57:30.402 INFO:tasks.workunit.client.0.trial069.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2026-02-18T00:57:30.403 INFO:tasks.workunit.client.0.trial069.stdout: "flags_num": 5799936, 2026-02-18T00:57:30.403 INFO:tasks.workunit.client.0.trial069.stdout: "flags_set": [ 2026-02-18T00:57:30.403 INFO:tasks.workunit.client.0.trial069.stdout: "pglog_hardlimit", 2026-02-18T00:57:30.403 INFO:tasks.workunit.client.0.trial069.stdout: "purged_snapdirs", 2026-02-18T00:57:30.403 INFO:tasks.workunit.client.0.trial069.stdout: "recovery_deletes", 2026-02-18T00:57:30.403 INFO:tasks.workunit.client.0.trial069.stdout: "sortbitwise" 2026-02-18T00:57:30.403 INFO:tasks.workunit.client.0.trial069.stdout: ], 2026-02-18T00:57:30.403 INFO:tasks.workunit.client.0.trial069.stdout: "crush_version": 3, 2026-02-18T00:57:30.403 INFO:tasks.workunit.client.0.trial069.stdout: "full_ratio": 0.99000000953674316, 2026-02-18T00:57:30.403 INFO:tasks.workunit.client.0.trial069.stdout: "backfillfull_ratio": 0.99000000953674316, 2026-02-18T00:57:30.403 INFO:tasks.workunit.client.0.trial069.stdout: "nearfull_ratio": 0.85000002384185791, 2026-02-18T00:57:30.403 INFO:tasks.workunit.client.0.trial069.stdout: "cluster_snapshot": "", 2026-02-18T00:57:30.403 INFO:tasks.workunit.client.0.trial069.stdout: "pool_max": 1, 2026-02-18T00:57:30.403 INFO:tasks.workunit.client.0.trial069.stdout: "max_osd": 1, 2026-02-18T00:57:30.403 INFO:tasks.workunit.client.0.trial069.stdout: "require_min_compat_client": "luminous", 2026-02-18T00:57:30.403 INFO:tasks.workunit.client.0.trial069.stdout: "min_compat_client": "jewel", 2026-02-18T00:57:30.403 INFO:tasks.workunit.client.0.trial069.stdout: "require_osd_release": "tentacle", 2026-02-18T00:57:30.403 INFO:tasks.workunit.client.0.trial069.stdout: "allow_crimson": false, 2026-02-18T00:57:30.403 INFO:tasks.workunit.client.0.trial069.stdout: "pools": [ 2026-02-18T00:57:30.403 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:57:30.404 INFO:tasks.workunit.client.0.trial069.stdout: "pool": 1, 2026-02-18T00:57:30.404 INFO:tasks.workunit.client.0.trial069.stdout: "pool_name": "rbd", 2026-02-18T00:57:30.404 INFO:tasks.workunit.client.0.trial069.stdout: "create_time": "2026-02-18T00:40:56.517647+0000", 2026-02-18T00:57:30.404 INFO:tasks.workunit.client.0.trial069.stdout: "flags": 8193, 2026-02-18T00:57:30.404 INFO:tasks.workunit.client.0.trial069.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2026-02-18T00:57:30.404 INFO:tasks.workunit.client.0.trial069.stdout: "type": 1, 2026-02-18T00:57:30.404 INFO:tasks.workunit.client.0.trial069.stdout: "size": 1, 2026-02-18T00:57:30.404 INFO:tasks.workunit.client.0.trial069.stdout: "min_size": 1, 2026-02-18T00:57:30.404 INFO:tasks.workunit.client.0.trial069.stdout: "crush_rule": 0, 2026-02-18T00:57:30.404 INFO:tasks.workunit.client.0.trial069.stdout: "peering_crush_bucket_count": 0, 2026-02-18T00:57:30.404 INFO:tasks.workunit.client.0.trial069.stdout: "peering_crush_bucket_target": 0, 2026-02-18T00:57:30.404 INFO:tasks.workunit.client.0.trial069.stdout: "peering_crush_bucket_barrier": 0, 2026-02-18T00:57:30.404 INFO:tasks.workunit.client.0.trial069.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2026-02-18T00:57:30.404 INFO:tasks.workunit.client.0.trial069.stdout: "is_stretch_pool": false, 2026-02-18T00:57:30.404 INFO:tasks.workunit.client.0.trial069.stdout: "object_hash": 2, 2026-02-18T00:57:30.404 INFO:tasks.workunit.client.0.trial069.stdout: "pg_autoscale_mode": "off", 2026-02-18T00:57:30.404 INFO:tasks.workunit.client.0.trial069.stdout: "pg_num": 4, 2026-02-18T00:57:30.404 INFO:tasks.workunit.client.0.trial069.stdout: "pg_placement_num": 4, 2026-02-18T00:57:30.404 INFO:tasks.workunit.client.0.trial069.stdout: "pg_placement_num_target": 4, 2026-02-18T00:57:30.405 INFO:tasks.workunit.client.0.trial069.stdout: "pg_num_target": 4, 2026-02-18T00:57:30.405 INFO:tasks.workunit.client.0.trial069.stdout: "pg_num_pending": 4, 2026-02-18T00:57:30.405 INFO:tasks.workunit.client.0.trial069.stdout: "last_pg_merge_meta": { 2026-02-18T00:57:30.405 INFO:tasks.workunit.client.0.trial069.stdout: "source_pgid": "0.0", 2026-02-18T00:57:30.405 INFO:tasks.workunit.client.0.trial069.stdout: "ready_epoch": 0, 2026-02-18T00:57:30.405 INFO:tasks.workunit.client.0.trial069.stdout: "last_epoch_started": 0, 2026-02-18T00:57:30.405 INFO:tasks.workunit.client.0.trial069.stdout: "last_epoch_clean": 0, 2026-02-18T00:57:30.405 INFO:tasks.workunit.client.0.trial069.stdout: "source_version": "0'0", 2026-02-18T00:57:30.405 INFO:tasks.workunit.client.0.trial069.stdout: "target_version": "0'0" 2026-02-18T00:57:30.405 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:57:30.405 INFO:tasks.workunit.client.0.trial069.stdout: "last_change": "11", 2026-02-18T00:57:30.405 INFO:tasks.workunit.client.0.trial069.stdout: "last_force_op_resend": "0", 2026-02-18T00:57:30.405 INFO:tasks.workunit.client.0.trial069.stdout: "last_force_op_resend_prenautilus": "0", 2026-02-18T00:57:30.405 INFO:tasks.workunit.client.0.trial069.stdout: "last_force_op_resend_preluminous": "0", 2026-02-18T00:57:30.405 INFO:tasks.workunit.client.0.trial069.stdout: "auid": 0, 2026-02-18T00:57:30.405 INFO:tasks.workunit.client.0.trial069.stdout: "snap_mode": "selfmanaged", 2026-02-18T00:57:30.405 INFO:tasks.workunit.client.0.trial069.stdout: "snap_seq": 2, 2026-02-18T00:57:30.405 INFO:tasks.workunit.client.0.trial069.stdout: "snap_epoch": 11, 2026-02-18T00:57:30.405 INFO:tasks.workunit.client.0.trial069.stdout: "pool_snaps": [], 2026-02-18T00:57:30.405 INFO:tasks.workunit.client.0.trial069.stdout: "removed_snaps": "[]", 2026-02-18T00:57:30.405 INFO:tasks.workunit.client.0.trial069.stdout: "quota_max_bytes": 0, 2026-02-18T00:57:30.406 INFO:tasks.workunit.client.0.trial069.stdout: "quota_max_objects": 0, 2026-02-18T00:57:30.406 INFO:tasks.workunit.client.0.trial069.stdout: "tiers": [], 2026-02-18T00:57:30.406 INFO:tasks.workunit.client.0.trial069.stdout: "tier_of": -1, 2026-02-18T00:57:30.406 INFO:tasks.workunit.client.0.trial069.stdout: "read_tier": -1, 2026-02-18T00:57:30.406 INFO:tasks.workunit.client.0.trial069.stdout: "write_tier": -1, 2026-02-18T00:57:30.406 INFO:tasks.workunit.client.0.trial069.stdout: "cache_mode": "none", 2026-02-18T00:57:30.406 INFO:tasks.workunit.client.0.trial069.stdout: "target_max_bytes": 0, 2026-02-18T00:57:30.406 INFO:tasks.workunit.client.0.trial069.stdout: "target_max_objects": 0, 2026-02-18T00:57:30.406 INFO:tasks.workunit.client.0.trial069.stdout: "cache_target_dirty_ratio_micro": 400000, 2026-02-18T00:57:30.406 INFO:tasks.workunit.client.0.trial069.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2026-02-18T00:57:30.406 INFO:tasks.workunit.client.0.trial069.stdout: "cache_target_full_ratio_micro": 800000, 2026-02-18T00:57:30.406 INFO:tasks.workunit.client.0.trial069.stdout: "cache_min_flush_age": 0, 2026-02-18T00:57:30.406 INFO:tasks.workunit.client.0.trial069.stdout: "cache_min_evict_age": 0, 2026-02-18T00:57:30.406 INFO:tasks.workunit.client.0.trial069.stdout: "erasure_code_profile": "", 2026-02-18T00:57:30.406 INFO:tasks.workunit.client.0.trial069.stdout: "hit_set_params": { 2026-02-18T00:57:30.406 INFO:tasks.workunit.client.0.trial069.stdout: "type": "none" 2026-02-18T00:57:30.406 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:57:30.406 INFO:tasks.workunit.client.0.trial069.stdout: "hit_set_period": 0, 2026-02-18T00:57:30.406 INFO:tasks.workunit.client.0.trial069.stdout: "hit_set_count": 0, 2026-02-18T00:57:30.407 INFO:tasks.workunit.client.0.trial069.stdout: "use_gmt_hitset": true, 2026-02-18T00:57:30.407 INFO:tasks.workunit.client.0.trial069.stdout: "min_read_recency_for_promote": 0, 2026-02-18T00:57:30.407 INFO:tasks.workunit.client.0.trial069.stdout: "min_write_recency_for_promote": 0, 2026-02-18T00:57:30.407 INFO:tasks.workunit.client.0.trial069.stdout: "hit_set_grade_decay_rate": 0, 2026-02-18T00:57:30.407 INFO:tasks.workunit.client.0.trial069.stdout: "hit_set_search_last_n": 0, 2026-02-18T00:57:30.407 INFO:tasks.workunit.client.0.trial069.stdout: "grade_table": [], 2026-02-18T00:57:30.407 INFO:tasks.workunit.client.0.trial069.stdout: "stripe_width": 0, 2026-02-18T00:57:30.407 INFO:tasks.workunit.client.0.trial069.stdout: "expected_num_objects": 0, 2026-02-18T00:57:30.407 INFO:tasks.workunit.client.0.trial069.stdout: "fast_read": false, 2026-02-18T00:57:30.407 INFO:tasks.workunit.client.0.trial069.stdout: "nonprimary_shards": "{}", 2026-02-18T00:57:30.407 INFO:tasks.workunit.client.0.trial069.stdout: "options": {}, 2026-02-18T00:57:30.407 INFO:tasks.workunit.client.0.trial069.stdout: "application_metadata": { 2026-02-18T00:57:30.407 INFO:tasks.workunit.client.0.trial069.stdout: "rbd": {} 2026-02-18T00:57:30.407 INFO:tasks.workunit.client.0.trial069.stdout: } 2026-02-18T00:57:30.407 INFO:tasks.workunit.client.0.trial069.stdout: } 2026-02-18T00:57:30.407 INFO:tasks.workunit.client.0.trial069.stdout: ], 2026-02-18T00:57:30.407 INFO:tasks.workunit.client.0.trial069.stdout: "osds": [ 2026-02-18T00:57:30.407 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:57:30.407 INFO:tasks.workunit.client.0.trial069.stdout: "osd": 0, 2026-02-18T00:57:30.408 INFO:tasks.workunit.client.0.trial069.stdout: "uuid": "ea77aa56-ee71-4dfd-b1df-6d2e5fb75946", 2026-02-18T00:57:30.408 INFO:tasks.workunit.client.0.trial069.stdout: "up": 0, 2026-02-18T00:57:30.408 INFO:tasks.workunit.client.0.trial069.stdout: "in": 1, 2026-02-18T00:57:30.408 INFO:tasks.workunit.client.0.trial069.stdout: "weight": 1, 2026-02-18T00:57:30.408 INFO:tasks.workunit.client.0.trial069.stdout: "primary_affinity": 1, 2026-02-18T00:57:30.408 INFO:tasks.workunit.client.0.trial069.stdout: "last_clean_begin": 0, 2026-02-18T00:57:30.408 INFO:tasks.workunit.client.0.trial069.stdout: "last_clean_end": 0, 2026-02-18T00:57:30.408 INFO:tasks.workunit.client.0.trial069.stdout: "up_from": 5, 2026-02-18T00:57:30.408 INFO:tasks.workunit.client.0.trial069.stdout: "up_thru": 6, 2026-02-18T00:57:30.408 INFO:tasks.workunit.client.0.trial069.stdout: "down_at": 13, 2026-02-18T00:57:30.408 INFO:tasks.workunit.client.0.trial069.stdout: "lost_at": 0, 2026-02-18T00:57:30.408 INFO:tasks.workunit.client.0.trial069.stdout: "public_addrs": { 2026-02-18T00:57:30.408 INFO:tasks.workunit.client.0.trial069.stdout: "addrvec": [ 2026-02-18T00:57:30.408 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:57:30.408 INFO:tasks.workunit.client.0.trial069.stdout: "type": "v2", 2026-02-18T00:57:30.408 INFO:tasks.workunit.client.0.trial069.stdout: "addr": "127.0.0.1:6800", 2026-02-18T00:57:30.408 INFO:tasks.workunit.client.0.trial069.stdout: "nonce": 2446608286 2026-02-18T00:57:30.408 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:57:30.408 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:57:30.408 INFO:tasks.workunit.client.0.trial069.stdout: "type": "v1", 2026-02-18T00:57:30.409 INFO:tasks.workunit.client.0.trial069.stdout: "addr": "127.0.0.1:6801", 2026-02-18T00:57:30.409 INFO:tasks.workunit.client.0.trial069.stdout: "nonce": 2446608286 2026-02-18T00:57:30.409 INFO:tasks.workunit.client.0.trial069.stdout: } 2026-02-18T00:57:30.409 INFO:tasks.workunit.client.0.trial069.stdout: ] 2026-02-18T00:57:30.409 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:57:30.409 INFO:tasks.workunit.client.0.trial069.stdout: "cluster_addrs": { 2026-02-18T00:57:30.409 INFO:tasks.workunit.client.0.trial069.stdout: "addrvec": [ 2026-02-18T00:57:30.409 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:57:30.409 INFO:tasks.workunit.client.0.trial069.stdout: "type": "v2", 2026-02-18T00:57:30.409 INFO:tasks.workunit.client.0.trial069.stdout: "addr": "127.0.0.1:6802", 2026-02-18T00:57:30.409 INFO:tasks.workunit.client.0.trial069.stdout: "nonce": 2446608286 2026-02-18T00:57:30.409 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:57:30.409 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:57:30.409 INFO:tasks.workunit.client.0.trial069.stdout: "type": "v1", 2026-02-18T00:57:30.409 INFO:tasks.workunit.client.0.trial069.stdout: "addr": "127.0.0.1:6803", 2026-02-18T00:57:30.409 INFO:tasks.workunit.client.0.trial069.stdout: "nonce": 2446608286 2026-02-18T00:57:30.409 INFO:tasks.workunit.client.0.trial069.stdout: } 2026-02-18T00:57:30.409 INFO:tasks.workunit.client.0.trial069.stdout: ] 2026-02-18T00:57:30.409 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:57:30.409 INFO:tasks.workunit.client.0.trial069.stdout: "heartbeat_back_addrs": { 2026-02-18T00:57:30.409 INFO:tasks.workunit.client.0.trial069.stdout: "addrvec": [ 2026-02-18T00:57:30.410 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:57:30.410 INFO:tasks.workunit.client.0.trial069.stdout: "type": "v2", 2026-02-18T00:57:30.410 INFO:tasks.workunit.client.0.trial069.stdout: "addr": "127.0.0.1:6806", 2026-02-18T00:57:30.410 INFO:tasks.workunit.client.0.trial069.stdout: "nonce": 2446608286 2026-02-18T00:57:30.410 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:57:30.410 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:57:30.410 INFO:tasks.workunit.client.0.trial069.stdout: "type": "v1", 2026-02-18T00:57:30.410 INFO:tasks.workunit.client.0.trial069.stdout: "addr": "127.0.0.1:6807", 2026-02-18T00:57:30.410 INFO:tasks.workunit.client.0.trial069.stdout: "nonce": 2446608286 2026-02-18T00:57:30.410 INFO:tasks.workunit.client.0.trial069.stdout: } 2026-02-18T00:57:30.410 INFO:tasks.workunit.client.0.trial069.stdout: ] 2026-02-18T00:57:30.410 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:57:30.410 INFO:tasks.workunit.client.0.trial069.stdout: "heartbeat_front_addrs": { 2026-02-18T00:57:30.410 INFO:tasks.workunit.client.0.trial069.stdout: "addrvec": [ 2026-02-18T00:57:30.410 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:57:30.410 INFO:tasks.workunit.client.0.trial069.stdout: "type": "v2", 2026-02-18T00:57:30.410 INFO:tasks.workunit.client.0.trial069.stdout: "addr": "127.0.0.1:6804", 2026-02-18T00:57:30.410 INFO:tasks.workunit.client.0.trial069.stdout: "nonce": 2446608286 2026-02-18T00:57:30.410 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:57:30.411 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:57:30.411 INFO:tasks.workunit.client.0.trial069.stdout: "type": "v1", 2026-02-18T00:57:30.411 INFO:tasks.workunit.client.0.trial069.stdout: "addr": "127.0.0.1:6805", 2026-02-18T00:57:30.411 INFO:tasks.workunit.client.0.trial069.stdout: "nonce": 2446608286 2026-02-18T00:57:30.411 INFO:tasks.workunit.client.0.trial069.stdout: } 2026-02-18T00:57:30.411 INFO:tasks.workunit.client.0.trial069.stdout: ] 2026-02-18T00:57:30.411 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:57:30.411 INFO:tasks.workunit.client.0.trial069.stdout: "public_addr": "127.0.0.1:6801/2446608286", 2026-02-18T00:57:30.411 INFO:tasks.workunit.client.0.trial069.stdout: "cluster_addr": "127.0.0.1:6803/2446608286", 2026-02-18T00:57:30.411 INFO:tasks.workunit.client.0.trial069.stdout: "heartbeat_back_addr": "127.0.0.1:6807/2446608286", 2026-02-18T00:57:30.411 INFO:tasks.workunit.client.0.trial069.stdout: "heartbeat_front_addr": "127.0.0.1:6805/2446608286", 2026-02-18T00:57:30.411 INFO:tasks.workunit.client.0.trial069.stdout: "state": [ 2026-02-18T00:57:30.411 INFO:tasks.workunit.client.0.trial069.stdout: "exists" 2026-02-18T00:57:30.411 INFO:tasks.workunit.client.0.trial069.stdout: ] 2026-02-18T00:57:30.411 INFO:tasks.workunit.client.0.trial069.stdout: } 2026-02-18T00:57:30.411 INFO:tasks.workunit.client.0.trial069.stdout: ], 2026-02-18T00:57:30.411 INFO:tasks.workunit.client.0.trial069.stdout: "osd_xinfo": [ 2026-02-18T00:57:30.411 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:57:30.411 INFO:tasks.workunit.client.0.trial069.stdout: "osd": 0, 2026-02-18T00:57:30.411 INFO:tasks.workunit.client.0.trial069.stdout: "down_stamp": "2026-02-18T00:55:57.383145+0000", 2026-02-18T00:57:30.412 INFO:tasks.workunit.client.0.trial069.stdout: "laggy_probability": 0, 2026-02-18T00:57:30.412 INFO:tasks.workunit.client.0.trial069.stdout: "laggy_interval": 0, 2026-02-18T00:57:30.412 INFO:tasks.workunit.client.0.trial069.stdout: "features": 4544132024016699391, 2026-02-18T00:57:30.412 INFO:tasks.workunit.client.0.trial069.stdout: "old_weight": 0, 2026-02-18T00:57:30.412 INFO:tasks.workunit.client.0.trial069.stdout: "last_purged_snaps_scrub": "0.000000", 2026-02-18T00:57:30.412 INFO:tasks.workunit.client.0.trial069.stdout: "dead_epoch": 0 2026-02-18T00:57:30.412 INFO:tasks.workunit.client.0.trial069.stdout: } 2026-02-18T00:57:30.412 INFO:tasks.workunit.client.0.trial069.stdout: ], 2026-02-18T00:57:30.412 INFO:tasks.workunit.client.0.trial069.stdout: "pg_upmap": [], 2026-02-18T00:57:30.412 INFO:tasks.workunit.client.0.trial069.stdout: "pg_upmap_items": [], 2026-02-18T00:57:30.412 INFO:tasks.workunit.client.0.trial069.stdout: "pg_upmap_primaries": [], 2026-02-18T00:57:30.412 INFO:tasks.workunit.client.0.trial069.stdout: "pg_temp": [], 2026-02-18T00:57:30.412 INFO:tasks.workunit.client.0.trial069.stdout: "primary_temp": [], 2026-02-18T00:57:30.412 INFO:tasks.workunit.client.0.trial069.stdout: "blocklist": {}, 2026-02-18T00:57:30.412 INFO:tasks.workunit.client.0.trial069.stdout: "range_blocklist": {}, 2026-02-18T00:57:30.412 INFO:tasks.workunit.client.0.trial069.stdout: "erasure_code_profiles": { 2026-02-18T00:57:30.412 INFO:tasks.workunit.client.0.trial069.stdout: "default": { 2026-02-18T00:57:30.412 INFO:tasks.workunit.client.0.trial069.stdout: "k": "2", 2026-02-18T00:57:30.412 INFO:tasks.workunit.client.0.trial069.stdout: "m": "2", 2026-02-18T00:57:30.412 INFO:tasks.workunit.client.0.trial069.stdout: "plugin": "isa", 2026-02-18T00:57:30.413 INFO:tasks.workunit.client.0.trial069.stdout: "technique": "reed_sol_van" 2026-02-18T00:57:30.413 INFO:tasks.workunit.client.0.trial069.stdout: } 2026-02-18T00:57:30.413 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:57:30.413 INFO:tasks.workunit.client.0.trial069.stdout: "removed_snaps_queue": [], 2026-02-18T00:57:30.413 INFO:tasks.workunit.client.0.trial069.stdout: "new_removed_snaps": [], 2026-02-18T00:57:30.413 INFO:tasks.workunit.client.0.trial069.stdout: "new_purged_snaps": [], 2026-02-18T00:57:30.413 INFO:tasks.workunit.client.0.trial069.stdout: "crush_node_flags": {}, 2026-02-18T00:57:30.413 INFO:tasks.workunit.client.0.trial069.stdout: "device_class_flags": {}, 2026-02-18T00:57:30.413 INFO:tasks.workunit.client.0.trial069.stdout: "stretch_mode": { 2026-02-18T00:57:30.413 INFO:tasks.workunit.client.0.trial069.stdout: "stretch_mode_enabled": false, 2026-02-18T00:57:30.413 INFO:tasks.workunit.client.0.trial069.stdout: "stretch_bucket_count": 0, 2026-02-18T00:57:30.413 INFO:tasks.workunit.client.0.trial069.stdout: "degraded_stretch_mode": 0, 2026-02-18T00:57:30.413 INFO:tasks.workunit.client.0.trial069.stdout: "recovering_stretch_mode": 0, 2026-02-18T00:57:30.413 INFO:tasks.workunit.client.0.trial069.stdout: "stretch_mode_bucket": 0 2026-02-18T00:57:30.413 INFO:tasks.workunit.client.0.trial069.stdout: } 2026-02-18T00:57:30.413 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:57:30.413 INFO:tasks.workunit.client.0.trial069.stdout: "osd_metadata": [ 2026-02-18T00:57:30.413 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:57:30.413 INFO:tasks.workunit.client.0.trial069.stdout: "id": 0, 2026-02-18T00:57:30.413 INFO:tasks.workunit.client.0.trial069.stdout: "arch": "x86_64", 2026-02-18T00:57:30.414 INFO:tasks.workunit.client.0.trial069.stdout: "back_addr": "[v2:127.0.0.1:6802/2446608286,v1:127.0.0.1:6803/2446608286]", 2026-02-18T00:57:30.414 INFO:tasks.workunit.client.0.trial069.stdout: "back_iface": "", 2026-02-18T00:57:30.414 INFO:tasks.workunit.client.0.trial069.stdout: "bluefs": "1", 2026-02-18T00:57:30.414 INFO:tasks.workunit.client.0.trial069.stdout: "bluefs_dedicated_db": "0", 2026-02-18T00:57:30.414 INFO:tasks.workunit.client.0.trial069.stdout: "bluefs_dedicated_wal": "0", 2026-02-18T00:57:30.414 INFO:tasks.workunit.client.0.trial069.stdout: "bluefs_single_shared_device": "1", 2026-02-18T00:57:30.414 INFO:tasks.workunit.client.0.trial069.stdout: "bluestore_allocation_from_file": "1", 2026-02-18T00:57:30.414 INFO:tasks.workunit.client.0.trial069.stdout: "bluestore_allocator": "hybrid", 2026-02-18T00:57:30.414 INFO:tasks.workunit.client.0.trial069.stdout: "bluestore_bdev_access_mode": "file", 2026-02-18T00:57:30.414 INFO:tasks.workunit.client.0.trial069.stdout: "bluestore_bdev_block_size": "4096", 2026-02-18T00:57:30.414 INFO:tasks.workunit.client.0.trial069.stdout: "bluestore_bdev_devices": "nvme0n1", 2026-02-18T00:57:30.414 INFO:tasks.workunit.client.0.trial069.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-18T00:57:30.414 INFO:tasks.workunit.client.0.trial069.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-18T00:57:30.414 INFO:tasks.workunit.client.0.trial069.stdout: "bluestore_bdev_path": "td/ceph-helpers/0/block", 2026-02-18T00:57:30.414 INFO:tasks.workunit.client.0.trial069.stdout: "bluestore_bdev_rotational": "0", 2026-02-18T00:57:30.414 INFO:tasks.workunit.client.0.trial069.stdout: "bluestore_bdev_size": "107374182400", 2026-02-18T00:57:30.414 INFO:tasks.workunit.client.0.trial069.stdout: "bluestore_bdev_support_discard": "1", 2026-02-18T00:57:30.414 INFO:tasks.workunit.client.0.trial069.stdout: "bluestore_bdev_type": "ssd", 2026-02-18T00:57:30.414 INFO:tasks.workunit.client.0.trial069.stdout: "bluestore_min_alloc_size": "4096", 2026-02-18T00:57:30.414 INFO:tasks.workunit.client.0.trial069.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-18T00:57:30.415 INFO:tasks.workunit.client.0.trial069.stdout: "bluestore_write_mode": "classic", 2026-02-18T00:57:30.415 INFO:tasks.workunit.client.0.trial069.stdout: "ceph_release": "tentacle", 2026-02-18T00:57:30.415 INFO:tasks.workunit.client.0.trial069.stdout: "ceph_version": "ceph version 20.2.0-670-gadc19233 (adc1923395f2bcd6ae89b5d331d278364d1848ed) tentacle (stable - None)", 2026-02-18T00:57:30.415 INFO:tasks.workunit.client.0.trial069.stdout: "ceph_version_short": "20.2.0-670-gadc19233", 2026-02-18T00:57:30.415 INFO:tasks.workunit.client.0.trial069.stdout: "ceph_version_when_created": "ceph version 20.2.0-670-gadc19233 (adc1923395f2bcd6ae89b5d331d278364d1848ed) tentacle (stable - None)", 2026-02-18T00:57:30.415 INFO:tasks.workunit.client.0.trial069.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-18T00:57:30.415 INFO:tasks.workunit.client.0.trial069.stdout: "created_at": "2026-02-18T00:40:53.316332Z", 2026-02-18T00:57:30.415 INFO:tasks.workunit.client.0.trial069.stdout: "default_device_class": "ssd", 2026-02-18T00:57:30.415 INFO:tasks.workunit.client.0.trial069.stdout: "device_ids": "nvme0n1=Micron_7450_MTFDKBA960TFR_25174FCD463C", 2026-02-18T00:57:30.415 INFO:tasks.workunit.client.0.trial069.stdout: "device_paths": "nvme0n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-18T00:57:30.415 INFO:tasks.workunit.client.0.trial069.stdout: "devices": "nvme0n1", 2026-02-18T00:57:30.415 INFO:tasks.workunit.client.0.trial069.stdout: "distro": "ubuntu", 2026-02-18T00:57:30.415 INFO:tasks.workunit.client.0.trial069.stdout: "distro_description": "Ubuntu 22.04.5 LTS", 2026-02-18T00:57:30.415 INFO:tasks.workunit.client.0.trial069.stdout: "distro_version": "22.04", 2026-02-18T00:57:30.415 INFO:tasks.workunit.client.0.trial069.stdout: "front_addr": "[v2:127.0.0.1:6800/2446608286,v1:127.0.0.1:6801/2446608286]", 2026-02-18T00:57:30.415 INFO:tasks.workunit.client.0.trial069.stdout: "front_iface": "", 2026-02-18T00:57:30.415 INFO:tasks.workunit.client.0.trial069.stdout: "hb_back_addr": "[v2:127.0.0.1:6806/2446608286,v1:127.0.0.1:6807/2446608286]", 2026-02-18T00:57:30.415 INFO:tasks.workunit.client.0.trial069.stdout: "hb_front_addr": "[v2:127.0.0.1:6804/2446608286,v1:127.0.0.1:6805/2446608286]", 2026-02-18T00:57:30.415 INFO:tasks.workunit.client.0.trial069.stdout: "hostname": "trial069", 2026-02-18T00:57:30.415 INFO:tasks.workunit.client.0.trial069.stdout: "journal_rotational": "0", 2026-02-18T00:57:30.416 INFO:tasks.workunit.client.0.trial069.stdout: "kernel_description": "#180-Ubuntu SMP Fri Jan 9 16:10:31 UTC 2026", 2026-02-18T00:57:30.416 INFO:tasks.workunit.client.0.trial069.stdout: "kernel_version": "5.15.0-170-generic", 2026-02-18T00:57:30.416 INFO:tasks.workunit.client.0.trial069.stdout: "mem_swap_kb": "8388604", 2026-02-18T00:57:30.416 INFO:tasks.workunit.client.0.trial069.stdout: "mem_total_kb": "130961700", 2026-02-18T00:57:30.416 INFO:tasks.workunit.client.0.trial069.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-18T00:57:30.416 INFO:tasks.workunit.client.0.trial069.stdout: "objectstore_numa_node": "0", 2026-02-18T00:57:30.416 INFO:tasks.workunit.client.0.trial069.stdout: "objectstore_numa_nodes": "0", 2026-02-18T00:57:30.416 INFO:tasks.workunit.client.0.trial069.stdout: "os": "Linux", 2026-02-18T00:57:30.416 INFO:tasks.workunit.client.0.trial069.stdout: "osd_data": "td/ceph-helpers/0", 2026-02-18T00:57:30.416 INFO:tasks.workunit.client.0.trial069.stdout: "osd_objectstore": "bluestore", 2026-02-18T00:57:30.416 INFO:tasks.workunit.client.0.trial069.stdout: "osdspec_affinity": "", 2026-02-18T00:57:30.416 INFO:tasks.workunit.client.0.trial069.stdout: "rotational": "0" 2026-02-18T00:57:30.416 INFO:tasks.workunit.client.0.trial069.stdout: } 2026-02-18T00:57:30.416 INFO:tasks.workunit.client.0.trial069.stdout: ], 2026-02-18T00:57:30.416 INFO:tasks.workunit.client.0.trial069.stdout: "osdmap_clean_epochs": { 2026-02-18T00:57:30.416 INFO:tasks.workunit.client.0.trial069.stdout: "min_last_epoch_clean": 0, 2026-02-18T00:57:30.416 INFO:tasks.workunit.client.0.trial069.stdout: "last_epoch_clean": { 2026-02-18T00:57:30.416 INFO:tasks.workunit.client.0.trial069.stdout: "per_pool": [] 2026-02-18T00:57:30.416 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:57:30.416 INFO:tasks.workunit.client.0.trial069.stdout: "osd_epochs": [] 2026-02-18T00:57:30.417 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:57:30.417 INFO:tasks.workunit.client.0.trial069.stdout: "osdmap_first_committed": 1, 2026-02-18T00:57:30.417 INFO:tasks.workunit.client.0.trial069.stdout: "osdmap_last_committed": 13, 2026-02-18T00:57:30.417 INFO:tasks.workunit.client.0.trial069.stdout: "crushmap": { 2026-02-18T00:57:30.417 INFO:tasks.workunit.client.0.trial069.stdout: "devices": [ 2026-02-18T00:57:30.417 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:57:30.417 INFO:tasks.workunit.client.0.trial069.stdout: "id": 0, 2026-02-18T00:57:30.417 INFO:tasks.workunit.client.0.trial069.stdout: "name": "osd.0", 2026-02-18T00:57:30.417 INFO:tasks.workunit.client.0.trial069.stdout: "class": "ssd" 2026-02-18T00:57:30.417 INFO:tasks.workunit.client.0.trial069.stdout: } 2026-02-18T00:57:30.417 INFO:tasks.workunit.client.0.trial069.stdout: ], 2026-02-18T00:57:30.417 INFO:tasks.workunit.client.0.trial069.stdout: "types": [ 2026-02-18T00:57:30.417 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:57:30.417 INFO:tasks.workunit.client.0.trial069.stdout: "type_id": 0, 2026-02-18T00:57:30.417 INFO:tasks.workunit.client.0.trial069.stdout: "name": "osd" 2026-02-18T00:57:30.417 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:57:30.417 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:57:30.417 INFO:tasks.workunit.client.0.trial069.stdout: "type_id": 1, 2026-02-18T00:57:30.417 INFO:tasks.workunit.client.0.trial069.stdout: "name": "host" 2026-02-18T00:57:30.418 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:57:30.418 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:57:30.418 INFO:tasks.workunit.client.0.trial069.stdout: "type_id": 2, 2026-02-18T00:57:30.418 INFO:tasks.workunit.client.0.trial069.stdout: "name": "chassis" 2026-02-18T00:57:30.418 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:57:30.418 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:57:30.418 INFO:tasks.workunit.client.0.trial069.stdout: "type_id": 3, 2026-02-18T00:57:30.418 INFO:tasks.workunit.client.0.trial069.stdout: "name": "rack" 2026-02-18T00:57:30.418 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:57:30.418 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:57:30.418 INFO:tasks.workunit.client.0.trial069.stdout: "type_id": 4, 2026-02-18T00:57:30.418 INFO:tasks.workunit.client.0.trial069.stdout: "name": "row" 2026-02-18T00:57:30.418 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:57:30.418 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:57:30.418 INFO:tasks.workunit.client.0.trial069.stdout: "type_id": 5, 2026-02-18T00:57:30.418 INFO:tasks.workunit.client.0.trial069.stdout: "name": "pdu" 2026-02-18T00:57:30.418 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:57:30.418 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:57:30.418 INFO:tasks.workunit.client.0.trial069.stdout: "type_id": 6, 2026-02-18T00:57:30.419 INFO:tasks.workunit.client.0.trial069.stdout: "name": "pod" 2026-02-18T00:57:30.419 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:57:30.419 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:57:30.419 INFO:tasks.workunit.client.0.trial069.stdout: "type_id": 7, 2026-02-18T00:57:30.419 INFO:tasks.workunit.client.0.trial069.stdout: "name": "room" 2026-02-18T00:57:30.419 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:57:30.419 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:57:30.419 INFO:tasks.workunit.client.0.trial069.stdout: "type_id": 8, 2026-02-18T00:57:30.419 INFO:tasks.workunit.client.0.trial069.stdout: "name": "datacenter" 2026-02-18T00:57:30.419 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:57:30.419 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:57:30.419 INFO:tasks.workunit.client.0.trial069.stdout: "type_id": 9, 2026-02-18T00:57:30.419 INFO:tasks.workunit.client.0.trial069.stdout: "name": "zone" 2026-02-18T00:57:30.419 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:57:30.419 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:57:30.419 INFO:tasks.workunit.client.0.trial069.stdout: "type_id": 10, 2026-02-18T00:57:30.419 INFO:tasks.workunit.client.0.trial069.stdout: "name": "region" 2026-02-18T00:57:30.419 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:57:30.419 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:57:30.420 INFO:tasks.workunit.client.0.trial069.stdout: "type_id": 11, 2026-02-18T00:57:30.420 INFO:tasks.workunit.client.0.trial069.stdout: "name": "root" 2026-02-18T00:57:30.420 INFO:tasks.workunit.client.0.trial069.stdout: } 2026-02-18T00:57:30.420 INFO:tasks.workunit.client.0.trial069.stdout: ], 2026-02-18T00:57:30.420 INFO:tasks.workunit.client.0.trial069.stdout: "buckets": [ 2026-02-18T00:57:30.420 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:57:30.420 INFO:tasks.workunit.client.0.trial069.stdout: "id": -1, 2026-02-18T00:57:30.420 INFO:tasks.workunit.client.0.trial069.stdout: "name": "default", 2026-02-18T00:57:30.420 INFO:tasks.workunit.client.0.trial069.stdout: "type_id": 11, 2026-02-18T00:57:30.420 INFO:tasks.workunit.client.0.trial069.stdout: "type_name": "root", 2026-02-18T00:57:30.420 INFO:tasks.workunit.client.0.trial069.stdout: "weight": 6402, 2026-02-18T00:57:30.420 INFO:tasks.workunit.client.0.trial069.stdout: "alg": "straw2", 2026-02-18T00:57:30.420 INFO:tasks.workunit.client.0.trial069.stdout: "hash": "rjenkins1", 2026-02-18T00:57:30.420 INFO:tasks.workunit.client.0.trial069.stdout: "items": [ 2026-02-18T00:57:30.420 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:57:30.420 INFO:tasks.workunit.client.0.trial069.stdout: "id": -3, 2026-02-18T00:57:30.420 INFO:tasks.workunit.client.0.trial069.stdout: "weight": 6402, 2026-02-18T00:57:30.420 INFO:tasks.workunit.client.0.trial069.stdout: "pos": 0 2026-02-18T00:57:30.420 INFO:tasks.workunit.client.0.trial069.stdout: } 2026-02-18T00:57:30.421 INFO:tasks.workunit.client.0.trial069.stdout: ] 2026-02-18T00:57:30.421 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:57:30.421 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:57:30.421 INFO:tasks.workunit.client.0.trial069.stdout: "id": -2, 2026-02-18T00:57:30.421 INFO:tasks.workunit.client.0.trial069.stdout: "name": "default~ssd", 2026-02-18T00:57:30.421 INFO:tasks.workunit.client.0.trial069.stdout: "type_id": 11, 2026-02-18T00:57:30.421 INFO:tasks.workunit.client.0.trial069.stdout: "type_name": "root", 2026-02-18T00:57:30.421 INFO:tasks.workunit.client.0.trial069.stdout: "weight": 6402, 2026-02-18T00:57:30.421 INFO:tasks.workunit.client.0.trial069.stdout: "alg": "straw2", 2026-02-18T00:57:30.421 INFO:tasks.workunit.client.0.trial069.stdout: "hash": "rjenkins1", 2026-02-18T00:57:30.421 INFO:tasks.workunit.client.0.trial069.stdout: "items": [ 2026-02-18T00:57:30.421 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:57:30.421 INFO:tasks.workunit.client.0.trial069.stdout: "id": -4, 2026-02-18T00:57:30.421 INFO:tasks.workunit.client.0.trial069.stdout: "weight": 6402, 2026-02-18T00:57:30.422 INFO:tasks.workunit.client.0.trial069.stdout: "pos": 0 2026-02-18T00:57:30.422 INFO:tasks.workunit.client.0.trial069.stdout: } 2026-02-18T00:57:30.422 INFO:tasks.workunit.client.0.trial069.stdout: ] 2026-02-18T00:57:30.422 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:57:30.422 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:57:30.422 INFO:tasks.workunit.client.0.trial069.stdout: "id": -3, 2026-02-18T00:57:30.422 INFO:tasks.workunit.client.0.trial069.stdout: "name": "trial069", 2026-02-18T00:57:30.422 INFO:tasks.workunit.client.0.trial069.stdout: "type_id": 1, 2026-02-18T00:57:30.422 INFO:tasks.workunit.client.0.trial069.stdout: "type_name": "host", 2026-02-18T00:57:30.422 INFO:tasks.workunit.client.0.trial069.stdout: "weight": 6402, 2026-02-18T00:57:30.422 INFO:tasks.workunit.client.0.trial069.stdout: "alg": "straw2", 2026-02-18T00:57:30.422 INFO:tasks.workunit.client.0.trial069.stdout: "hash": "rjenkins1", 2026-02-18T00:57:30.423 INFO:tasks.workunit.client.0.trial069.stdout: "items": [ 2026-02-18T00:57:30.423 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:57:30.423 INFO:tasks.workunit.client.0.trial069.stdout: "id": 0, 2026-02-18T00:57:30.423 INFO:tasks.workunit.client.0.trial069.stdout: "weight": 6402, 2026-02-18T00:57:30.423 INFO:tasks.workunit.client.0.trial069.stdout: "pos": 0 2026-02-18T00:57:30.423 INFO:tasks.workunit.client.0.trial069.stdout: } 2026-02-18T00:57:30.423 INFO:tasks.workunit.client.0.trial069.stdout: ] 2026-02-18T00:57:30.423 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:57:30.423 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:57:30.423 INFO:tasks.workunit.client.0.trial069.stdout: "id": -4, 2026-02-18T00:57:30.423 INFO:tasks.workunit.client.0.trial069.stdout: "name": "trial069~ssd", 2026-02-18T00:57:30.423 INFO:tasks.workunit.client.0.trial069.stdout: "type_id": 1, 2026-02-18T00:57:30.423 INFO:tasks.workunit.client.0.trial069.stdout: "type_name": "host", 2026-02-18T00:57:30.424 INFO:tasks.workunit.client.0.trial069.stdout: "weight": 6402, 2026-02-18T00:57:30.424 INFO:tasks.workunit.client.0.trial069.stdout: "alg": "straw2", 2026-02-18T00:57:30.424 INFO:tasks.workunit.client.0.trial069.stdout: "hash": "rjenkins1", 2026-02-18T00:57:30.424 INFO:tasks.workunit.client.0.trial069.stdout: "items": [ 2026-02-18T00:57:30.424 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:57:30.424 INFO:tasks.workunit.client.0.trial069.stdout: "id": 0, 2026-02-18T00:57:30.424 INFO:tasks.workunit.client.0.trial069.stdout: "weight": 6402, 2026-02-18T00:57:30.424 INFO:tasks.workunit.client.0.trial069.stdout: "pos": 0 2026-02-18T00:57:30.424 INFO:tasks.workunit.client.0.trial069.stdout: } 2026-02-18T00:57:30.424 INFO:tasks.workunit.client.0.trial069.stdout: ] 2026-02-18T00:57:30.424 INFO:tasks.workunit.client.0.trial069.stdout: } 2026-02-18T00:57:30.424 INFO:tasks.workunit.client.0.trial069.stdout: ], 2026-02-18T00:57:30.424 INFO:tasks.workunit.client.0.trial069.stdout: "rules": [ 2026-02-18T00:57:30.425 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:57:30.425 INFO:tasks.workunit.client.0.trial069.stdout: "rule_id": 0, 2026-02-18T00:57:30.425 INFO:tasks.workunit.client.0.trial069.stdout: "rule_name": "replicated_rule", 2026-02-18T00:57:30.425 INFO:tasks.workunit.client.0.trial069.stdout: "type": 1, 2026-02-18T00:57:30.425 INFO:tasks.workunit.client.0.trial069.stdout: "steps": [ 2026-02-18T00:57:30.425 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:57:30.425 INFO:tasks.workunit.client.0.trial069.stdout: "op": "take", 2026-02-18T00:57:30.425 INFO:tasks.workunit.client.0.trial069.stdout: "item": -1, 2026-02-18T00:57:30.425 INFO:tasks.workunit.client.0.trial069.stdout: "item_name": "default" 2026-02-18T00:57:30.425 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:57:30.425 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:57:30.425 INFO:tasks.workunit.client.0.trial069.stdout: "op": "choose_firstn", 2026-02-18T00:57:30.426 INFO:tasks.workunit.client.0.trial069.stdout: "num": 0, 2026-02-18T00:57:30.426 INFO:tasks.workunit.client.0.trial069.stdout: "type": "osd" 2026-02-18T00:57:30.426 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:57:30.426 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:57:30.426 INFO:tasks.workunit.client.0.trial069.stdout: "op": "emit" 2026-02-18T00:57:30.426 INFO:tasks.workunit.client.0.trial069.stdout: } 2026-02-18T00:57:30.426 INFO:tasks.workunit.client.0.trial069.stdout: ] 2026-02-18T00:57:30.426 INFO:tasks.workunit.client.0.trial069.stdout: } 2026-02-18T00:57:30.426 INFO:tasks.workunit.client.0.trial069.stdout: ], 2026-02-18T00:57:30.426 INFO:tasks.workunit.client.0.trial069.stdout: "tunables": { 2026-02-18T00:57:30.426 INFO:tasks.workunit.client.0.trial069.stdout: "choose_local_tries": 0, 2026-02-18T00:57:30.426 INFO:tasks.workunit.client.0.trial069.stdout: "choose_local_fallback_tries": 0, 2026-02-18T00:57:30.426 INFO:tasks.workunit.client.0.trial069.stdout: "choose_total_tries": 50, 2026-02-18T00:57:30.427 INFO:tasks.workunit.client.0.trial069.stdout: "chooseleaf_descend_once": 1, 2026-02-18T00:57:30.427 INFO:tasks.workunit.client.0.trial069.stdout: "chooseleaf_vary_r": 1, 2026-02-18T00:57:30.427 INFO:tasks.workunit.client.0.trial069.stdout: "chooseleaf_stable": 1, 2026-02-18T00:57:30.427 INFO:tasks.workunit.client.0.trial069.stdout: "msr_descents": 100, 2026-02-18T00:57:30.427 INFO:tasks.workunit.client.0.trial069.stdout: "msr_collision_tries": 100, 2026-02-18T00:57:30.427 INFO:tasks.workunit.client.0.trial069.stdout: "straw_calc_version": 1, 2026-02-18T00:57:30.427 INFO:tasks.workunit.client.0.trial069.stdout: "allowed_bucket_algs": 54, 2026-02-18T00:57:30.427 INFO:tasks.workunit.client.0.trial069.stdout: "profile": "jewel", 2026-02-18T00:57:30.427 INFO:tasks.workunit.client.0.trial069.stdout: "optimal_tunables": 1, 2026-02-18T00:57:30.427 INFO:tasks.workunit.client.0.trial069.stdout: "legacy_tunables": 0, 2026-02-18T00:57:30.427 INFO:tasks.workunit.client.0.trial069.stdout: "minimum_required_version": "jewel", 2026-02-18T00:57:30.427 INFO:tasks.workunit.client.0.trial069.stdout: "require_feature_tunables": 1, 2026-02-18T00:57:30.427 INFO:tasks.workunit.client.0.trial069.stdout: "require_feature_tunables2": 1, 2026-02-18T00:57:30.428 INFO:tasks.workunit.client.0.trial069.stdout: "has_v2_rules": 0, 2026-02-18T00:57:30.428 INFO:tasks.workunit.client.0.trial069.stdout: "require_feature_tunables3": 1, 2026-02-18T00:57:30.428 INFO:tasks.workunit.client.0.trial069.stdout: "has_v3_rules": 0, 2026-02-18T00:57:30.428 INFO:tasks.workunit.client.0.trial069.stdout: "has_v4_buckets": 1, 2026-02-18T00:57:30.428 INFO:tasks.workunit.client.0.trial069.stdout: "require_feature_tunables5": 1, 2026-02-18T00:57:30.428 INFO:tasks.workunit.client.0.trial069.stdout: "has_v5_rules": 0, 2026-02-18T00:57:30.428 INFO:tasks.workunit.client.0.trial069.stdout: "has_msr_rules": 0 2026-02-18T00:57:30.428 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:57:30.428 INFO:tasks.workunit.client.0.trial069.stdout: "choose_args": {} 2026-02-18T00:57:30.428 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:57:30.428 INFO:tasks.workunit.client.0.trial069.stdout: "fsmap": { 2026-02-18T00:57:30.428 INFO:tasks.workunit.client.0.trial069.stdout: "epoch": 1, 2026-02-18T00:57:30.429 INFO:tasks.workunit.client.0.trial069.stdout: "btime": "2026-02-18T00:40:52:388928+0000", 2026-02-18T00:57:30.429 INFO:tasks.workunit.client.0.trial069.stdout: "default_fscid": -1, 2026-02-18T00:57:30.429 INFO:tasks.workunit.client.0.trial069.stdout: "compat": { 2026-02-18T00:57:30.429 INFO:tasks.workunit.client.0.trial069.stdout: "compat": {}, 2026-02-18T00:57:30.429 INFO:tasks.workunit.client.0.trial069.stdout: "ro_compat": {}, 2026-02-18T00:57:30.429 INFO:tasks.workunit.client.0.trial069.stdout: "incompat": { 2026-02-18T00:57:30.429 INFO:tasks.workunit.client.0.trial069.stdout: "feature_1": "base v0.20", 2026-02-18T00:57:30.429 INFO:tasks.workunit.client.0.trial069.stdout: "feature_2": "client writeable ranges", 2026-02-18T00:57:30.429 INFO:tasks.workunit.client.0.trial069.stdout: "feature_3": "default file layouts on dirs", 2026-02-18T00:57:30.429 INFO:tasks.workunit.client.0.trial069.stdout: "feature_4": "dir inode in separate object", 2026-02-18T00:57:30.429 INFO:tasks.workunit.client.0.trial069.stdout: "feature_5": "mds uses versioned encoding", 2026-02-18T00:57:30.429 INFO:tasks.workunit.client.0.trial069.stdout: "feature_6": "dirfrag is stored in omap", 2026-02-18T00:57:30.430 INFO:tasks.workunit.client.0.trial069.stdout: "feature_8": "no anchor table", 2026-02-18T00:57:30.430 INFO:tasks.workunit.client.0.trial069.stdout: "feature_9": "file layout v2", 2026-02-18T00:57:30.430 INFO:tasks.workunit.client.0.trial069.stdout: "feature_10": "snaprealm v2", 2026-02-18T00:57:30.430 INFO:tasks.workunit.client.0.trial069.stdout: "feature_11": "minor log segments", 2026-02-18T00:57:30.430 INFO:tasks.workunit.client.0.trial069.stdout: "feature_12": "quiesce subvolumes" 2026-02-18T00:57:30.430 INFO:tasks.workunit.client.0.trial069.stdout: } 2026-02-18T00:57:30.430 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:57:30.430 INFO:tasks.workunit.client.0.trial069.stdout: "feature_flags": { 2026-02-18T00:57:30.430 INFO:tasks.workunit.client.0.trial069.stdout: "enable_multiple": true, 2026-02-18T00:57:30.430 INFO:tasks.workunit.client.0.trial069.stdout: "ever_enabled_multiple": true 2026-02-18T00:57:30.430 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:57:30.430 INFO:tasks.workunit.client.0.trial069.stdout: "standbys": [], 2026-02-18T00:57:30.430 INFO:tasks.workunit.client.0.trial069.stdout: "filesystems": [] 2026-02-18T00:57:30.431 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:57:30.431 INFO:tasks.workunit.client.0.trial069.stdout: "mdsmap_first_committed": 1, 2026-02-18T00:57:30.431 INFO:tasks.workunit.client.0.trial069.stdout: "mdsmap_last_committed": 1, 2026-02-18T00:57:30.431 INFO:tasks.workunit.client.0.trial069.stdout: "auth": { 2026-02-18T00:57:30.431 INFO:tasks.workunit.client.0.trial069.stdout: "first_committed": 1, 2026-02-18T00:57:30.431 INFO:tasks.workunit.client.0.trial069.stdout: "last_committed": 3, 2026-02-18T00:57:30.431 INFO:tasks.workunit.client.0.trial069.stdout: "num_secrets": 1 2026-02-18T00:57:30.431 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:57:30.431 INFO:tasks.workunit.client.0.trial069.stdout: "num_pg": 4, 2026-02-18T00:57:30.431 INFO:tasks.workunit.client.0.trial069.stdout: "num_pg_active": 4, 2026-02-18T00:57:30.431 INFO:tasks.workunit.client.0.trial069.stdout: "num_pg_unknown": 0, 2026-02-18T00:57:30.431 INFO:tasks.workunit.client.0.trial069.stdout: "num_osd": 1, 2026-02-18T00:57:30.431 INFO:tasks.workunit.client.0.trial069.stdout: "pool_sum": { 2026-02-18T00:57:30.432 INFO:tasks.workunit.client.0.trial069.stdout: "stat_sum": { 2026-02-18T00:57:30.432 INFO:tasks.workunit.client.0.trial069.stdout: "num_bytes": 19, 2026-02-18T00:57:30.432 INFO:tasks.workunit.client.0.trial069.stdout: "num_objects": 2, 2026-02-18T00:57:30.432 INFO:tasks.workunit.client.0.trial069.stdout: "num_object_clones": 0, 2026-02-18T00:57:30.432 INFO:tasks.workunit.client.0.trial069.stdout: "num_object_copies": 2, 2026-02-18T00:57:30.432 INFO:tasks.workunit.client.0.trial069.stdout: "num_objects_missing_on_primary": 0, 2026-02-18T00:57:30.432 INFO:tasks.workunit.client.0.trial069.stdout: "num_objects_missing": 0, 2026-02-18T00:57:30.432 INFO:tasks.workunit.client.0.trial069.stdout: "num_objects_degraded": 0, 2026-02-18T00:57:30.432 INFO:tasks.workunit.client.0.trial069.stdout: "num_objects_misplaced": 0, 2026-02-18T00:57:30.432 INFO:tasks.workunit.client.0.trial069.stdout: "num_objects_unfound": 0, 2026-02-18T00:57:30.432 INFO:tasks.workunit.client.0.trial069.stdout: "num_objects_dirty": 2, 2026-02-18T00:57:30.432 INFO:tasks.workunit.client.0.trial069.stdout: "num_whiteouts": 0, 2026-02-18T00:57:30.432 INFO:tasks.workunit.client.0.trial069.stdout: "num_read": 0, 2026-02-18T00:57:30.433 INFO:tasks.workunit.client.0.trial069.stdout: "num_read_kb": 0, 2026-02-18T00:57:30.433 INFO:tasks.workunit.client.0.trial069.stdout: "num_write": 2, 2026-02-18T00:57:30.433 INFO:tasks.workunit.client.0.trial069.stdout: "num_write_kb": 2, 2026-02-18T00:57:30.433 INFO:tasks.workunit.client.0.trial069.stdout: "num_scrub_errors": 0, 2026-02-18T00:57:30.433 INFO:tasks.workunit.client.0.trial069.stdout: "num_shallow_scrub_errors": 0, 2026-02-18T00:57:30.433 INFO:tasks.workunit.client.0.trial069.stdout: "num_deep_scrub_errors": 0, 2026-02-18T00:57:30.433 INFO:tasks.workunit.client.0.trial069.stdout: "num_objects_recovered": 0, 2026-02-18T00:57:30.433 INFO:tasks.workunit.client.0.trial069.stdout: "num_bytes_recovered": 0, 2026-02-18T00:57:30.433 INFO:tasks.workunit.client.0.trial069.stdout: "num_keys_recovered": 0, 2026-02-18T00:57:30.433 INFO:tasks.workunit.client.0.trial069.stdout: "num_objects_omap": 0, 2026-02-18T00:57:30.433 INFO:tasks.workunit.client.0.trial069.stdout: "num_objects_hit_set_archive": 0, 2026-02-18T00:57:30.433 INFO:tasks.workunit.client.0.trial069.stdout: "num_bytes_hit_set_archive": 0, 2026-02-18T00:57:30.433 INFO:tasks.workunit.client.0.trial069.stdout: "num_flush": 0, 2026-02-18T00:57:30.433 INFO:tasks.workunit.client.0.trial069.stdout: "num_flush_kb": 0, 2026-02-18T00:57:30.434 INFO:tasks.workunit.client.0.trial069.stdout: "num_evict": 0, 2026-02-18T00:57:30.434 INFO:tasks.workunit.client.0.trial069.stdout: "num_evict_kb": 0, 2026-02-18T00:57:30.434 INFO:tasks.workunit.client.0.trial069.stdout: "num_promote": 0, 2026-02-18T00:57:30.434 INFO:tasks.workunit.client.0.trial069.stdout: "num_flush_mode_high": 0, 2026-02-18T00:57:30.434 INFO:tasks.workunit.client.0.trial069.stdout: "num_flush_mode_low": 0, 2026-02-18T00:57:30.434 INFO:tasks.workunit.client.0.trial069.stdout: "num_evict_mode_some": 0, 2026-02-18T00:57:30.434 INFO:tasks.workunit.client.0.trial069.stdout: "num_evict_mode_full": 0, 2026-02-18T00:57:30.434 INFO:tasks.workunit.client.0.trial069.stdout: "num_objects_pinned": 0, 2026-02-18T00:57:30.434 INFO:tasks.workunit.client.0.trial069.stdout: "num_legacy_snapsets": 0, 2026-02-18T00:57:30.434 INFO:tasks.workunit.client.0.trial069.stdout: "num_large_omap_objects": 0, 2026-02-18T00:57:30.434 INFO:tasks.workunit.client.0.trial069.stdout: "num_objects_manifest": 0, 2026-02-18T00:57:30.434 INFO:tasks.workunit.client.0.trial069.stdout: "num_omap_bytes": 0, 2026-02-18T00:57:30.434 INFO:tasks.workunit.client.0.trial069.stdout: "num_omap_keys": 0, 2026-02-18T00:57:30.434 INFO:tasks.workunit.client.0.trial069.stdout: "num_objects_repaired": 0 2026-02-18T00:57:30.434 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:57:30.435 INFO:tasks.workunit.client.0.trial069.stdout: "store_stats": { 2026-02-18T00:57:30.435 INFO:tasks.workunit.client.0.trial069.stdout: "total": 0, 2026-02-18T00:57:30.435 INFO:tasks.workunit.client.0.trial069.stdout: "available": 0, 2026-02-18T00:57:30.435 INFO:tasks.workunit.client.0.trial069.stdout: "internally_reserved": 0, 2026-02-18T00:57:30.435 INFO:tasks.workunit.client.0.trial069.stdout: "allocated": 0, 2026-02-18T00:57:30.435 INFO:tasks.workunit.client.0.trial069.stdout: "data_stored": 0, 2026-02-18T00:57:30.435 INFO:tasks.workunit.client.0.trial069.stdout: "data_compressed": 0, 2026-02-18T00:57:30.435 INFO:tasks.workunit.client.0.trial069.stdout: "data_compressed_allocated": 0, 2026-02-18T00:57:30.435 INFO:tasks.workunit.client.0.trial069.stdout: "data_compressed_original": 0, 2026-02-18T00:57:30.435 INFO:tasks.workunit.client.0.trial069.stdout: "omap_allocated": 0, 2026-02-18T00:57:30.435 INFO:tasks.workunit.client.0.trial069.stdout: "internal_metadata": 0 2026-02-18T00:57:30.435 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:57:30.435 INFO:tasks.workunit.client.0.trial069.stdout: "log_size": 3, 2026-02-18T00:57:30.435 INFO:tasks.workunit.client.0.trial069.stdout: "ondisk_log_size": 3, 2026-02-18T00:57:30.435 INFO:tasks.workunit.client.0.trial069.stdout: "up": 4, 2026-02-18T00:57:30.435 INFO:tasks.workunit.client.0.trial069.stdout: "acting": 4, 2026-02-18T00:57:30.436 INFO:tasks.workunit.client.0.trial069.stdout: "num_store_stats": 0 2026-02-18T00:57:30.436 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:57:30.436 INFO:tasks.workunit.client.0.trial069.stdout: "osd_sum": { 2026-02-18T00:57:30.436 INFO:tasks.workunit.client.0.trial069.stdout: "up_from": 0, 2026-02-18T00:57:30.436 INFO:tasks.workunit.client.0.trial069.stdout: "seq": 0, 2026-02-18T00:57:30.436 INFO:tasks.workunit.client.0.trial069.stdout: "num_pgs": 4, 2026-02-18T00:57:30.436 INFO:tasks.workunit.client.0.trial069.stdout: "num_osds": 1, 2026-02-18T00:57:30.436 INFO:tasks.workunit.client.0.trial069.stdout: "num_per_pool_osds": 1, 2026-02-18T00:57:30.436 INFO:tasks.workunit.client.0.trial069.stdout: "num_per_pool_omap_osds": 1, 2026-02-18T00:57:30.436 INFO:tasks.workunit.client.0.trial069.stdout: "kb": 104857600, 2026-02-18T00:57:30.436 INFO:tasks.workunit.client.0.trial069.stdout: "kb_used": 27068, 2026-02-18T00:57:30.436 INFO:tasks.workunit.client.0.trial069.stdout: "kb_used_data": 108, 2026-02-18T00:57:30.436 INFO:tasks.workunit.client.0.trial069.stdout: "kb_used_omap": 8, 2026-02-18T00:57:30.436 INFO:tasks.workunit.client.0.trial069.stdout: "kb_used_meta": 26935, 2026-02-18T00:57:30.436 INFO:tasks.workunit.client.0.trial069.stdout: "kb_avail": 104830532, 2026-02-18T00:57:30.436 INFO:tasks.workunit.client.0.trial069.stdout: "statfs": { 2026-02-18T00:57:30.436 INFO:tasks.workunit.client.0.trial069.stdout: "total": 107374182400, 2026-02-18T00:57:30.436 INFO:tasks.workunit.client.0.trial069.stdout: "available": 107346464768, 2026-02-18T00:57:30.436 INFO:tasks.workunit.client.0.trial069.stdout: "internally_reserved": 0, 2026-02-18T00:57:30.436 INFO:tasks.workunit.client.0.trial069.stdout: "allocated": 110592, 2026-02-18T00:57:30.436 INFO:tasks.workunit.client.0.trial069.stdout: "data_stored": 23248, 2026-02-18T00:57:30.436 INFO:tasks.workunit.client.0.trial069.stdout: "data_compressed": 0, 2026-02-18T00:57:30.437 INFO:tasks.workunit.client.0.trial069.stdout: "data_compressed_allocated": 0, 2026-02-18T00:57:30.437 INFO:tasks.workunit.client.0.trial069.stdout: "data_compressed_original": 0, 2026-02-18T00:57:30.437 INFO:tasks.workunit.client.0.trial069.stdout: "omap_allocated": 8863, 2026-02-18T00:57:30.437 INFO:tasks.workunit.client.0.trial069.stdout: "internal_metadata": 27581793 2026-02-18T00:57:30.437 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:57:30.437 INFO:tasks.workunit.client.0.trial069.stdout: "hb_peers": [], 2026-02-18T00:57:30.437 INFO:tasks.workunit.client.0.trial069.stdout: "snap_trim_queue_len": 0, 2026-02-18T00:57:30.437 INFO:tasks.workunit.client.0.trial069.stdout: "num_snap_trimming": 0, 2026-02-18T00:57:30.437 INFO:tasks.workunit.client.0.trial069.stdout: "num_shards_repaired": 0, 2026-02-18T00:57:30.437 INFO:tasks.workunit.client.0.trial069.stdout: "op_queue_age_hist": { 2026-02-18T00:57:30.437 INFO:tasks.workunit.client.0.trial069.stdout: "histogram": [], 2026-02-18T00:57:30.437 INFO:tasks.workunit.client.0.trial069.stdout: "upper_bound": 1 2026-02-18T00:57:30.437 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:57:30.437 INFO:tasks.workunit.client.0.trial069.stdout: "perf_stat": { 2026-02-18T00:57:30.437 INFO:tasks.workunit.client.0.trial069.stdout: "commit_latency_ms": 0, 2026-02-18T00:57:30.437 INFO:tasks.workunit.client.0.trial069.stdout: "apply_latency_ms": 0, 2026-02-18T00:57:30.437 INFO:tasks.workunit.client.0.trial069.stdout: "commit_latency_ns": 0, 2026-02-18T00:57:30.437 INFO:tasks.workunit.client.0.trial069.stdout: "apply_latency_ns": 0 2026-02-18T00:57:30.437 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:57:30.437 INFO:tasks.workunit.client.0.trial069.stdout: "alerts": [], 2026-02-18T00:57:30.437 INFO:tasks.workunit.client.0.trial069.stdout: "network_ping_times": [] 2026-02-18T00:57:30.437 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:57:30.437 INFO:tasks.workunit.client.0.trial069.stdout: "osd_sum_by_class": { 2026-02-18T00:57:30.437 INFO:tasks.workunit.client.0.trial069.stdout: "ssd": { 2026-02-18T00:57:30.438 INFO:tasks.workunit.client.0.trial069.stdout: "up_from": 0, 2026-02-18T00:57:30.438 INFO:tasks.workunit.client.0.trial069.stdout: "seq": 0, 2026-02-18T00:57:30.438 INFO:tasks.workunit.client.0.trial069.stdout: "num_pgs": 4, 2026-02-18T00:57:30.438 INFO:tasks.workunit.client.0.trial069.stdout: "num_osds": 1, 2026-02-18T00:57:30.438 INFO:tasks.workunit.client.0.trial069.stdout: "num_per_pool_osds": 1, 2026-02-18T00:57:30.438 INFO:tasks.workunit.client.0.trial069.stdout: "num_per_pool_omap_osds": 1, 2026-02-18T00:57:30.438 INFO:tasks.workunit.client.0.trial069.stdout: "kb": 104857600, 2026-02-18T00:57:30.438 INFO:tasks.workunit.client.0.trial069.stdout: "kb_used": 27068, 2026-02-18T00:57:30.438 INFO:tasks.workunit.client.0.trial069.stdout: "kb_used_data": 108, 2026-02-18T00:57:30.438 INFO:tasks.workunit.client.0.trial069.stdout: "kb_used_omap": 8, 2026-02-18T00:57:30.438 INFO:tasks.workunit.client.0.trial069.stdout: "kb_used_meta": 26935, 2026-02-18T00:57:30.438 INFO:tasks.workunit.client.0.trial069.stdout: "kb_avail": 104830532, 2026-02-18T00:57:30.438 INFO:tasks.workunit.client.0.trial069.stdout: "statfs": { 2026-02-18T00:57:30.438 INFO:tasks.workunit.client.0.trial069.stdout: "total": 107374182400, 2026-02-18T00:57:30.438 INFO:tasks.workunit.client.0.trial069.stdout: "available": 107346464768, 2026-02-18T00:57:30.438 INFO:tasks.workunit.client.0.trial069.stdout: "internally_reserved": 0, 2026-02-18T00:57:30.438 INFO:tasks.workunit.client.0.trial069.stdout: "allocated": 110592, 2026-02-18T00:57:30.438 INFO:tasks.workunit.client.0.trial069.stdout: "data_stored": 23248, 2026-02-18T00:57:30.438 INFO:tasks.workunit.client.0.trial069.stdout: "data_compressed": 0, 2026-02-18T00:57:30.438 INFO:tasks.workunit.client.0.trial069.stdout: "data_compressed_allocated": 0, 2026-02-18T00:57:30.438 INFO:tasks.workunit.client.0.trial069.stdout: "data_compressed_original": 0, 2026-02-18T00:57:30.438 INFO:tasks.workunit.client.0.trial069.stdout: "omap_allocated": 8863, 2026-02-18T00:57:30.438 INFO:tasks.workunit.client.0.trial069.stdout: "internal_metadata": 27581793 2026-02-18T00:57:30.438 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:57:30.439 INFO:tasks.workunit.client.0.trial069.stdout: "hb_peers": [], 2026-02-18T00:57:30.439 INFO:tasks.workunit.client.0.trial069.stdout: "snap_trim_queue_len": 0, 2026-02-18T00:57:30.439 INFO:tasks.workunit.client.0.trial069.stdout: "num_snap_trimming": 0, 2026-02-18T00:57:30.439 INFO:tasks.workunit.client.0.trial069.stdout: "num_shards_repaired": 0, 2026-02-18T00:57:30.439 INFO:tasks.workunit.client.0.trial069.stdout: "op_queue_age_hist": { 2026-02-18T00:57:30.439 INFO:tasks.workunit.client.0.trial069.stdout: "histogram": [], 2026-02-18T00:57:30.439 INFO:tasks.workunit.client.0.trial069.stdout: "upper_bound": 1 2026-02-18T00:57:30.439 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:57:30.439 INFO:tasks.workunit.client.0.trial069.stdout: "perf_stat": { 2026-02-18T00:57:30.439 INFO:tasks.workunit.client.0.trial069.stdout: "commit_latency_ms": 0, 2026-02-18T00:57:30.439 INFO:tasks.workunit.client.0.trial069.stdout: "apply_latency_ms": 0, 2026-02-18T00:57:30.439 INFO:tasks.workunit.client.0.trial069.stdout: "commit_latency_ns": 0, 2026-02-18T00:57:30.439 INFO:tasks.workunit.client.0.trial069.stdout: "apply_latency_ns": 0 2026-02-18T00:57:30.439 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:57:30.439 INFO:tasks.workunit.client.0.trial069.stdout: "alerts": [], 2026-02-18T00:57:30.439 INFO:tasks.workunit.client.0.trial069.stdout: "network_ping_times": [] 2026-02-18T00:57:30.439 INFO:tasks.workunit.client.0.trial069.stdout: } 2026-02-18T00:57:30.439 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:57:30.439 INFO:tasks.workunit.client.0.trial069.stdout: "pool_stats": [ 2026-02-18T00:57:30.439 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:57:30.439 INFO:tasks.workunit.client.0.trial069.stdout: "poolid": 1, 2026-02-18T00:57:30.439 INFO:tasks.workunit.client.0.trial069.stdout: "num_pg": 4, 2026-02-18T00:57:30.439 INFO:tasks.workunit.client.0.trial069.stdout: "stat_sum": { 2026-02-18T00:57:30.439 INFO:tasks.workunit.client.0.trial069.stdout: "num_bytes": 19, 2026-02-18T00:57:30.439 INFO:tasks.workunit.client.0.trial069.stdout: "num_objects": 2, 2026-02-18T00:57:30.440 INFO:tasks.workunit.client.0.trial069.stdout: "num_object_clones": 0, 2026-02-18T00:57:30.440 INFO:tasks.workunit.client.0.trial069.stdout: "num_object_copies": 2, 2026-02-18T00:57:30.440 INFO:tasks.workunit.client.0.trial069.stdout: "num_objects_missing_on_primary": 0, 2026-02-18T00:57:30.440 INFO:tasks.workunit.client.0.trial069.stdout: "num_objects_missing": 0, 2026-02-18T00:57:30.440 INFO:tasks.workunit.client.0.trial069.stdout: "num_objects_degraded": 0, 2026-02-18T00:57:30.440 INFO:tasks.workunit.client.0.trial069.stdout: "num_objects_misplaced": 0, 2026-02-18T00:57:30.440 INFO:tasks.workunit.client.0.trial069.stdout: "num_objects_unfound": 0, 2026-02-18T00:57:30.440 INFO:tasks.workunit.client.0.trial069.stdout: "num_objects_dirty": 2, 2026-02-18T00:57:30.440 INFO:tasks.workunit.client.0.trial069.stdout: "num_whiteouts": 0, 2026-02-18T00:57:30.440 INFO:tasks.workunit.client.0.trial069.stdout: "num_read": 0, 2026-02-18T00:57:30.440 INFO:tasks.workunit.client.0.trial069.stdout: "num_read_kb": 0, 2026-02-18T00:57:30.440 INFO:tasks.workunit.client.0.trial069.stdout: "num_write": 2, 2026-02-18T00:57:30.440 INFO:tasks.workunit.client.0.trial069.stdout: "num_write_kb": 2, 2026-02-18T00:57:30.440 INFO:tasks.workunit.client.0.trial069.stdout: "num_scrub_errors": 0, 2026-02-18T00:57:30.440 INFO:tasks.workunit.client.0.trial069.stdout: "num_shallow_scrub_errors": 0, 2026-02-18T00:57:30.440 INFO:tasks.workunit.client.0.trial069.stdout: "num_deep_scrub_errors": 0, 2026-02-18T00:57:30.440 INFO:tasks.workunit.client.0.trial069.stdout: "num_objects_recovered": 0, 2026-02-18T00:57:30.440 INFO:tasks.workunit.client.0.trial069.stdout: "num_bytes_recovered": 0, 2026-02-18T00:57:30.440 INFO:tasks.workunit.client.0.trial069.stdout: "num_keys_recovered": 0, 2026-02-18T00:57:30.440 INFO:tasks.workunit.client.0.trial069.stdout: "num_objects_omap": 0, 2026-02-18T00:57:30.440 INFO:tasks.workunit.client.0.trial069.stdout: "num_objects_hit_set_archive": 0, 2026-02-18T00:57:30.440 INFO:tasks.workunit.client.0.trial069.stdout: "num_bytes_hit_set_archive": 0, 2026-02-18T00:57:30.440 INFO:tasks.workunit.client.0.trial069.stdout: "num_flush": 0, 2026-02-18T00:57:30.440 INFO:tasks.workunit.client.0.trial069.stdout: "num_flush_kb": 0, 2026-02-18T00:57:30.441 INFO:tasks.workunit.client.0.trial069.stdout: "num_evict": 0, 2026-02-18T00:57:30.441 INFO:tasks.workunit.client.0.trial069.stdout: "num_evict_kb": 0, 2026-02-18T00:57:30.441 INFO:tasks.workunit.client.0.trial069.stdout: "num_promote": 0, 2026-02-18T00:57:30.441 INFO:tasks.workunit.client.0.trial069.stdout: "num_flush_mode_high": 0, 2026-02-18T00:57:30.441 INFO:tasks.workunit.client.0.trial069.stdout: "num_flush_mode_low": 0, 2026-02-18T00:57:30.441 INFO:tasks.workunit.client.0.trial069.stdout: "num_evict_mode_some": 0, 2026-02-18T00:57:30.441 INFO:tasks.workunit.client.0.trial069.stdout: "num_evict_mode_full": 0, 2026-02-18T00:57:30.441 INFO:tasks.workunit.client.0.trial069.stdout: "num_objects_pinned": 0, 2026-02-18T00:57:30.441 INFO:tasks.workunit.client.0.trial069.stdout: "num_legacy_snapsets": 0, 2026-02-18T00:57:30.441 INFO:tasks.workunit.client.0.trial069.stdout: "num_large_omap_objects": 0, 2026-02-18T00:57:30.441 INFO:tasks.workunit.client.0.trial069.stdout: "num_objects_manifest": 0, 2026-02-18T00:57:30.441 INFO:tasks.workunit.client.0.trial069.stdout: "num_omap_bytes": 0, 2026-02-18T00:57:30.441 INFO:tasks.workunit.client.0.trial069.stdout: "num_omap_keys": 0, 2026-02-18T00:57:30.441 INFO:tasks.workunit.client.0.trial069.stdout: "num_objects_repaired": 0 2026-02-18T00:57:30.441 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:57:30.441 INFO:tasks.workunit.client.0.trial069.stdout: "store_stats": { 2026-02-18T00:57:30.441 INFO:tasks.workunit.client.0.trial069.stdout: "total": 0, 2026-02-18T00:57:30.441 INFO:tasks.workunit.client.0.trial069.stdout: "available": 0, 2026-02-18T00:57:30.441 INFO:tasks.workunit.client.0.trial069.stdout: "internally_reserved": 0, 2026-02-18T00:57:30.441 INFO:tasks.workunit.client.0.trial069.stdout: "allocated": 4096, 2026-02-18T00:57:30.441 INFO:tasks.workunit.client.0.trial069.stdout: "data_stored": 19, 2026-02-18T00:57:30.441 INFO:tasks.workunit.client.0.trial069.stdout: "data_compressed": 0, 2026-02-18T00:57:30.441 INFO:tasks.workunit.client.0.trial069.stdout: "data_compressed_allocated": 0, 2026-02-18T00:57:30.441 INFO:tasks.workunit.client.0.trial069.stdout: "data_compressed_original": 0, 2026-02-18T00:57:30.441 INFO:tasks.workunit.client.0.trial069.stdout: "omap_allocated": 0, 2026-02-18T00:57:30.441 INFO:tasks.workunit.client.0.trial069.stdout: "internal_metadata": 0 2026-02-18T00:57:30.441 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:57:30.442 INFO:tasks.workunit.client.0.trial069.stdout: "log_size": 3, 2026-02-18T00:57:30.442 INFO:tasks.workunit.client.0.trial069.stdout: "ondisk_log_size": 3, 2026-02-18T00:57:30.442 INFO:tasks.workunit.client.0.trial069.stdout: "up": 4, 2026-02-18T00:57:30.442 INFO:tasks.workunit.client.0.trial069.stdout: "acting": 4, 2026-02-18T00:57:30.442 INFO:tasks.workunit.client.0.trial069.stdout: "num_store_stats": 1 2026-02-18T00:57:30.442 INFO:tasks.workunit.client.0.trial069.stdout: } 2026-02-18T00:57:30.442 INFO:tasks.workunit.client.0.trial069.stdout: ], 2026-02-18T00:57:30.442 INFO:tasks.workunit.client.0.trial069.stdout: "osd_stats": [ 2026-02-18T00:57:30.442 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:57:30.442 INFO:tasks.workunit.client.0.trial069.stdout: "osd": 0, 2026-02-18T00:57:30.442 INFO:tasks.workunit.client.0.trial069.stdout: "seq": 21474836487 2026-02-18T00:57:30.442 INFO:tasks.workunit.client.0.trial069.stdout: } 2026-02-18T00:57:30.442 INFO:tasks.workunit.client.0.trial069.stdout: ], 2026-02-18T00:57:30.442 INFO:tasks.workunit.client.0.trial069.stdout: "num_pg_by_state": [ 2026-02-18T00:57:30.442 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:57:30.442 INFO:tasks.workunit.client.0.trial069.stdout: "state": "stale+active+clean", 2026-02-18T00:57:30.442 INFO:tasks.workunit.client.0.trial069.stdout: "num": 4 2026-02-18T00:57:30.442 INFO:tasks.workunit.client.0.trial069.stdout: } 2026-02-18T00:57:30.442 INFO:tasks.workunit.client.0.trial069.stdout: ], 2026-02-18T00:57:30.442 INFO:tasks.workunit.client.0.trial069.stdout: "pool_pg_unavailable_map": [ 2026-02-18T00:57:30.442 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:57:30.442 INFO:tasks.workunit.client.0.trial069.stdout: "poolid": "1", 2026-02-18T00:57:30.442 INFO:tasks.workunit.client.0.trial069.stdout: "pgs": [ 2026-02-18T00:57:30.442 INFO:tasks.workunit.client.0.trial069.stdout: "1.3", 2026-02-18T00:57:30.442 INFO:tasks.workunit.client.0.trial069.stdout: "1.2", 2026-02-18T00:57:30.442 INFO:tasks.workunit.client.0.trial069.stdout: "1.1", 2026-02-18T00:57:30.443 INFO:tasks.workunit.client.0.trial069.stdout: "1.0" 2026-02-18T00:57:30.443 INFO:tasks.workunit.client.0.trial069.stdout: ] 2026-02-18T00:57:30.443 INFO:tasks.workunit.client.0.trial069.stdout: } 2026-02-18T00:57:30.443 INFO:tasks.workunit.client.0.trial069.stdout: ], 2026-02-18T00:57:30.443 INFO:tasks.workunit.client.0.trial069.stdout: "num_pg_by_osd": [ 2026-02-18T00:57:30.443 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:57:30.443 INFO:tasks.workunit.client.0.trial069.stdout: "osd": 0, 2026-02-18T00:57:30.443 INFO:tasks.workunit.client.0.trial069.stdout: "num_primary_pg": 4, 2026-02-18T00:57:30.443 INFO:tasks.workunit.client.0.trial069.stdout: "num_acting_pg": 4, 2026-02-18T00:57:30.443 INFO:tasks.workunit.client.0.trial069.stdout: "num_up_not_acting_pg": 0 2026-02-18T00:57:30.443 INFO:tasks.workunit.client.0.trial069.stdout: } 2026-02-18T00:57:30.443 INFO:tasks.workunit.client.0.trial069.stdout: ], 2026-02-18T00:57:30.443 INFO:tasks.workunit.client.0.trial069.stdout: "purged_snaps": [ 2026-02-18T00:57:30.443 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:57:30.443 INFO:tasks.workunit.client.0.trial069.stdout: "pool": 1, 2026-02-18T00:57:30.443 INFO:tasks.workunit.client.0.trial069.stdout: "purged_snaps": {} 2026-02-18T00:57:30.443 INFO:tasks.workunit.client.0.trial069.stdout: } 2026-02-18T00:57:30.443 INFO:tasks.workunit.client.0.trial069.stdout: ], 2026-02-18T00:57:30.443 INFO:tasks.workunit.client.0.trial069.stdout: "servicemap": { 2026-02-18T00:57:30.443 INFO:tasks.workunit.client.0.trial069.stdout: "epoch": 3, 2026-02-18T00:57:30.443 INFO:tasks.workunit.client.0.trial069.stdout: "modified": "2026-02-18T00:56:56.879762+0000", 2026-02-18T00:57:30.443 INFO:tasks.workunit.client.0.trial069.stdout: "services": {} 2026-02-18T00:57:30.443 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:57:30.443 INFO:tasks.workunit.client.0.trial069.stdout: "mgrstat_first_committed": 253, 2026-02-18T00:57:30.443 INFO:tasks.workunit.client.0.trial069.stdout: "mgrstat_last_committed": 499, 2026-02-18T00:57:30.443 INFO:tasks.workunit.client.0.trial069.stdout: "logm_first_committed": 1, 2026-02-18T00:57:30.443 INFO:tasks.workunit.client.0.trial069.stdout: "logm_last_committed": 551, 2026-02-18T00:57:30.443 INFO:tasks.workunit.client.0.trial069.stdout: "paxos": { 2026-02-18T00:57:30.444 INFO:tasks.workunit.client.0.trial069.stdout: "first_committed": 503, 2026-02-18T00:57:30.444 INFO:tasks.workunit.client.0.trial069.stdout: "last_committed": 1074, 2026-02-18T00:57:30.444 INFO:tasks.workunit.client.0.trial069.stdout: "last_pn": 0, 2026-02-18T00:57:30.444 INFO:tasks.workunit.client.0.trial069.stdout: "accepted_pn": 0 2026-02-18T00:57:30.444 INFO:tasks.workunit.client.0.trial069.stdout: } 2026-02-18T00:57:30.444 INFO:tasks.workunit.client.0.trial069.stdout:} 2026-02-18T00:57:30.444 INFO:tasks.workunit.client.0.trial069.stderr:report 1577939370 2026-02-18T00:57:30.444 INFO:tasks.workunit.client.0.trial069.stdout:PG 1.0 is not clean after 31 iterations 2026-02-18T00:57:30.445 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1713: wait_for_pg_clean: echo 'PG 1.0 is not clean after 31 iterations' 2026-02-18T00:57:30.445 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1714: wait_for_pg_clean: return 1 2026-02-18T00:57:30.445 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1925: pg_scrub: return 1 2026-02-18T00:57:30.445 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1952: test_pg_scrub: teardown td/ceph-helpers 2026-02-18T00:57:30.445 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/ceph-helpers 2026-02-18T00:57:30.445 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T00:57:30.445 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/ceph-helpers KILL 2026-02-18T00:57:30.445 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:57:30.445 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:57:30.445 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:57:30.445 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:57:30.445 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:57:30.511 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:57:30.511 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T00:57:30.511 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T00:57:30.512 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T00:57:30.513 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T00:57:30.513 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T00:57:30.513 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T00:57:30.514 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:57:30.514 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T00:57:30.515 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T00:57:30.515 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:57:30.516 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T00:57:30.517 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T00:57:30.517 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/ceph-helpers 2026-02-18T00:57:30.531 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T00:57:30.531 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:57:30.531 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:57:30.532 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.57427 2026-02-18T00:57:30.533 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T00:57:30.533 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T00:57:30.533 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2426: run_tests: for func in $funcs 2026-02-18T00:57:30.533 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2427: run_tests: test_repair td/ceph-helpers 2026-02-18T00:57:30.533 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1894: test_repair: local dir=td/ceph-helpers 2026-02-18T00:57:30.533 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1896: test_repair: setup td/ceph-helpers 2026-02-18T00:57:30.533 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/ceph-helpers 2026-02-18T00:57:30.533 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/ceph-helpers 2026-02-18T00:57:30.533 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/ceph-helpers 2026-02-18T00:57:30.533 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T00:57:30.533 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/ceph-helpers KILL 2026-02-18T00:57:30.534 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:57:30.534 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:57:30.534 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:57:30.534 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:57:30.534 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:57:30.536 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:57:30.536 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T00:57:30.537 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T00:57:30.537 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T00:57:30.538 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T00:57:30.538 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T00:57:30.538 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T00:57:30.539 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:57:30.540 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T00:57:30.540 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T00:57:30.540 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:57:30.541 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T00:57:30.542 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T00:57:30.542 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/ceph-helpers 2026-02-18T00:57:30.543 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T00:57:30.543 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:57:30.543 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:57:30.544 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.57427 2026-02-18T00:57:30.545 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T00:57:30.545 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T00:57:30.545 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/ceph-helpers 2026-02-18T00:57:30.546 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-18T00:57:30.546 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:57:30.546 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:57:30.546 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.57427 2026-02-18T00:57:30.547 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-18T00:57:30.548 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-18T00:57:30.548 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-18T00:57:30.548 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/ceph-helpers 1' TERM HUP INT 2026-02-18T00:57:30.548 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1897: test_repair: run_mon td/ceph-helpers a --osd_pool_default_size=1 --mon_allow_pool_size_one=true 2026-02-18T00:57:30.548 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/ceph-helpers 2026-02-18T00:57:30.548 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-18T00:57:30.548 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-18T00:57:30.548 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-18T00:57:30.548 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/ceph-helpers/a 2026-02-18T00:57:30.548 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/ceph-helpers/a --run-dir=td/ceph-helpers --osd_pool_default_size=1 --mon_allow_pool_size_one=true 2026-02-18T00:57:30.571 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-18T00:57:30.571 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:57:30.571 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:57:30.571 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:57:30.571 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:57:30.571 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:57:30.571 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.57427/$cluster-$name.asok' 2026-02-18T00:57:30.572 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/ceph-helpers/a '--log-file=td/ceph-helpers/$name.log' '--admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' --mon-cluster-log-file=td/ceph-helpers/log --run-dir=td/ceph-helpers '--pid-file=td/ceph-helpers/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --osd_pool_default_size=1 --mon_allow_pool_size_one=true 2026-02-18T00:57:30.601 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-18T00:57:30.603 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-18T00:57:30.603 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T00:57:30.603 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-18T00:57:30.603 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-18T00:57:30.604 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-18T00:57:30.604 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-18T00:57:30.604 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:57:30.604 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:57:30.604 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:57:30.604 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:57:30.605 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:57:30.605 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.57427/ceph-mon.a.asok 2026-02-18T00:57:30.605 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T00:57:30.605 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.57427/ceph-mon.a.asok config get fsid 2026-02-18T00:57:30.663 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-18T00:57:30.663 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T00:57:30.663 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-18T00:57:30.663 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-18T00:57:30.663 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-18T00:57:30.663 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-18T00:57:30.663 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:57:30.663 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:57:30.664 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:57:30.664 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:57:30.664 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:57:30.664 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.57427/ceph-mon.a.asok 2026-02-18T00:57:30.664 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T00:57:30.664 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.57427/ceph-mon.a.asok config get mon_host 2026-02-18T00:57:30.720 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1898: test_repair: run_mgr td/ceph-helpers x 2026-02-18T00:57:30.720 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/ceph-helpers 2026-02-18T00:57:30.720 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-18T00:57:30.720 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-18T00:57:30.720 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-18T00:57:30.720 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/ceph-helpers/x 2026-02-18T00:57:30.720 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-18T00:57:30.834 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-18T00:57:30.834 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:57:30.834 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:57:30.835 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:57:30.835 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:57:30.835 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:57:30.835 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.57427/$cluster-$name.asok' 2026-02-18T00:57:30.836 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-18T00:57:30.837 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/ceph-helpers/x '--log-file=td/ceph-helpers/$name.log' '--admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' --run-dir=td/ceph-helpers '--pid-file=td/ceph-helpers/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-18T00:57:30.854 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1899: test_repair: run_osd td/ceph-helpers 0 2026-02-18T00:57:30.854 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/ceph-helpers 2026-02-18T00:57:30.854 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T00:57:30.854 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-18T00:57:30.854 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T00:57:30.854 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/ceph-helpers/0 2026-02-18T00:57:30.854 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--cluster ceph --fsid=863c4e35-ceb0-4172-b7b2-c3ff099e05a2 --auth-supported=none --mon-host=127.0.0.1:7109 ' 2026-02-18T00:57:30.854 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T00:57:30.854 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T00:57:30.854 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T00:57:30.854 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/ceph-helpers/0' 2026-02-18T00:57:30.854 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/ceph-helpers/0/journal' 2026-02-18T00:57:30.854 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T00:57:30.854 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-18T00:57:30.854 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/ceph-helpers' 2026-02-18T00:57:30.854 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T00:57:30.854 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:57:30.854 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:57:30.854 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:57:30.854 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:57:30.854 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:57:30.855 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.57427/$cluster-$name.asok' 2026-02-18T00:57:30.855 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' 2026-02-18T00:57:30.855 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T00:57:30.855 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T00:57:30.855 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T00:57:30.855 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/ceph-helpers/$name.log' 2026-02-18T00:57:30.855 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/ceph-helpers/$name.pid' 2026-02-18T00:57:30.855 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T00:57:30.855 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T00:57:30.855 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T00:57:30.855 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T00:57:30.855 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T00:57:30.855 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-18T00:57:30.855 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/ceph-helpers/0 2026-02-18T00:57:30.856 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T00:57:30.857 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=364812fb-b245-4edf-933a-a2d820675275 2026-02-18T00:57:30.857 INFO:tasks.workunit.client.0.trial069.stdout:add osd0 364812fb-b245-4edf-933a-a2d820675275 2026-02-18T00:57:30.857 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 364812fb-b245-4edf-933a-a2d820675275' 2026-02-18T00:57:30.857 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T00:57:30.869 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQB6DpVp2slBMxAAkw03E2pRsqnB3vANcaYQ0A== 2026-02-18T00:57:30.869 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQB6DpVp2slBMxAAkw03E2pRsqnB3vANcaYQ0A=="}' 2026-02-18T00:57:30.869 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 364812fb-b245-4edf-933a-a2d820675275 -i td/ceph-helpers/0/new.json 2026-02-18T00:57:30.979 INFO:tasks.workunit.client.0.trial069.stdout:0 2026-02-18T00:57:30.987 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/ceph-helpers/0/new.json 2026-02-18T00:57:30.988 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --cluster ceph --fsid=863c4e35-ceb0-4172-b7b2-c3ff099e05a2 --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/0 --osd-journal=td/ceph-helpers/0/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQB6DpVp2slBMxAAkw03E2pRsqnB3vANcaYQ0A== --osd-uuid 364812fb-b245-4edf-933a-a2d820675275 2026-02-18T00:57:31.005 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:57:30.993+0000 7f9416213a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:57:31.006 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:57:30.993+0000 7f9416213a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:57:31.007 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:57:30.993+0000 7f9416213a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:57:31.007 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:57:30.993+0000 7f9416213a40 -1 bdev(0x55808897ec00 td/ceph-helpers/0/block) open stat got: (1) Operation not permitted 2026-02-18T00:57:31.007 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:57:30.993+0000 7f9416213a40 -1 bluestore(td/ceph-helpers/0) _read_fsid unparsable uuid 2026-02-18T00:57:31.688 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/ceph-helpers/0/keyring 2026-02-18T00:57:31.688 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T00:57:31.688 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-18T00:57:31.688 INFO:tasks.workunit.client.0.trial069.stdout:adding osd0 key to auth repository 2026-02-18T00:57:31.689 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/ceph-helpers/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T00:57:31.801 INFO:tasks.workunit.client.0.trial069.stdout:start osd.0 2026-02-18T00:57:31.801 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-18T00:57:31.801 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --cluster ceph --fsid=863c4e35-ceb0-4172-b7b2-c3ff099e05a2 --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/0 --osd-journal=td/ceph-helpers/0/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T00:57:31.801 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T00:57:31.801 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T00:57:31.801 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T00:57:31.816 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:57:31.805+0000 7ff2e1a01a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:57:31.818 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:57:31.805+0000 7ff2e1a01a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:57:31.819 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:57:31.805+0000 7ff2e1a01a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:57:31.910 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-18T00:57:31.910 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:57:31.910 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-18T00:57:31.910 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:57:31.910 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:57:31.910 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:57:31.910 INFO:tasks.workunit.client.0.trial069.stdout:0 2026-02-18T00:57:31.910 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:57:31.910 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:57:31.910 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T00:57:32.016 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:57:32.226 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:57:32.213+0000 7ff2e1a01a40 -1 Falling back to public interface 2026-02-18T00:57:33.017 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:57:33.017 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:57:33.018 INFO:tasks.workunit.client.0.trial069.stdout:1 2026-02-18T00:57:33.018 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T00:57:33.020 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T00:57:33.023 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:57:33.148 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:57:33.277 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:57:33.265+0000 7ff2e1a01a40 -1 osd.0 0 log_to_monitors true 2026-02-18T00:57:34.149 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:57:34.149 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:57:34.149 INFO:tasks.workunit.client.0.trial069.stdout:2 2026-02-18T00:57:34.150 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-18T00:57:34.150 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:57:34.150 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T00:57:34.366 INFO:tasks.workunit.client.0.trial069.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/1182753713,v1:127.0.0.1:6801/1182753713] [v2:127.0.0.1:6802/1182753713,v1:127.0.0.1:6803/1182753713] exists,up 364812fb-b245-4edf-933a-a2d820675275 2026-02-18T00:57:34.367 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:57:34.367 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:57:34.367 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:57:34.367 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1900: test_repair: create_rbd_pool 2026-02-18T00:57:34.367 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:526: create_rbd_pool: ceph osd pool delete rbd rbd --yes-i-really-really-mean-it 2026-02-18T00:57:34.573 INFO:tasks.workunit.client.0.trial069.stderr:pool 'rbd' does not exist 2026-02-18T00:57:34.582 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:527: create_rbd_pool: create_pool rbd 4 2026-02-18T00:57:34.582 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create rbd 4 2026-02-18T00:57:34.862 INFO:tasks.workunit.client.0.trial069.stderr:pool 'rbd' already exists 2026-02-18T00:57:34.872 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-18T00:57:35.873 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:528: create_rbd_pool: rbd pool init rbd 2026-02-18T00:57:36.153 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1901: test_repair: wait_for_clean 2026-02-18T00:57:36.153 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-18T00:57:36.154 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-18T00:57:36.154 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-18T00:57:36.154 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-18T00:57:36.155 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-18T00:57:36.155 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-18T00:57:36.155 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-18T00:57:36.155 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-18T00:57:36.155 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-18T00:57:36.253 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-18T00:57:36.253 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-18T00:57:36.253 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-18T00:57:36.253 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-18T00:57:36.254 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-18T00:57:36.254 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-18T00:57:36.470 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids=0 2026-02-18T00:57:36.470 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-18T00:57:36.470 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:57:36.470 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-18T00:57:36.548 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836483 2026-02-18T00:57:36.549 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836483 2026-02-18T00:57:36.549 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836483' 2026-02-18T00:57:36.549 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:57:36.549 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836483 2026-02-18T00:57:36.550 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:57:36.550 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-18T00:57:36.551 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-21474836483 2026-02-18T00:57:36.551 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:57:36.553 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=21474836483 2026-02-18T00:57:36.553 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 21474836483' 2026-02-18T00:57:36.553 INFO:tasks.workunit.client.0.trial069.stdout:waiting osd.0 seq 21474836483 2026-02-18T00:57:36.553 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T00:57:36.768 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 21474836481 -lt 21474836483 2026-02-18T00:57:36.768 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-18T00:57:37.769 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-18T00:57:37.770 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T00:57:37.985 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 21474836483 -lt 21474836483 2026-02-18T00:57:37.986 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-18T00:57:37.986 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T00:57:37.986 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T00:57:38.260 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 4 == 0 2026-02-18T00:57:38.260 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-18T00:57:38.261 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-18T00:57:38.261 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-18T00:57:38.261 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-18T00:57:38.261 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-18T00:57:38.262 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-18T00:57:38.262 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-18T00:57:38.462 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=4 2026-02-18T00:57:38.463 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-18T00:57:38.463 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T00:57:38.463 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T00:57:38.737 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 4 = 4 2026-02-18T00:57:38.737 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-18T00:57:38.737 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-18T00:57:38.737 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1902: test_repair: repair 1.0 2026-02-18T00:57:38.737 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1887: repair: local pgid=1.0 2026-02-18T00:57:38.737 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1888: repair: get_last_scrub_stamp 1.0 2026-02-18T00:57:38.737 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-18T00:57:38.737 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-18T00:57:38.737 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-18T00:57:38.738 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-18T00:57:38.937 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1888: repair: local last_scrub=2026-02-18T00:57:34.800384+0000 2026-02-18T00:57:38.938 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1889: repair: ceph pg repair 1.0 2026-02-18T00:57:39.138 INFO:tasks.workunit.client.0.trial069.stderr:instructing pg 1.0 on osd.0 to repair 2026-02-18T00:57:39.149 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1890: repair: wait_for_scrub 1.0 2026-02-18T00:57:34.800384+0000 2026-02-18T00:57:39.149 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2063: wait_for_scrub: local pgid=1.0 2026-02-18T00:57:39.149 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2064: wait_for_scrub: local last_scrub=2026-02-18T00:57:34.800384+0000 2026-02-18T00:57:39.149 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2065: wait_for_scrub: local sname=last_scrub_stamp 2026-02-18T00:57:39.149 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i=0 )) 2026-02-18T00:57:39.149 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-18T00:57:39.149 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-18T00:57:39.149 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-18T00:57:39.149 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-18T00:57:39.150 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-18T00:57:39.150 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-18T00:57:39.359 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-18T00:57:34.800384+0000 '>' 2026-02-18T00:57:34.800384+0000 2026-02-18T00:57:39.360 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-18T00:57:40.361 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-18T00:57:40.361 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-18T00:57:40.362 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-18T00:57:40.362 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-18T00:57:40.363 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-18T00:57:40.363 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-18T00:57:40.363 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-18T00:57:40.573 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-18T00:57:34.800384+0000 '>' 2026-02-18T00:57:34.800384+0000 2026-02-18T00:57:40.573 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-18T00:57:41.574 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-18T00:57:41.575 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-18T00:57:41.576 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-18T00:57:41.576 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-18T00:57:41.576 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-18T00:57:41.576 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-18T00:57:41.576 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-18T00:57:41.786 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-18T00:57:39.155386+0000 '>' 2026-02-18T00:57:34.800384+0000 2026-02-18T00:57:41.786 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: wait_for_scrub: return 0 2026-02-18T00:57:41.786 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1903: test_repair: kill_daemons td/ceph-helpers KILL osd 2026-02-18T00:57:41.787 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:57:41.787 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:57:41.787 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:57:41.787 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:57:41.787 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:57:41.893 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:57:41.893 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1904: test_repair: TIMEOUT=2 2026-02-18T00:57:41.893 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1904: test_repair: repair 1.0 2026-02-18T00:57:41.894 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1887: repair: local pgid=1.0 2026-02-18T00:57:41.894 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1888: repair: get_last_scrub_stamp 1.0 2026-02-18T00:57:41.894 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-18T00:57:41.894 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-18T00:57:41.894 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-18T00:57:41.894 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-18T00:57:42.097 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1888: repair: local last_scrub=2026-02-18T00:57:39.155386+0000 2026-02-18T00:57:42.098 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1889: repair: ceph pg repair 1.0 2026-02-18T00:57:42.303 INFO:tasks.workunit.client.0.trial069.stderr:instructing pg 1.0 on osd.0 to repair 2026-02-18T00:57:42.314 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1890: repair: wait_for_scrub 1.0 2026-02-18T00:57:39.155386+0000 2026-02-18T00:57:42.314 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2063: wait_for_scrub: local pgid=1.0 2026-02-18T00:57:42.314 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2064: wait_for_scrub: local last_scrub=2026-02-18T00:57:39.155386+0000 2026-02-18T00:57:42.314 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2065: wait_for_scrub: local sname=last_scrub_stamp 2026-02-18T00:57:42.314 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i=0 )) 2026-02-18T00:57:42.314 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 2 )) 2026-02-18T00:57:42.315 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-18T00:57:42.315 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-18T00:57:42.315 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-18T00:57:42.315 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-18T00:57:42.315 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-18T00:57:42.523 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-18T00:57:39.155386+0000 '>' 2026-02-18T00:57:39.155386+0000 2026-02-18T00:57:42.523 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-18T00:57:43.524 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-18T00:57:43.524 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 2 )) 2026-02-18T00:57:43.525 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-18T00:57:43.525 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-18T00:57:43.525 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-18T00:57:43.525 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-18T00:57:43.525 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-18T00:57:43.737 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-18T00:57:39.155386+0000 '>' 2026-02-18T00:57:39.155386+0000 2026-02-18T00:57:43.738 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-18T00:57:44.739 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-18T00:57:44.740 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 2 )) 2026-02-18T00:57:44.740 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: wait_for_scrub: return 1 2026-02-18T00:57:44.740 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1905: test_repair: teardown td/ceph-helpers 2026-02-18T00:57:44.740 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/ceph-helpers 2026-02-18T00:57:44.740 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T00:57:44.740 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/ceph-helpers KILL 2026-02-18T00:57:44.740 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:57:44.740 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:57:44.741 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:57:44.741 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:57:44.741 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:57:44.848 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:57:44.849 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T00:57:44.849 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T00:57:44.850 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T00:57:44.851 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T00:57:44.851 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T00:57:44.852 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T00:57:44.852 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:57:44.853 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T00:57:44.853 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T00:57:44.853 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:57:44.854 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T00:57:44.855 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T00:57:44.855 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/ceph-helpers 2026-02-18T00:57:44.861 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T00:57:44.861 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:57:44.861 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:57:44.861 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.57427 2026-02-18T00:57:44.864 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T00:57:44.864 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T00:57:44.864 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2426: run_tests: for func in $funcs 2026-02-18T00:57:44.864 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2427: run_tests: test_run_in_background td/ceph-helpers 2026-02-18T00:57:44.864 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2198: test_run_in_background: local pids 2026-02-18T00:57:44.864 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2199: test_run_in_background: run_in_background pids sleep 1 2026-02-18T00:57:44.864 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2183: run_in_background: local pid_variable=pids 2026-02-18T00:57:44.864 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2184: run_in_background: shift 2026-02-18T00:57:44.865 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2188: run_in_background: eval 'pids+=" 114456"' 2026-02-18T00:57:44.865 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2188: run_in_background: pids+=' 114456' 2026-02-18T00:57:44.865 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2200: test_run_in_background: run_in_background pids sleep 1 2026-02-18T00:57:44.865 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2183: run_in_background: local pid_variable=pids 2026-02-18T00:57:44.865 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2184: run_in_background: shift 2026-02-18T00:57:44.865 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2188: run_in_background: eval 'pids+=" 114458"' 2026-02-18T00:57:44.865 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2188: run_in_background: pids+=' 114458' 2026-02-18T00:57:44.865 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: sleep 1 2026-02-18T00:57:44.865 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: sed 's/^/114459: /' 2026-02-18T00:57:44.865 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: sleep 1 2026-02-18T00:57:44.865 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: sed 's/^/114462: /' 2026-02-18T00:57:44.866 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: test_run_in_background: echo 114456 114458 2026-02-18T00:57:44.866 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: test_run_in_background: wc -w 2026-02-18T00:57:44.866 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: test_run_in_background: test 2 = 2 2026-02-18T00:57:44.866 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: test_run_in_background: wait 114456 114458 2026-02-18T00:57:45.864 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: return 0 2026-02-18T00:57:45.866 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: return 0 2026-02-18T00:57:45.866 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2426: run_tests: for func in $funcs 2026-02-18T00:57:45.866 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2427: run_tests: test_run_mon td/ceph-helpers 2026-02-18T00:57:45.866 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: test_run_mon: local dir=td/ceph-helpers 2026-02-18T00:57:45.866 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:488: test_run_mon: setup td/ceph-helpers 2026-02-18T00:57:45.866 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/ceph-helpers 2026-02-18T00:57:45.866 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/ceph-helpers 2026-02-18T00:57:45.867 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/ceph-helpers 2026-02-18T00:57:45.867 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T00:57:45.867 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/ceph-helpers KILL 2026-02-18T00:57:45.867 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:57:45.867 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:57:45.868 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:57:45.868 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:57:45.868 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:57:45.869 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:57:45.870 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T00:57:45.871 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T00:57:45.871 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T00:57:45.872 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T00:57:45.873 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T00:57:45.873 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T00:57:45.874 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:57:45.874 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T00:57:45.875 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T00:57:45.875 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:57:45.876 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T00:57:45.877 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T00:57:45.877 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/ceph-helpers 2026-02-18T00:57:45.878 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T00:57:45.879 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:57:45.879 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:57:45.879 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.57427 2026-02-18T00:57:45.879 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T00:57:45.880 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T00:57:45.880 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/ceph-helpers 2026-02-18T00:57:45.881 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-18T00:57:45.881 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:57:45.881 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:57:45.881 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.57427 2026-02-18T00:57:45.883 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-18T00:57:45.884 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-18T00:57:45.884 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-18T00:57:45.884 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/ceph-helpers 1' TERM HUP INT 2026-02-18T00:57:45.884 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:490: test_run_mon: run_mon td/ceph-helpers a 2026-02-18T00:57:45.884 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/ceph-helpers 2026-02-18T00:57:45.884 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-18T00:57:45.885 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-18T00:57:45.885 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-18T00:57:45.885 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/ceph-helpers/a 2026-02-18T00:57:45.885 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/ceph-helpers/a --run-dir=td/ceph-helpers 2026-02-18T00:57:45.905 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-18T00:57:45.905 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:57:45.905 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:57:45.905 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:57:45.905 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:57:45.905 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:57:45.906 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.57427/$cluster-$name.asok' 2026-02-18T00:57:45.906 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/ceph-helpers/a '--log-file=td/ceph-helpers/$name.log' '--admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' --mon-cluster-log-file=td/ceph-helpers/log --run-dir=td/ceph-helpers '--pid-file=td/ceph-helpers/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-18T00:57:45.934 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-18T00:57:45.935 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-18T00:57:45.935 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T00:57:45.935 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-18T00:57:45.935 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-18T00:57:45.935 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-18T00:57:45.937 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-18T00:57:45.937 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:57:45.937 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:57:45.937 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:57:45.937 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:57:45.937 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:57:45.937 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.57427/ceph-mon.a.asok 2026-02-18T00:57:45.937 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T00:57:45.937 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.57427/ceph-mon.a.asok config get fsid 2026-02-18T00:57:45.991 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-18T00:57:45.991 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T00:57:45.992 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-18T00:57:45.992 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-18T00:57:45.992 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-18T00:57:45.993 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-18T00:57:45.993 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:57:45.993 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:57:45.993 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:57:45.993 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:57:45.993 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:57:45.994 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.57427/ceph-mon.a.asok 2026-02-18T00:57:45.994 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T00:57:45.994 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.57427/ceph-mon.a.asok config get mon_host 2026-02-18T00:57:46.046 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:491: test_run_mon: ceph mon dump 2026-02-18T00:57:46.047 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:491: test_run_mon: grep mon.a 2026-02-18T00:57:46.151 INFO:tasks.workunit.client.0.trial069.stderr:dumped monmap epoch 1 2026-02-18T00:57:46.158 INFO:tasks.workunit.client.0.trial069.stdout:0: v2:127.0.0.1:7109/0 mon.a 2026-02-18T00:57:46.159 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:492: test_run_mon: kill_daemons td/ceph-helpers 2026-02-18T00:57:46.160 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:57:46.160 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:57:46.160 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:57:46.160 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:57:46.160 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:57:46.266 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:57:46.266 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:494: test_run_mon: run_mon td/ceph-helpers a --osd_pool_default_size=3 2026-02-18T00:57:46.266 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/ceph-helpers 2026-02-18T00:57:46.266 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-18T00:57:46.266 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-18T00:57:46.266 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-18T00:57:46.266 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/ceph-helpers/a 2026-02-18T00:57:46.267 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/ceph-helpers/a --run-dir=td/ceph-helpers --osd_pool_default_size=3 2026-02-18T00:57:46.280 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:57:46.268+0000 7fdc6e64cec0 -1 'td/ceph-helpers/a' already exists and is not empty: monitor may already exist 2026-02-18T00:57:46.281 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-18T00:57:46.282 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:57:46.282 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:57:46.282 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:57:46.282 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:57:46.282 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:57:46.282 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.57427/$cluster-$name.asok' 2026-02-18T00:57:46.283 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/ceph-helpers/a '--log-file=td/ceph-helpers/$name.log' '--admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' --mon-cluster-log-file=td/ceph-helpers/log --run-dir=td/ceph-helpers '--pid-file=td/ceph-helpers/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --osd_pool_default_size=3 2026-02-18T00:57:46.312 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-18T00:57:46.313 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-18T00:57:46.313 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T00:57:46.313 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-18T00:57:46.313 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-18T00:57:46.314 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-18T00:57:46.314 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-18T00:57:46.314 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:57:46.314 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:57:46.314 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:57:46.314 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:57:46.314 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:57:46.315 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.57427/ceph-mon.a.asok 2026-02-18T00:57:46.315 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T00:57:46.315 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.57427/ceph-mon.a.asok config get fsid 2026-02-18T00:57:46.372 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-18T00:57:46.372 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T00:57:46.372 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-18T00:57:46.372 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-18T00:57:46.372 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-18T00:57:46.373 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-18T00:57:46.373 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:57:46.374 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:57:46.374 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:57:46.374 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:57:46.374 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:57:46.374 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.57427/ceph-mon.a.asok 2026-02-18T00:57:46.374 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T00:57:46.374 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.57427/ceph-mon.a.asok config get mon_host 2026-02-18T00:57:46.431 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:495: test_run_mon: run_osd td/ceph-helpers 0 2026-02-18T00:57:46.431 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/ceph-helpers 2026-02-18T00:57:46.431 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T00:57:46.431 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-18T00:57:46.431 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T00:57:46.431 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/ceph-helpers/0 2026-02-18T00:57:46.431 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--cluster ceph --fsid=863c4e35-ceb0-4172-b7b2-c3ff099e05a2 --auth-supported=none --mon-host=127.0.0.1:7109 ' 2026-02-18T00:57:46.432 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T00:57:46.432 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T00:57:46.432 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T00:57:46.432 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/ceph-helpers/0' 2026-02-18T00:57:46.432 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/ceph-helpers/0/journal' 2026-02-18T00:57:46.432 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T00:57:46.432 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-18T00:57:46.432 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/ceph-helpers' 2026-02-18T00:57:46.432 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T00:57:46.432 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:57:46.432 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:57:46.433 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:57:46.433 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:57:46.433 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:57:46.433 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.57427/$cluster-$name.asok' 2026-02-18T00:57:46.433 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' 2026-02-18T00:57:46.433 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T00:57:46.433 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T00:57:46.433 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T00:57:46.433 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/ceph-helpers/$name.log' 2026-02-18T00:57:46.433 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/ceph-helpers/$name.pid' 2026-02-18T00:57:46.433 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T00:57:46.433 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T00:57:46.434 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T00:57:46.434 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T00:57:46.434 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T00:57:46.434 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-18T00:57:46.434 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/ceph-helpers/0 2026-02-18T00:57:46.435 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T00:57:46.435 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=35c9b06a-4593-4e10-861c-2d5241e20f10 2026-02-18T00:57:46.435 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 35c9b06a-4593-4e10-861c-2d5241e20f10' 2026-02-18T00:57:46.435 INFO:tasks.workunit.client.0.trial069.stdout:add osd0 35c9b06a-4593-4e10-861c-2d5241e20f10 2026-02-18T00:57:46.435 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T00:57:46.446 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQCKDpVpLtsFGhAAozPHpYPUTE2lOT63P8nnUQ== 2026-02-18T00:57:46.446 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQCKDpVpLtsFGhAAozPHpYPUTE2lOT63P8nnUQ=="}' 2026-02-18T00:57:46.446 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 35c9b06a-4593-4e10-861c-2d5241e20f10 -i td/ceph-helpers/0/new.json 2026-02-18T00:57:46.563 INFO:tasks.workunit.client.0.trial069.stdout:0 2026-02-18T00:57:46.573 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/ceph-helpers/0/new.json 2026-02-18T00:57:46.574 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --cluster ceph --fsid=863c4e35-ceb0-4172-b7b2-c3ff099e05a2 --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/0 --osd-journal=td/ceph-helpers/0/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCKDpVpLtsFGhAAozPHpYPUTE2lOT63P8nnUQ== --osd-uuid 35c9b06a-4593-4e10-861c-2d5241e20f10 2026-02-18T00:57:46.598 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:57:46.584+0000 7f02930f0a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:57:46.600 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:57:46.584+0000 7f02930f0a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:57:46.601 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:57:46.588+0000 7f02930f0a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:57:46.602 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:57:46.588+0000 7f02930f0a40 -1 bdev(0x55e01ef6ec00 td/ceph-helpers/0/block) open stat got: (1) Operation not permitted 2026-02-18T00:57:46.602 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:57:46.588+0000 7f02930f0a40 -1 bluestore(td/ceph-helpers/0) _read_fsid unparsable uuid 2026-02-18T00:57:47.255 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/ceph-helpers/0/keyring 2026-02-18T00:57:47.255 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T00:57:47.256 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-18T00:57:47.256 INFO:tasks.workunit.client.0.trial069.stdout:adding osd0 key to auth repository 2026-02-18T00:57:47.257 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/ceph-helpers/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T00:57:47.385 INFO:tasks.workunit.client.0.trial069.stdout:start osd.0 2026-02-18T00:57:47.386 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-18T00:57:47.386 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --cluster ceph --fsid=863c4e35-ceb0-4172-b7b2-c3ff099e05a2 --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/0 --osd-journal=td/ceph-helpers/0/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T00:57:47.386 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T00:57:47.386 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T00:57:47.386 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T00:57:47.402 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:57:47.388+0000 7feb3f9dba40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:57:47.403 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:57:47.388+0000 7feb3f9dba40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:57:47.404 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:57:47.392+0000 7feb3f9dba40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:57:47.493 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-18T00:57:47.494 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:57:47.494 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-18T00:57:47.494 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:57:47.494 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:57:47.494 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:57:47.494 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:57:47.494 INFO:tasks.workunit.client.0.trial069.stdout:0 2026-02-18T00:57:47.495 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:57:47.495 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T00:57:47.606 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:57:47.762 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:57:47.748+0000 7feb3f9dba40 -1 Falling back to public interface 2026-02-18T00:57:48.398 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:57:48.384+0000 7feb3f9dba40 -1 osd.0 0 log_to_monitors true 2026-02-18T00:57:48.607 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:57:48.607 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:57:48.607 INFO:tasks.workunit.client.0.trial069.stdout:1 2026-02-18T00:57:48.608 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T00:57:48.608 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:57:48.608 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T00:57:48.753 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:57:49.755 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:57:49.755 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:57:49.755 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-18T00:57:49.755 INFO:tasks.workunit.client.0.trial069.stdout:2 2026-02-18T00:57:49.756 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:57:49.756 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T00:57:49.868 INFO:tasks.workunit.client.0.trial069.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/2599606629,v1:127.0.0.1:6801/2599606629] [v2:127.0.0.1:6802/2599606629,v1:127.0.0.1:6803/2599606629] exists,up 35c9b06a-4593-4e10-861c-2d5241e20f10 2026-02-18T00:57:49.872 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:57:49.872 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:57:49.872 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:57:49.872 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:496: test_run_mon: run_osd td/ceph-helpers 1 2026-02-18T00:57:49.872 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/ceph-helpers 2026-02-18T00:57:49.872 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T00:57:49.873 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2026-02-18T00:57:49.873 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T00:57:49.873 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/ceph-helpers/1 2026-02-18T00:57:49.873 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--cluster ceph --fsid=863c4e35-ceb0-4172-b7b2-c3ff099e05a2 --auth-supported=none --mon-host=127.0.0.1:7109 ' 2026-02-18T00:57:49.873 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T00:57:49.873 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T00:57:49.873 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T00:57:49.873 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/ceph-helpers/1' 2026-02-18T00:57:49.873 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/ceph-helpers/1/journal' 2026-02-18T00:57:49.873 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T00:57:49.874 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-18T00:57:49.874 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/ceph-helpers' 2026-02-18T00:57:49.874 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T00:57:49.874 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:57:49.874 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:57:49.874 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:57:49.874 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:57:49.874 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:57:49.874 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.57427/$cluster-$name.asok' 2026-02-18T00:57:49.874 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' 2026-02-18T00:57:49.874 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T00:57:49.875 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T00:57:49.875 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T00:57:49.875 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/ceph-helpers/$name.log' 2026-02-18T00:57:49.875 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/ceph-helpers/$name.pid' 2026-02-18T00:57:49.875 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T00:57:49.875 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T00:57:49.875 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T00:57:49.875 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T00:57:49.875 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T00:57:49.875 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-18T00:57:49.875 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/ceph-helpers/1 2026-02-18T00:57:49.876 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T00:57:49.876 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=22e194c9-37a1-4e3d-8e3f-1d9690cb94fa 2026-02-18T00:57:49.876 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 22e194c9-37a1-4e3d-8e3f-1d9690cb94fa' 2026-02-18T00:57:49.877 INFO:tasks.workunit.client.0.trial069.stdout:add osd1 22e194c9-37a1-4e3d-8e3f-1d9690cb94fa 2026-02-18T00:57:49.877 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T00:57:49.885 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQCNDpVpE083NBAAOX+oXE7NG9LYV8P8bVT7hg== 2026-02-18T00:57:49.885 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQCNDpVpE083NBAAOX+oXE7NG9LYV8P8bVT7hg=="}' 2026-02-18T00:57:49.885 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 22e194c9-37a1-4e3d-8e3f-1d9690cb94fa -i td/ceph-helpers/1/new.json 2026-02-18T00:57:49.997 INFO:tasks.workunit.client.0.trial069.stdout:1 2026-02-18T00:57:50.007 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/ceph-helpers/1/new.json 2026-02-18T00:57:50.008 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --cluster ceph --fsid=863c4e35-ceb0-4172-b7b2-c3ff099e05a2 --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/1 --osd-journal=td/ceph-helpers/1/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCNDpVpE083NBAAOX+oXE7NG9LYV8P8bVT7hg== --osd-uuid 22e194c9-37a1-4e3d-8e3f-1d9690cb94fa 2026-02-18T00:57:50.025 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:57:50.012+0000 7f25dad67a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:57:50.027 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:57:50.012+0000 7f25dad67a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:57:50.028 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:57:50.012+0000 7f25dad67a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:57:50.028 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:57:50.016+0000 7f25dad67a40 -1 bdev(0x55ecbc954c00 td/ceph-helpers/1/block) open stat got: (1) Operation not permitted 2026-02-18T00:57:50.028 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:57:50.016+0000 7f25dad67a40 -1 bluestore(td/ceph-helpers/1) _read_fsid unparsable uuid 2026-02-18T00:57:50.679 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/ceph-helpers/1/keyring 2026-02-18T00:57:50.679 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T00:57:50.680 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2026-02-18T00:57:50.680 INFO:tasks.workunit.client.0.trial069.stdout:adding osd1 key to auth repository 2026-02-18T00:57:50.681 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/ceph-helpers/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T00:57:50.801 INFO:tasks.workunit.client.0.trial069.stdout:start osd.1 2026-02-18T00:57:50.802 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2026-02-18T00:57:50.802 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --cluster ceph --fsid=863c4e35-ceb0-4172-b7b2-c3ff099e05a2 --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/1 --osd-journal=td/ceph-helpers/1/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T00:57:50.803 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T00:57:50.803 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T00:57:50.803 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T00:57:50.823 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:57:50.808+0000 7f38cce2ca40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:57:50.825 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:57:50.812+0000 7f38cce2ca40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:57:50.826 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:57:50.812+0000 7f38cce2ca40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:57:50.910 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2026-02-18T00:57:50.910 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:57:50.910 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-18T00:57:50.910 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:57:50.910 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:57:50.910 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:57:50.911 INFO:tasks.workunit.client.0.trial069.stdout:0 2026-02-18T00:57:50.911 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:57:50.911 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:57:50.911 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-18T00:57:51.020 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:57:51.178 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:57:51.164+0000 7f38cce2ca40 -1 Falling back to public interface 2026-02-18T00:57:51.827 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:57:51.812+0000 7f38cce2ca40 -1 osd.1 0 log_to_monitors true 2026-02-18T00:57:52.022 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:57:52.022 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:57:52.022 INFO:tasks.workunit.client.0.trial069.stdout:1 2026-02-18T00:57:52.022 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T00:57:52.023 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:57:52.023 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-18T00:57:52.135 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:57:53.137 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:57:53.137 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:57:53.137 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-18T00:57:53.138 INFO:tasks.workunit.client.0.trial069.stdout:2 2026-02-18T00:57:53.138 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:57:53.138 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-18T00:57:53.249 INFO:tasks.workunit.client.0.trial069.stdout:osd.1 up in weight 1 up_from 9 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6808/2058840724,v1:127.0.0.1:6809/2058840724] [v2:127.0.0.1:6810/2058840724,v1:127.0.0.1:6811/2058840724] exists,up 22e194c9-37a1-4e3d-8e3f-1d9690cb94fa 2026-02-18T00:57:53.252 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:57:53.253 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:57:53.253 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:57:53.253 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:497: test_run_mon: run_osd td/ceph-helpers 2 2026-02-18T00:57:53.253 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/ceph-helpers 2026-02-18T00:57:53.253 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T00:57:53.253 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2026-02-18T00:57:53.253 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T00:57:53.253 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/ceph-helpers/2 2026-02-18T00:57:53.253 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--cluster ceph --fsid=863c4e35-ceb0-4172-b7b2-c3ff099e05a2 --auth-supported=none --mon-host=127.0.0.1:7109 ' 2026-02-18T00:57:53.253 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T00:57:53.253 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T00:57:53.254 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T00:57:53.254 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/ceph-helpers/2' 2026-02-18T00:57:53.254 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/ceph-helpers/2/journal' 2026-02-18T00:57:53.254 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T00:57:53.254 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-18T00:57:53.254 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/ceph-helpers' 2026-02-18T00:57:53.254 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T00:57:53.254 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:57:53.254 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:57:53.254 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:57:53.254 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:57:53.254 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:57:53.255 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.57427/$cluster-$name.asok' 2026-02-18T00:57:53.255 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' 2026-02-18T00:57:53.255 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T00:57:53.255 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T00:57:53.255 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T00:57:53.255 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/ceph-helpers/$name.log' 2026-02-18T00:57:53.255 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/ceph-helpers/$name.pid' 2026-02-18T00:57:53.255 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T00:57:53.255 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T00:57:53.255 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T00:57:53.255 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T00:57:53.255 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T00:57:53.255 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-18T00:57:53.256 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/ceph-helpers/2 2026-02-18T00:57:53.256 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T00:57:53.256 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=f282b7fc-4a8a-4a70-86f6-fdb976182be5 2026-02-18T00:57:53.256 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 f282b7fc-4a8a-4a70-86f6-fdb976182be5' 2026-02-18T00:57:53.257 INFO:tasks.workunit.client.0.trial069.stdout:add osd2 f282b7fc-4a8a-4a70-86f6-fdb976182be5 2026-02-18T00:57:53.257 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T00:57:53.266 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQCRDpVpVBVWDxAAg0qnWvW8aa0BgzSMjbPbwA== 2026-02-18T00:57:53.267 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQCRDpVpVBVWDxAAg0qnWvW8aa0BgzSMjbPbwA=="}' 2026-02-18T00:57:53.267 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new f282b7fc-4a8a-4a70-86f6-fdb976182be5 -i td/ceph-helpers/2/new.json 2026-02-18T00:57:53.389 INFO:tasks.workunit.client.0.trial069.stdout:2 2026-02-18T00:57:53.396 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/ceph-helpers/2/new.json 2026-02-18T00:57:53.397 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --cluster ceph --fsid=863c4e35-ceb0-4172-b7b2-c3ff099e05a2 --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/2 --osd-journal=td/ceph-helpers/2/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCRDpVpVBVWDxAAg0qnWvW8aa0BgzSMjbPbwA== --osd-uuid f282b7fc-4a8a-4a70-86f6-fdb976182be5 2026-02-18T00:57:53.422 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:57:53.408+0000 7f39b5f12a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:57:53.423 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:57:53.408+0000 7f39b5f12a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:57:53.424 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:57:53.412+0000 7f39b5f12a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:57:53.425 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:57:53.412+0000 7f39b5f12a40 -1 bdev(0x55917d916c00 td/ceph-helpers/2/block) open stat got: (1) Operation not permitted 2026-02-18T00:57:53.425 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:57:53.412+0000 7f39b5f12a40 -1 bluestore(td/ceph-helpers/2) _read_fsid unparsable uuid 2026-02-18T00:57:54.036 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/ceph-helpers/2/keyring 2026-02-18T00:57:54.036 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T00:57:54.037 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2026-02-18T00:57:54.037 INFO:tasks.workunit.client.0.trial069.stdout:adding osd2 key to auth repository 2026-02-18T00:57:54.038 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/ceph-helpers/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T00:57:54.161 INFO:tasks.workunit.client.0.trial069.stdout:start osd.2 2026-02-18T00:57:54.162 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2026-02-18T00:57:54.163 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --cluster ceph --fsid=863c4e35-ceb0-4172-b7b2-c3ff099e05a2 --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/2 --osd-journal=td/ceph-helpers/2/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T00:57:54.163 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T00:57:54.163 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T00:57:54.163 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T00:57:54.185 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:57:54.172+0000 7ff56fed4a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:57:54.187 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:57:54.172+0000 7ff56fed4a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:57:54.188 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:57:54.172+0000 7ff56fed4a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:57:54.270 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2026-02-18T00:57:54.270 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:57:54.270 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-18T00:57:54.270 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:57:54.270 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:57:54.270 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:57:54.271 INFO:tasks.workunit.client.0.trial069.stdout:0 2026-02-18T00:57:54.271 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:57:54.272 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:57:54.272 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-18T00:57:54.382 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:57:54.550 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:57:54.536+0000 7ff56fed4a40 -1 Falling back to public interface 2026-02-18T00:57:55.167 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:57:55.152+0000 7ff56fed4a40 -1 osd.2 0 log_to_monitors true 2026-02-18T00:57:55.383 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:57:55.383 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:57:55.384 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T00:57:55.384 INFO:tasks.workunit.client.0.trial069.stdout:1 2026-02-18T00:57:55.384 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:57:55.385 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-18T00:57:55.490 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:57:56.492 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:57:56.493 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:57:56.493 INFO:tasks.workunit.client.0.trial069.stdout:2 2026-02-18T00:57:56.494 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-18T00:57:56.494 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:57:56.494 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-18T00:57:56.605 INFO:tasks.workunit.client.0.trial069.stdout:osd.2 up in weight 1 up_from 13 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6816/2448861572,v1:127.0.0.1:6817/2448861572] [v2:127.0.0.1:6818/2448861572,v1:127.0.0.1:6819/2448861572] exists,up f282b7fc-4a8a-4a70-86f6-fdb976182be5 2026-02-18T00:57:56.605 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:57:56.606 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:57:56.606 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:57:56.606 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:498: test_run_mon: create_rbd_pool 2026-02-18T00:57:56.606 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:526: create_rbd_pool: ceph osd pool delete rbd rbd --yes-i-really-really-mean-it 2026-02-18T00:57:56.709 INFO:tasks.workunit.client.0.trial069.stderr:pool 'rbd' does not exist 2026-02-18T00:57:56.716 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:527: create_rbd_pool: create_pool rbd 4 2026-02-18T00:57:56.716 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create rbd 4 2026-02-18T00:57:56.849 INFO:tasks.workunit.client.0.trial069.stderr:pool 'rbd' already exists 2026-02-18T00:57:56.859 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-18T00:57:57.860 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:528: create_rbd_pool: rbd pool init rbd 2026-02-18T00:57:58.129 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:499: test_run_mon: ceph osd dump 2026-02-18T00:57:58.129 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:499: test_run_mon: grep 'pool 1 '\''rbd'\''' 2026-02-18T00:57:58.240 INFO:tasks.workunit.client.0.trial069.stdout:pool 1 'rbd' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 4 pgp_num 4 autoscale_mode off last_change 20 flags hashpspool,selfmanaged_snaps stripe_width 0 application rbd read_balance_score 1.50 2026-02-18T00:57:58.242 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:501: test_run_mon: get_asok_path mon.a 2026-02-18T00:57:58.242 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:57:58.242 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:57:58.242 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:57:58.242 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:57:58.242 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:57:58.243 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.57427/ceph-mon.a.asok 2026-02-18T00:57:58.243 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:501: test_run_mon: CEPH_ARGS= 2026-02-18T00:57:58.243 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:501: test_run_mon: ceph --format=json daemon /tmp/ceph-asok.57427/ceph-mon.a.asok config get osd_pool_default_size 2026-02-18T00:57:58.296 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:501: test_run_mon: local 'size={"osd_pool_default_size":"3"}' 2026-02-18T00:57:58.297 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:502: test_run_mon: test '{"osd_pool_default_size":"3"}' = '{"osd_pool_default_size":"3"}' 2026-02-18T00:57:58.297 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:504: test_run_mon: CEPH_ARGS= 2026-02-18T00:57:58.297 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:504: test_run_mon: ceph status 2026-02-18T00:57:58.398 INFO:tasks.workunit.client.0.trial069.stderr:unable to get monitor info from DNS SRV with service name: ceph-mon 2026-02-18T00:57:58.398 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:57:58.388+0000 7f208ced4640 -1 failed for service _ceph-mon._tcp 2026-02-18T00:57:58.398 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:57:58.388+0000 7f208ced4640 -1 monclient: get_monmap_and_config cannot identify monitors to contact 2026-02-18T00:57:58.399 INFO:tasks.workunit.client.0.trial069.stderr:[errno 2] RADOS object not found (error connecting to the cluster) 2026-02-18T00:57:58.400 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:505: test_run_mon: CEPH_ARGS= 2026-02-18T00:57:58.400 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:505: test_run_mon: ceph --conf td/ceph-helpers/ceph.conf status 2026-02-18T00:57:58.450 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:57:58.436+0000 7fb35af78640 -1 auth: unable to find a keyring on /etc/ceph/ceph.client.admin.keyring,/etc/ceph/ceph.keyring,/etc/ceph/keyring,/etc/ceph/keyring.bin: (2) No such file or directory 2026-02-18T00:57:58.450 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:57:58.436+0000 7fb35af78640 -1 AuthRegistry(0x7fb354053130) no keyring found at /etc/ceph/ceph.client.admin.keyring,/etc/ceph/ceph.keyring,/etc/ceph/keyring,/etc/ceph/keyring.bin, disabling cephx 2026-02-18T00:57:58.450 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:57:58.436+0000 7fb35af78640 -1 auth: unable to find a keyring on /etc/ceph/ceph.client.admin.keyring,/etc/ceph/ceph.keyring,/etc/ceph/keyring,/etc/ceph/keyring.bin: (2) No such file or directory 2026-02-18T00:57:58.451 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:57:58.436+0000 7fb35af78640 -1 AuthRegistry(0x7fb35af76f50) no keyring found at /etc/ceph/ceph.client.admin.keyring,/etc/ceph/ceph.keyring,/etc/ceph/keyring,/etc/ceph/keyring.bin, disabling cephx 2026-02-18T00:57:58.451 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:57:58.436+0000 7fb35af78640 -1 auth: unable to find a keyring on /etc/ceph/ceph.client.admin.keyring,/etc/ceph/ceph.keyring,/etc/ceph/keyring,/etc/ceph/keyring.bin: (2) No such file or directory 2026-02-18T00:57:58.452 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:57:58.436+0000 7fb35af78640 -1 AuthRegistry(0x7fb35404ff10) no keyring found at /etc/ceph/ceph.client.admin.keyring,/etc/ceph/ceph.keyring,/etc/ceph/keyring,/etc/ceph/keyring.bin, disabling cephx 2026-02-18T00:57:58.452 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:57:58.436+0000 7fb35af78640 -1 auth: unable to find a keyring on /etc/ceph/ceph.client.admin.keyring,/etc/ceph/ceph.keyring,/etc/ceph/keyring,/etc/ceph/keyring.bin: (2) No such file or directory 2026-02-18T00:57:58.452 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:57:58.436+0000 7fb35af78640 -1 AuthRegistry(0x7fb35410dfa0) no keyring found at /etc/ceph/ceph.client.admin.keyring,/etc/ceph/ceph.keyring,/etc/ceph/keyring,/etc/ceph/keyring.bin, disabling cephx 2026-02-18T00:57:58.452 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:57:58.436+0000 7fb35af78640 -1 auth: unable to find a keyring on /etc/ceph/ceph.client.admin.keyring,/etc/ceph/ceph.keyring,/etc/ceph/keyring,/etc/ceph/keyring.bin: (2) No such file or directory 2026-02-18T00:57:58.452 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:57:58.436+0000 7fb35af78640 -1 AuthRegistry(0x7fb35404ff10) no keyring found at /etc/ceph/ceph.client.admin.keyring,/etc/ceph/ceph.keyring,/etc/ceph/keyring,/etc/ceph/keyring.bin, disabling cephx 2026-02-18T00:57:58.502 INFO:tasks.workunit.client.0.trial069.stdout: cluster: 2026-02-18T00:57:58.503 INFO:tasks.workunit.client.0.trial069.stdout: id: 863c4e35-ceb0-4172-b7b2-c3ff099e05a2 2026-02-18T00:57:58.503 INFO:tasks.workunit.client.0.trial069.stdout: health: HEALTH_OK 2026-02-18T00:57:58.503 INFO:tasks.workunit.client.0.trial069.stdout: 2026-02-18T00:57:58.503 INFO:tasks.workunit.client.0.trial069.stdout: services: 2026-02-18T00:57:58.503 INFO:tasks.workunit.client.0.trial069.stdout: mon: 1 daemons, quorum a (age 12s) [leader: a] 2026-02-18T00:57:58.503 INFO:tasks.workunit.client.0.trial069.stdout: mgr: no daemons active 2026-02-18T00:57:58.503 INFO:tasks.workunit.client.0.trial069.stdout: osd: 3 osds: 3 up (since 2s), 3 in (since 5s) 2026-02-18T00:57:58.503 INFO:tasks.workunit.client.0.trial069.stdout: 2026-02-18T00:57:58.503 INFO:tasks.workunit.client.0.trial069.stdout: data: 2026-02-18T00:57:58.503 INFO:tasks.workunit.client.0.trial069.stdout: pools: 0 pools, 0 pgs 2026-02-18T00:57:58.503 INFO:tasks.workunit.client.0.trial069.stdout: objects: 0 objects, 0 B 2026-02-18T00:57:58.504 INFO:tasks.workunit.client.0.trial069.stdout: usage: 0 B used, 0 B / 0 B avail 2026-02-18T00:57:58.504 INFO:tasks.workunit.client.0.trial069.stdout: pgs: 2026-02-18T00:57:58.504 INFO:tasks.workunit.client.0.trial069.stdout: 2026-02-18T00:57:58.512 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:507: test_run_mon: kill_daemons td/ceph-helpers 2026-02-18T00:57:58.513 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:57:58.513 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:57:58.514 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:57:58.514 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:57:58.514 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:58:03.829 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:58:03.829 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:509: test_run_mon: run_mon td/ceph-helpers a --osd_pool_default_size=1 --mon_allow_pool_size_one=true 2026-02-18T00:58:03.829 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/ceph-helpers 2026-02-18T00:58:03.830 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-18T00:58:03.830 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-18T00:58:03.830 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-18T00:58:03.830 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/ceph-helpers/a 2026-02-18T00:58:03.830 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/ceph-helpers/a --run-dir=td/ceph-helpers --osd_pool_default_size=1 --mon_allow_pool_size_one=true 2026-02-18T00:58:03.843 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:58:03.828+0000 7f3f1bedeec0 -1 'td/ceph-helpers/a' already exists and is not empty: monitor may already exist 2026-02-18T00:58:03.845 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-18T00:58:03.845 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:58:03.845 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:58:03.846 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:58:03.846 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:58:03.846 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:58:03.846 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.57427/$cluster-$name.asok' 2026-02-18T00:58:03.846 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/ceph-helpers/a '--log-file=td/ceph-helpers/$name.log' '--admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' --mon-cluster-log-file=td/ceph-helpers/log --run-dir=td/ceph-helpers '--pid-file=td/ceph-helpers/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --osd_pool_default_size=1 --mon_allow_pool_size_one=true 2026-02-18T00:58:03.878 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-18T00:58:03.879 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-18T00:58:03.879 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T00:58:03.879 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-18T00:58:03.879 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-18T00:58:03.881 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-18T00:58:03.881 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-18T00:58:03.881 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:58:03.881 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:58:03.881 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:58:03.881 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:58:03.881 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:58:03.882 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.57427/ceph-mon.a.asok 2026-02-18T00:58:03.882 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T00:58:03.882 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.57427/ceph-mon.a.asok config get fsid 2026-02-18T00:58:03.937 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-18T00:58:03.937 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T00:58:03.937 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-18T00:58:03.937 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-18T00:58:03.938 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-18T00:58:03.938 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-18T00:58:03.938 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:58:03.938 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:58:03.938 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:58:03.938 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:58:03.938 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:58:03.939 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.57427/ceph-mon.a.asok 2026-02-18T00:58:03.939 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T00:58:03.939 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.57427/ceph-mon.a.asok config get mon_host 2026-02-18T00:58:03.996 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:511: test_run_mon: get_asok_path mon.a 2026-02-18T00:58:03.996 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:58:03.996 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:58:03.996 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:58:03.996 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:58:03.996 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:58:03.997 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.57427/ceph-mon.a.asok 2026-02-18T00:58:03.997 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:511: test_run_mon: CEPH_ARGS= 2026-02-18T00:58:03.997 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:511: test_run_mon: ceph --format=json daemon /tmp/ceph-asok.57427/ceph-mon.a.asok config get osd_pool_default_size 2026-02-18T00:58:04.049 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:511: test_run_mon: local 'size={"osd_pool_default_size":"1"}' 2026-02-18T00:58:04.049 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:512: test_run_mon: test '{"osd_pool_default_size":"1"}' = '{"osd_pool_default_size":"1"}' 2026-02-18T00:58:04.049 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:513: test_run_mon: kill_daemons td/ceph-helpers 2026-02-18T00:58:04.049 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:58:04.050 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:58:04.050 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:58:04.050 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:58:04.051 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:58:04.358 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:58:04.359 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:515: test_run_mon: CEPH_ARGS='--cluster ceph --fsid=863c4e35-ceb0-4172-b7b2-c3ff099e05a2 --auth-supported=none --mon-host=127.0.0.1:7109 --osd_pool_default_size=2' 2026-02-18T00:58:04.359 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:515: test_run_mon: run_mon td/ceph-helpers a 2026-02-18T00:58:04.359 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/ceph-helpers 2026-02-18T00:58:04.359 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-18T00:58:04.359 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-18T00:58:04.359 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-18T00:58:04.359 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/ceph-helpers/a 2026-02-18T00:58:04.359 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/ceph-helpers/a --run-dir=td/ceph-helpers 2026-02-18T00:58:04.373 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:58:04.360+0000 7f2a004e1ec0 -1 'td/ceph-helpers/a' already exists and is not empty: monitor may already exist 2026-02-18T00:58:04.375 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-18T00:58:04.375 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:58:04.375 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:58:04.375 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:58:04.375 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:58:04.375 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:58:04.375 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.57427/$cluster-$name.asok' 2026-02-18T00:58:04.376 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/ceph-helpers/a '--log-file=td/ceph-helpers/$name.log' '--admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' --mon-cluster-log-file=td/ceph-helpers/log --run-dir=td/ceph-helpers '--pid-file=td/ceph-helpers/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-18T00:58:04.404 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-18T00:58:04.406 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-18T00:58:04.406 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T00:58:04.406 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-18T00:58:04.406 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-18T00:58:04.406 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-18T00:58:04.407 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-18T00:58:04.408 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:58:04.408 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:58:04.408 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:58:04.408 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:58:04.408 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:58:04.408 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.57427/ceph-mon.a.asok 2026-02-18T00:58:04.408 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T00:58:04.408 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.57427/ceph-mon.a.asok config get fsid 2026-02-18T00:58:04.474 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-18T00:58:04.474 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T00:58:04.474 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-18T00:58:04.474 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-18T00:58:04.474 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-18T00:58:04.476 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-18T00:58:04.476 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:58:04.476 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:58:04.476 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:58:04.476 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:58:04.476 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:58:04.476 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.57427/ceph-mon.a.asok 2026-02-18T00:58:04.476 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T00:58:04.476 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.57427/ceph-mon.a.asok config get mon_host 2026-02-18T00:58:04.538 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:518: test_run_mon: get_asok_path mon.a 2026-02-18T00:58:04.538 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:58:04.539 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:58:04.539 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:58:04.540 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:58:04.540 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:58:04.540 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.57427/ceph-mon.a.asok 2026-02-18T00:58:04.540 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:518: test_run_mon: CEPH_ARGS= 2026-02-18T00:58:04.540 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:518: test_run_mon: ceph --format=json daemon /tmp/ceph-asok.57427/ceph-mon.a.asok config get osd_pool_default_size 2026-02-18T00:58:04.595 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:518: test_run_mon: local 'size={"osd_pool_default_size":"2"}' 2026-02-18T00:58:04.595 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:519: test_run_mon: test '{"osd_pool_default_size":"2"}' = '{"osd_pool_default_size":"2"}' 2026-02-18T00:58:04.595 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:520: test_run_mon: kill_daemons td/ceph-helpers 2026-02-18T00:58:04.596 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:58:04.596 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:58:04.596 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:58:04.596 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:58:04.596 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:58:04.904 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:58:04.904 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:522: test_run_mon: teardown td/ceph-helpers 2026-02-18T00:58:04.905 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/ceph-helpers 2026-02-18T00:58:04.905 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T00:58:04.905 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/ceph-helpers KILL 2026-02-18T00:58:04.905 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:58:04.905 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:58:04.906 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:58:04.906 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:58:04.906 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:58:04.911 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:58:04.911 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T00:58:04.912 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T00:58:04.912 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T00:58:04.913 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T00:58:04.913 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T00:58:04.913 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T00:58:04.915 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:58:04.915 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T00:58:04.915 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T00:58:04.916 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:58:04.916 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T00:58:04.917 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T00:58:04.917 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/ceph-helpers 2026-02-18T00:58:04.924 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T00:58:04.924 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:58:04.924 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:58:04.924 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.57427 2026-02-18T00:58:04.926 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T00:58:04.927 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T00:58:04.927 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2426: run_tests: for func in $funcs 2026-02-18T00:58:04.927 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2427: run_tests: test_run_osd td/ceph-helpers 2026-02-18T00:58:04.927 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:736: test_run_osd: local dir=td/ceph-helpers 2026-02-18T00:58:04.927 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:738: test_run_osd: setup td/ceph-helpers 2026-02-18T00:58:04.927 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/ceph-helpers 2026-02-18T00:58:04.927 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/ceph-helpers 2026-02-18T00:58:04.927 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/ceph-helpers 2026-02-18T00:58:04.927 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T00:58:04.927 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/ceph-helpers KILL 2026-02-18T00:58:04.927 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:58:04.927 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:58:04.928 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:58:04.928 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:58:04.928 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:58:04.929 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:58:04.929 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T00:58:04.929 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T00:58:04.930 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T00:58:04.931 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T00:58:04.931 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T00:58:04.931 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T00:58:04.932 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:58:04.932 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T00:58:04.933 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T00:58:04.933 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:58:04.934 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T00:58:04.935 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T00:58:04.935 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/ceph-helpers 2026-02-18T00:58:04.937 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T00:58:04.937 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:58:04.937 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:58:04.937 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.57427 2026-02-18T00:58:04.938 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T00:58:04.938 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T00:58:04.938 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/ceph-helpers 2026-02-18T00:58:04.939 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-18T00:58:04.940 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:58:04.940 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:58:04.940 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.57427 2026-02-18T00:58:04.941 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-18T00:58:04.942 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-18T00:58:04.942 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-18T00:58:04.942 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/ceph-helpers 1' TERM HUP INT 2026-02-18T00:58:04.942 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:740: test_run_osd: run_mon td/ceph-helpers a 2026-02-18T00:58:04.942 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/ceph-helpers 2026-02-18T00:58:04.942 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-18T00:58:04.942 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-18T00:58:04.942 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-18T00:58:04.943 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/ceph-helpers/a 2026-02-18T00:58:04.943 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/ceph-helpers/a --run-dir=td/ceph-helpers 2026-02-18T00:58:04.963 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-18T00:58:04.963 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:58:04.963 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:58:04.963 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:58:04.963 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:58:04.963 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:58:04.964 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.57427/$cluster-$name.asok' 2026-02-18T00:58:04.964 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/ceph-helpers/a '--log-file=td/ceph-helpers/$name.log' '--admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' --mon-cluster-log-file=td/ceph-helpers/log --run-dir=td/ceph-helpers '--pid-file=td/ceph-helpers/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-18T00:58:04.991 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-18T00:58:04.993 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-18T00:58:04.993 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T00:58:04.993 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-18T00:58:04.993 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-18T00:58:04.993 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-18T00:58:04.994 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-18T00:58:04.994 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:58:04.994 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:58:04.994 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:58:04.995 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:58:04.995 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:58:04.995 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.57427/ceph-mon.a.asok 2026-02-18T00:58:04.995 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T00:58:04.995 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.57427/ceph-mon.a.asok config get fsid 2026-02-18T00:58:05.050 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-18T00:58:05.050 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T00:58:05.051 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-18T00:58:05.051 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-18T00:58:05.051 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-18T00:58:05.052 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-18T00:58:05.052 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:58:05.052 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:58:05.052 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:58:05.052 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:58:05.052 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:58:05.053 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.57427/ceph-mon.a.asok 2026-02-18T00:58:05.053 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T00:58:05.053 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.57427/ceph-mon.a.asok config get mon_host 2026-02-18T00:58:05.108 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:741: test_run_osd: run_mgr td/ceph-helpers x 2026-02-18T00:58:05.108 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/ceph-helpers 2026-02-18T00:58:05.108 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-18T00:58:05.108 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-18T00:58:05.109 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-18T00:58:05.109 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/ceph-helpers/x 2026-02-18T00:58:05.109 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-18T00:58:05.224 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-18T00:58:05.224 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:58:05.224 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:58:05.225 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:58:05.225 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:58:05.225 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:58:05.225 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.57427/$cluster-$name.asok' 2026-02-18T00:58:05.225 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-18T00:58:05.226 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/ceph-helpers/x '--log-file=td/ceph-helpers/$name.log' '--admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' --run-dir=td/ceph-helpers '--pid-file=td/ceph-helpers/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-18T00:58:05.245 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:743: test_run_osd: run_osd td/ceph-helpers 0 2026-02-18T00:58:05.245 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/ceph-helpers 2026-02-18T00:58:05.245 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T00:58:05.245 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-18T00:58:05.245 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T00:58:05.245 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/ceph-helpers/0 2026-02-18T00:58:05.245 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--cluster ceph --fsid=863c4e35-ceb0-4172-b7b2-c3ff099e05a2 --auth-supported=none --mon-host=127.0.0.1:7109 ' 2026-02-18T00:58:05.246 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T00:58:05.246 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T00:58:05.246 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T00:58:05.246 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/ceph-helpers/0' 2026-02-18T00:58:05.246 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/ceph-helpers/0/journal' 2026-02-18T00:58:05.246 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T00:58:05.247 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-18T00:58:05.247 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/ceph-helpers' 2026-02-18T00:58:05.247 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T00:58:05.247 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:58:05.247 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:58:05.247 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:58:05.247 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:58:05.247 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:58:05.247 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.57427/$cluster-$name.asok' 2026-02-18T00:58:05.247 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' 2026-02-18T00:58:05.247 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T00:58:05.248 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T00:58:05.248 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T00:58:05.248 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/ceph-helpers/$name.log' 2026-02-18T00:58:05.248 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/ceph-helpers/$name.pid' 2026-02-18T00:58:05.248 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T00:58:05.248 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T00:58:05.248 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T00:58:05.248 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T00:58:05.248 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T00:58:05.248 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-18T00:58:05.248 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/ceph-helpers/0 2026-02-18T00:58:05.249 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T00:58:05.249 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=6ff591ed-2842-4b33-8641-246eb2b7c9ee 2026-02-18T00:58:05.250 INFO:tasks.workunit.client.0.trial069.stdout:add osd0 6ff591ed-2842-4b33-8641-246eb2b7c9ee 2026-02-18T00:58:05.250 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 6ff591ed-2842-4b33-8641-246eb2b7c9ee' 2026-02-18T00:58:05.250 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T00:58:05.258 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQCdDpVp/rrQDhAA1kQmY0oJ+A0OE50RTL+f6g== 2026-02-18T00:58:05.258 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQCdDpVp/rrQDhAA1kQmY0oJ+A0OE50RTL+f6g=="}' 2026-02-18T00:58:05.258 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 6ff591ed-2842-4b33-8641-246eb2b7c9ee -i td/ceph-helpers/0/new.json 2026-02-18T00:58:05.367 INFO:tasks.workunit.client.0.trial069.stdout:0 2026-02-18T00:58:05.375 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/ceph-helpers/0/new.json 2026-02-18T00:58:05.376 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --cluster ceph --fsid=863c4e35-ceb0-4172-b7b2-c3ff099e05a2 --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/0 --osd-journal=td/ceph-helpers/0/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCdDpVp/rrQDhAA1kQmY0oJ+A0OE50RTL+f6g== --osd-uuid 6ff591ed-2842-4b33-8641-246eb2b7c9ee 2026-02-18T00:58:05.391 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:58:05.376+0000 7f56ab3b1a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:58:05.392 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:58:05.380+0000 7f56ab3b1a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:58:05.393 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:58:05.380+0000 7f56ab3b1a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:58:05.394 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:58:05.380+0000 7f56ab3b1a40 -1 bdev(0x563e7d27ac00 td/ceph-helpers/0/block) open stat got: (1) Operation not permitted 2026-02-18T00:58:05.394 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:58:05.380+0000 7f56ab3b1a40 -1 bluestore(td/ceph-helpers/0) _read_fsid unparsable uuid 2026-02-18T00:58:06.164 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/ceph-helpers/0/keyring 2026-02-18T00:58:06.164 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T00:58:06.165 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-18T00:58:06.165 INFO:tasks.workunit.client.0.trial069.stdout:adding osd0 key to auth repository 2026-02-18T00:58:06.166 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/ceph-helpers/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T00:58:06.285 INFO:tasks.workunit.client.0.trial069.stdout:start osd.0 2026-02-18T00:58:06.286 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-18T00:58:06.286 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --cluster ceph --fsid=863c4e35-ceb0-4172-b7b2-c3ff099e05a2 --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/0 --osd-journal=td/ceph-helpers/0/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T00:58:06.286 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T00:58:06.286 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T00:58:06.286 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T00:58:06.308 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:58:06.296+0000 7f887d278a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:58:06.312 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:58:06.296+0000 7f887d278a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:58:06.313 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:58:06.300+0000 7f887d278a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:58:06.396 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-18T00:58:06.396 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:58:06.396 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-18T00:58:06.397 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:58:06.397 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:58:06.397 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:58:06.397 INFO:tasks.workunit.client.0.trial069.stdout:0 2026-02-18T00:58:06.398 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:58:06.398 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:58:06.398 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T00:58:06.506 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:58:06.806 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:58:06.792+0000 7f887d278a40 -1 Falling back to public interface 2026-02-18T00:58:07.507 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:58:07.508 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:58:07.508 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T00:58:07.508 INFO:tasks.workunit.client.0.trial069.stdout:1 2026-02-18T00:58:07.509 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:58:07.509 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T00:58:07.720 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:58:07.734 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:58:07.720+0000 7f887d278a40 -1 osd.0 0 log_to_monitors true 2026-02-18T00:58:08.722 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:58:08.723 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:58:08.723 INFO:tasks.workunit.client.0.trial069.stdout:2 2026-02-18T00:58:08.724 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-18T00:58:08.724 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:58:08.724 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T00:58:08.934 INFO:tasks.workunit.client.0.trial069.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/2723839036,v1:127.0.0.1:6801/2723839036] [v2:127.0.0.1:6802/2723839036,v1:127.0.0.1:6803/2723839036] exists,up 6ff591ed-2842-4b33-8641-246eb2b7c9ee 2026-02-18T00:58:08.935 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:58:08.935 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:58:08.935 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:58:08.936 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:745: test_run_osd: get_asok_path osd.0 2026-02-18T00:58:08.936 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-18T00:58:08.936 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-18T00:58:08.936 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:58:08.936 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:58:08.936 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:58:08.937 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.57427/ceph-osd.0.asok 2026-02-18T00:58:08.937 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:745: test_run_osd: CEPH_ARGS= 2026-02-18T00:58:08.937 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:745: test_run_osd: ceph --format=json daemon /tmp/ceph-asok.57427/ceph-osd.0.asok config get osd_max_backfills 2026-02-18T00:58:08.995 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:745: test_run_osd: local 'backfills={"osd_max_backfills":"1"}' 2026-02-18T00:58:08.995 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:746: test_run_osd: echo '{"osd_max_backfills":"1"}' 2026-02-18T00:58:08.996 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:746: test_run_osd: grep --quiet osd_max_backfills 2026-02-18T00:58:08.999 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:748: test_run_osd: run_osd td/ceph-helpers 1 --osd-max-backfills 20 2026-02-18T00:58:08.999 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/ceph-helpers 2026-02-18T00:58:09.000 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T00:58:09.000 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2026-02-18T00:58:09.000 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T00:58:09.000 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/ceph-helpers/1 2026-02-18T00:58:09.000 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--cluster ceph --fsid=863c4e35-ceb0-4172-b7b2-c3ff099e05a2 --auth-supported=none --mon-host=127.0.0.1:7109 ' 2026-02-18T00:58:09.000 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T00:58:09.000 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T00:58:09.000 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T00:58:09.000 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/ceph-helpers/1' 2026-02-18T00:58:09.000 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/ceph-helpers/1/journal' 2026-02-18T00:58:09.001 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T00:58:09.001 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-18T00:58:09.001 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/ceph-helpers' 2026-02-18T00:58:09.001 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T00:58:09.001 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:58:09.001 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:58:09.001 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:58:09.001 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:58:09.001 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:58:09.001 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.57427/$cluster-$name.asok' 2026-02-18T00:58:09.001 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' 2026-02-18T00:58:09.001 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T00:58:09.001 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T00:58:09.002 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T00:58:09.002 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/ceph-helpers/$name.log' 2026-02-18T00:58:09.002 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/ceph-helpers/$name.pid' 2026-02-18T00:58:09.002 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T00:58:09.002 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T00:58:09.002 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T00:58:09.002 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T00:58:09.002 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T00:58:09.002 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+='--osd-max-backfills 20' 2026-02-18T00:58:09.002 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/ceph-helpers/1 2026-02-18T00:58:09.003 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T00:58:09.003 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=deb06a6b-5128-40ff-aa68-0842ce825264 2026-02-18T00:58:09.003 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 deb06a6b-5128-40ff-aa68-0842ce825264' 2026-02-18T00:58:09.003 INFO:tasks.workunit.client.0.trial069.stdout:add osd1 deb06a6b-5128-40ff-aa68-0842ce825264 2026-02-18T00:58:09.004 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T00:58:09.013 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQChDpVp3XIzABAAQLRFwhv07S4IFH4ebuEEUw== 2026-02-18T00:58:09.013 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQChDpVp3XIzABAAQLRFwhv07S4IFH4ebuEEUw=="}' 2026-02-18T00:58:09.013 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new deb06a6b-5128-40ff-aa68-0842ce825264 -i td/ceph-helpers/1/new.json 2026-02-18T00:58:09.225 INFO:tasks.workunit.client.0.trial069.stdout:1 2026-02-18T00:58:09.233 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/ceph-helpers/1/new.json 2026-02-18T00:58:09.235 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --cluster ceph --fsid=863c4e35-ceb0-4172-b7b2-c3ff099e05a2 --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/1 --osd-journal=td/ceph-helpers/1/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd-max-backfills 20 --mkfs --key AQChDpVp3XIzABAAQLRFwhv07S4IFH4ebuEEUw== --osd-uuid deb06a6b-5128-40ff-aa68-0842ce825264 2026-02-18T00:58:09.259 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:58:09.244+0000 7f64e3ee7a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:58:09.260 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:58:09.248+0000 7f64e3ee7a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:58:09.262 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:58:09.248+0000 7f64e3ee7a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:58:09.262 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:58:09.248+0000 7f64e3ee7a40 -1 bdev(0x55b9c3ca8c00 td/ceph-helpers/1/block) open stat got: (1) Operation not permitted 2026-02-18T00:58:09.262 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:58:09.248+0000 7f64e3ee7a40 -1 bluestore(td/ceph-helpers/1) _read_fsid unparsable uuid 2026-02-18T00:58:09.919 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/ceph-helpers/1/keyring 2026-02-18T00:58:09.919 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T00:58:09.919 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2026-02-18T00:58:09.920 INFO:tasks.workunit.client.0.trial069.stdout:adding osd1 key to auth repository 2026-02-18T00:58:09.920 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/ceph-helpers/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T00:58:10.213 INFO:tasks.workunit.client.0.trial069.stdout:start osd.1 2026-02-18T00:58:10.214 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2026-02-18T00:58:10.214 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --cluster ceph --fsid=863c4e35-ceb0-4172-b7b2-c3ff099e05a2 --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/1 --osd-journal=td/ceph-helpers/1/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd-max-backfills 20 2026-02-18T00:58:10.214 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T00:58:10.214 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T00:58:10.214 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T00:58:10.237 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:58:10.224+0000 7f550b3e1a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:58:10.239 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:58:10.224+0000 7f550b3e1a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:58:10.240 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:58:10.228+0000 7f550b3e1a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:58:10.431 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2026-02-18T00:58:10.431 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:58:10.431 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-18T00:58:10.431 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:58:10.431 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:58:10.432 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:58:10.432 INFO:tasks.workunit.client.0.trial069.stdout:0 2026-02-18T00:58:10.432 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:58:10.433 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:58:10.433 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-18T00:58:10.643 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:58:10.686 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:58:10.672+0000 7f550b3e1a40 -1 Falling back to public interface 2026-02-18T00:58:11.284 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:58:11.268+0000 7f550b3e1a40 -1 osd.1 0 log_to_monitors true 2026-02-18T00:58:11.644 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:58:11.645 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:58:11.645 INFO:tasks.workunit.client.0.trial069.stdout:1 2026-02-18T00:58:11.646 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T00:58:11.646 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:58:11.646 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-18T00:58:11.866 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:58:12.867 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:58:12.867 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:58:12.868 INFO:tasks.workunit.client.0.trial069.stdout:2 2026-02-18T00:58:12.868 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-18T00:58:12.868 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:58:12.868 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-18T00:58:13.074 INFO:tasks.workunit.client.0.trial069.stdout:osd.1 up in weight 1 up_from 9 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/3497629060,v1:127.0.0.1:6811/3497629060] [v2:127.0.0.1:6812/3497629060,v1:127.0.0.1:6813/3497629060] exists,up deb06a6b-5128-40ff-aa68-0842ce825264 2026-02-18T00:58:13.074 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:58:13.074 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:58:13.075 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:58:13.076 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:750: test_run_osd: get_asok_path osd.1 2026-02-18T00:58:13.076 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.1 2026-02-18T00:58:13.076 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.1 ']' 2026-02-18T00:58:13.076 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:58:13.076 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:58:13.076 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:58:13.076 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.57427/ceph-osd.1.asok 2026-02-18T00:58:13.076 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:750: test_run_osd: CEPH_ARGS= 2026-02-18T00:58:13.076 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:750: test_run_osd: ceph --format=json daemon /tmp/ceph-asok.57427/ceph-osd.1.asok config get osd_max_backfills 2026-02-18T00:58:13.136 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:750: test_run_osd: local 'backfills={"osd_max_backfills":"20"}' 2026-02-18T00:58:13.136 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:751: test_run_osd: test '{"osd_max_backfills":"20"}' = '{"osd_max_backfills":"20"}' 2026-02-18T00:58:13.136 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:753: test_run_osd: CEPH_ARGS='--cluster ceph --fsid=863c4e35-ceb0-4172-b7b2-c3ff099e05a2 --auth-supported=none --mon-host=127.0.0.1:7109 --osd-max-backfills 30' 2026-02-18T00:58:13.137 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:753: test_run_osd: run_osd td/ceph-helpers 2 2026-02-18T00:58:13.137 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/ceph-helpers 2026-02-18T00:58:13.137 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T00:58:13.137 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2026-02-18T00:58:13.137 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T00:58:13.137 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/ceph-helpers/2 2026-02-18T00:58:13.137 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--cluster ceph --fsid=863c4e35-ceb0-4172-b7b2-c3ff099e05a2 --auth-supported=none --mon-host=127.0.0.1:7109 --osd-max-backfills 30' 2026-02-18T00:58:13.137 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T00:58:13.137 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T00:58:13.137 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T00:58:13.137 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/ceph-helpers/2' 2026-02-18T00:58:13.137 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/ceph-helpers/2/journal' 2026-02-18T00:58:13.138 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T00:58:13.138 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-18T00:58:13.138 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/ceph-helpers' 2026-02-18T00:58:13.138 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T00:58:13.138 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:58:13.138 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:58:13.138 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:58:13.138 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:58:13.138 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:58:13.138 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.57427/$cluster-$name.asok' 2026-02-18T00:58:13.138 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' 2026-02-18T00:58:13.138 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T00:58:13.139 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T00:58:13.139 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T00:58:13.139 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/ceph-helpers/$name.log' 2026-02-18T00:58:13.139 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/ceph-helpers/$name.pid' 2026-02-18T00:58:13.139 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T00:58:13.139 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T00:58:13.139 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T00:58:13.139 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T00:58:13.139 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T00:58:13.139 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-18T00:58:13.139 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/ceph-helpers/2 2026-02-18T00:58:13.139 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T00:58:13.140 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=c9a5b4e8-94f6-493a-9847-084c2c75b1f7 2026-02-18T00:58:13.140 INFO:tasks.workunit.client.0.trial069.stdout:add osd2 c9a5b4e8-94f6-493a-9847-084c2c75b1f7 2026-02-18T00:58:13.141 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 c9a5b4e8-94f6-493a-9847-084c2c75b1f7' 2026-02-18T00:58:13.141 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T00:58:13.150 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQClDpVpQ09aCBAAuD1Crt688lYoNG3Gu+1kUw== 2026-02-18T00:58:13.150 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQClDpVpQ09aCBAAuD1Crt688lYoNG3Gu+1kUw=="}' 2026-02-18T00:58:13.150 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new c9a5b4e8-94f6-493a-9847-084c2c75b1f7 -i td/ceph-helpers/2/new.json 2026-02-18T00:58:13.368 INFO:tasks.workunit.client.0.trial069.stdout:2 2026-02-18T00:58:13.379 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/ceph-helpers/2/new.json 2026-02-18T00:58:13.380 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --cluster ceph --fsid=863c4e35-ceb0-4172-b7b2-c3ff099e05a2 --auth-supported=none --mon-host=127.0.0.1:7109 --osd-max-backfills 30 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/2 --osd-journal=td/ceph-helpers/2/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQClDpVpQ09aCBAAuD1Crt688lYoNG3Gu+1kUw== --osd-uuid c9a5b4e8-94f6-493a-9847-084c2c75b1f7 2026-02-18T00:58:13.403 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:58:13.388+0000 7fd9f6677a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:58:13.405 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:58:13.392+0000 7fd9f6677a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:58:13.406 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:58:13.392+0000 7fd9f6677a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:58:13.407 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:58:13.392+0000 7fd9f6677a40 -1 bdev(0x55d6c8cbec00 td/ceph-helpers/2/block) open stat got: (1) Operation not permitted 2026-02-18T00:58:13.407 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:58:13.392+0000 7fd9f6677a40 -1 bluestore(td/ceph-helpers/2) _read_fsid unparsable uuid 2026-02-18T00:58:14.038 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/ceph-helpers/2/keyring 2026-02-18T00:58:14.038 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T00:58:14.039 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2026-02-18T00:58:14.039 INFO:tasks.workunit.client.0.trial069.stdout:adding osd2 key to auth repository 2026-02-18T00:58:14.040 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/ceph-helpers/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T00:58:14.341 INFO:tasks.workunit.client.0.trial069.stdout:start osd.2 2026-02-18T00:58:14.342 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2026-02-18T00:58:14.342 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --cluster ceph --fsid=863c4e35-ceb0-4172-b7b2-c3ff099e05a2 --auth-supported=none --mon-host=127.0.0.1:7109 --osd-max-backfills 30 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/2 --osd-journal=td/ceph-helpers/2/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T00:58:14.342 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T00:58:14.342 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T00:58:14.342 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T00:58:14.366 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:58:14.352+0000 7fcb018e4a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:58:14.368 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:58:14.352+0000 7fcb018e4a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:58:14.369 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:58:14.356+0000 7fcb018e4a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:58:14.548 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2026-02-18T00:58:14.548 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:58:14.548 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-18T00:58:14.548 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:58:14.548 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:58:14.548 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:58:14.548 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:58:14.549 INFO:tasks.workunit.client.0.trial069.stdout:0 2026-02-18T00:58:14.549 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:58:14.549 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-18T00:58:14.694 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:58:14.680+0000 7fcb018e4a40 -1 Falling back to public interface 2026-02-18T00:58:14.765 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:58:15.354 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:58:15.340+0000 7fcb018e4a40 -1 osd.2 0 log_to_monitors true 2026-02-18T00:58:15.767 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:58:15.767 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:58:15.768 INFO:tasks.workunit.client.0.trial069.stdout:1 2026-02-18T00:58:15.768 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T00:58:15.768 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:58:15.768 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-18T00:58:15.988 INFO:tasks.workunit.client.0.trial069.stdout:osd.2 up in weight 1 up_from 13 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/867162070,v1:127.0.0.1:6819/867162070] [v2:127.0.0.1:6820/867162070,v1:127.0.0.1:6821/867162070] exists,up c9a5b4e8-94f6-493a-9847-084c2c75b1f7 2026-02-18T00:58:15.989 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:58:15.990 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:58:15.990 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:58:15.990 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:755: test_run_osd: get_asok_path osd.2 2026-02-18T00:58:15.990 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.2 2026-02-18T00:58:15.990 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.2 ']' 2026-02-18T00:58:15.991 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:58:15.991 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:58:15.991 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:58:15.991 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.57427/ceph-osd.2.asok 2026-02-18T00:58:15.991 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:755: test_run_osd: CEPH_ARGS= 2026-02-18T00:58:15.991 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:755: test_run_osd: ceph --format=json daemon /tmp/ceph-asok.57427/ceph-osd.2.asok config get osd_max_backfills 2026-02-18T00:58:16.051 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:755: test_run_osd: local 'backfills={"osd_max_backfills":"30"}' 2026-02-18T00:58:16.051 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:756: test_run_osd: test '{"osd_max_backfills":"30"}' = '{"osd_max_backfills":"30"}' 2026-02-18T00:58:16.051 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:758: test_run_osd: teardown td/ceph-helpers 2026-02-18T00:58:16.051 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/ceph-helpers 2026-02-18T00:58:16.051 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T00:58:16.051 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/ceph-helpers KILL 2026-02-18T00:58:16.051 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:58:16.051 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:58:16.052 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:58:16.052 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:58:16.052 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:58:16.160 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:58:16.160 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T00:58:16.161 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T00:58:16.162 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T00:58:16.163 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T00:58:16.163 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T00:58:16.164 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T00:58:16.165 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:58:16.165 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T00:58:16.165 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T00:58:16.166 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:58:16.166 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T00:58:16.168 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T00:58:16.168 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/ceph-helpers 2026-02-18T00:58:16.175 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T00:58:16.175 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:58:16.176 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:58:16.176 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.57427 2026-02-18T00:58:16.178 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T00:58:16.178 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T00:58:16.178 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2426: run_tests: for func in $funcs 2026-02-18T00:58:16.178 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2427: run_tests: test_set_config td/ceph-helpers 2026-02-18T00:58:16.178 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1163: test_set_config: local dir=td/ceph-helpers 2026-02-18T00:58:16.178 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1165: test_set_config: setup td/ceph-helpers 2026-02-18T00:58:16.179 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/ceph-helpers 2026-02-18T00:58:16.179 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/ceph-helpers 2026-02-18T00:58:16.179 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/ceph-helpers 2026-02-18T00:58:16.179 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T00:58:16.179 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/ceph-helpers KILL 2026-02-18T00:58:16.179 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:58:16.179 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:58:16.179 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:58:16.179 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:58:16.179 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:58:16.180 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:58:16.181 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T00:58:16.181 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T00:58:16.182 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T00:58:16.183 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T00:58:16.183 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T00:58:16.183 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T00:58:16.184 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:58:16.184 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T00:58:16.185 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T00:58:16.185 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:58:16.186 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T00:58:16.187 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T00:58:16.187 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/ceph-helpers 2026-02-18T00:58:16.188 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T00:58:16.189 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:58:16.189 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:58:16.189 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.57427 2026-02-18T00:58:16.190 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T00:58:16.190 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T00:58:16.190 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/ceph-helpers 2026-02-18T00:58:16.191 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-18T00:58:16.191 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:58:16.191 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:58:16.191 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.57427 2026-02-18T00:58:16.192 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-18T00:58:16.193 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-18T00:58:16.194 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-18T00:58:16.194 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/ceph-helpers 1' TERM HUP INT 2026-02-18T00:58:16.194 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1166: test_set_config: run_mon td/ceph-helpers a --osd_pool_default_size=1 --mon_allow_pool_size_one=true 2026-02-18T00:58:16.194 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/ceph-helpers 2026-02-18T00:58:16.194 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-18T00:58:16.194 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-18T00:58:16.194 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-18T00:58:16.194 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/ceph-helpers/a 2026-02-18T00:58:16.194 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/ceph-helpers/a --run-dir=td/ceph-helpers --osd_pool_default_size=1 --mon_allow_pool_size_one=true 2026-02-18T00:58:16.216 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-18T00:58:16.216 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:58:16.216 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:58:16.217 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:58:16.217 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:58:16.217 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:58:16.217 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.57427/$cluster-$name.asok' 2026-02-18T00:58:16.217 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/ceph-helpers/a '--log-file=td/ceph-helpers/$name.log' '--admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' --mon-cluster-log-file=td/ceph-helpers/log --run-dir=td/ceph-helpers '--pid-file=td/ceph-helpers/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --osd_pool_default_size=1 --mon_allow_pool_size_one=true 2026-02-18T00:58:16.244 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-18T00:58:16.246 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-18T00:58:16.246 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T00:58:16.246 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-18T00:58:16.246 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-18T00:58:16.246 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-18T00:58:16.247 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-18T00:58:16.247 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:58:16.247 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:58:16.247 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:58:16.247 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:58:16.247 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:58:16.248 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.57427/ceph-mon.a.asok 2026-02-18T00:58:16.248 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T00:58:16.248 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.57427/ceph-mon.a.asok config get fsid 2026-02-18T00:58:16.309 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-18T00:58:16.309 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T00:58:16.309 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-18T00:58:16.309 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-18T00:58:16.310 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-18T00:58:16.311 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-18T00:58:16.311 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:58:16.311 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:58:16.311 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:58:16.311 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:58:16.311 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:58:16.311 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.57427/ceph-mon.a.asok 2026-02-18T00:58:16.311 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T00:58:16.311 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.57427/ceph-mon.a.asok config get mon_host 2026-02-18T00:58:16.365 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1167: test_set_config: get_config mon a ms_crc_header 2026-02-18T00:58:16.365 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T00:58:16.365 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-18T00:58:16.365 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=ms_crc_header 2026-02-18T00:58:16.365 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .ms_crc_header 2026-02-18T00:58:16.366 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-18T00:58:16.366 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:58:16.366 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:58:16.366 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:58:16.366 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:58:16.367 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:58:16.367 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.57427/ceph-mon.a.asok 2026-02-18T00:58:16.367 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T00:58:16.367 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.57427/ceph-mon.a.asok config get ms_crc_header 2026-02-18T00:58:16.424 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1167: test_set_config: test true = true 2026-02-18T00:58:16.424 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1168: test_set_config: set_config mon a ms_crc_header false 2026-02-18T00:58:16.424 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1152: set_config: local daemon=mon 2026-02-18T00:58:16.424 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1153: set_config: local id=a 2026-02-18T00:58:16.424 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1154: set_config: local config=ms_crc_header 2026-02-18T00:58:16.424 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1155: set_config: local value=false 2026-02-18T00:58:16.425 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: jq 'has("success")' 2026-02-18T00:58:16.425 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: get_asok_path mon.a 2026-02-18T00:58:16.425 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:58:16.426 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:58:16.426 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:58:16.426 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:58:16.426 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:58:16.426 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.57427/ceph-mon.a.asok 2026-02-18T00:58:16.426 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: env CEPH_ARGS= ceph --format json daemon /tmp/ceph-asok.57427/ceph-mon.a.asok config set ms_crc_header false 2026-02-18T00:58:16.480 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: test true == true 2026-02-18T00:58:16.481 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1169: test_set_config: get_config mon a ms_crc_header 2026-02-18T00:58:16.481 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T00:58:16.481 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-18T00:58:16.481 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=ms_crc_header 2026-02-18T00:58:16.483 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .ms_crc_header 2026-02-18T00:58:16.483 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-18T00:58:16.483 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:58:16.483 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:58:16.483 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:58:16.483 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:58:16.483 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:58:16.483 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.57427/ceph-mon.a.asok 2026-02-18T00:58:16.483 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T00:58:16.483 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.57427/ceph-mon.a.asok config get ms_crc_header 2026-02-18T00:58:16.537 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1169: test_set_config: test false = false 2026-02-18T00:58:16.537 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1170: test_set_config: set_config mon a ms_crc_header true 2026-02-18T00:58:16.537 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1152: set_config: local daemon=mon 2026-02-18T00:58:16.537 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1153: set_config: local id=a 2026-02-18T00:58:16.537 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1154: set_config: local config=ms_crc_header 2026-02-18T00:58:16.537 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1155: set_config: local value=true 2026-02-18T00:58:16.538 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: jq 'has("success")' 2026-02-18T00:58:16.538 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: get_asok_path mon.a 2026-02-18T00:58:16.538 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:58:16.539 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:58:16.539 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:58:16.539 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:58:16.539 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:58:16.539 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.57427/ceph-mon.a.asok 2026-02-18T00:58:16.539 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: env CEPH_ARGS= ceph --format json daemon /tmp/ceph-asok.57427/ceph-mon.a.asok config set ms_crc_header true 2026-02-18T00:58:16.593 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: test true == true 2026-02-18T00:58:16.593 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1171: test_set_config: get_config mon a ms_crc_header 2026-02-18T00:58:16.593 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T00:58:16.594 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-18T00:58:16.594 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=ms_crc_header 2026-02-18T00:58:16.595 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .ms_crc_header 2026-02-18T00:58:16.595 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-18T00:58:16.595 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:58:16.595 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:58:16.595 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:58:16.595 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:58:16.595 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:58:16.595 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.57427/ceph-mon.a.asok 2026-02-18T00:58:16.596 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T00:58:16.596 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.57427/ceph-mon.a.asok config get ms_crc_header 2026-02-18T00:58:16.649 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1171: test_set_config: test true = true 2026-02-18T00:58:16.649 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1172: test_set_config: teardown td/ceph-helpers 2026-02-18T00:58:16.649 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/ceph-helpers 2026-02-18T00:58:16.649 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T00:58:16.650 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/ceph-helpers KILL 2026-02-18T00:58:16.650 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:58:16.650 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:58:16.651 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:58:16.651 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:58:16.651 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:58:16.757 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:58:16.757 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T00:58:16.758 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T00:58:16.758 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T00:58:16.759 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T00:58:16.760 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T00:58:16.760 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T00:58:16.761 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:58:16.761 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T00:58:16.761 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T00:58:16.761 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:58:16.762 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T00:58:16.763 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T00:58:16.763 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/ceph-helpers 2026-02-18T00:58:16.766 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T00:58:16.766 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:58:16.766 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:58:16.766 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.57427 2026-02-18T00:58:16.768 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T00:58:16.768 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T00:58:16.768 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2426: run_tests: for func in $funcs 2026-02-18T00:58:16.768 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2427: run_tests: test_setup td/ceph-helpers 2026-02-18T00:58:16.769 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: test_setup: local dir=td/ceph-helpers 2026-02-18T00:58:16.769 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:136: test_setup: setup td/ceph-helpers 2026-02-18T00:58:16.769 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/ceph-helpers 2026-02-18T00:58:16.769 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/ceph-helpers 2026-02-18T00:58:16.769 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/ceph-helpers 2026-02-18T00:58:16.769 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T00:58:16.769 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/ceph-helpers KILL 2026-02-18T00:58:16.769 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:58:16.769 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:58:16.769 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:58:16.769 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:58:16.769 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:58:16.770 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:58:16.771 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T00:58:16.771 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T00:58:16.772 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T00:58:16.773 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T00:58:16.773 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T00:58:16.773 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T00:58:16.774 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:58:16.774 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T00:58:16.775 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T00:58:16.775 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:58:16.776 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T00:58:16.777 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T00:58:16.777 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/ceph-helpers 2026-02-18T00:58:16.779 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T00:58:16.779 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:58:16.779 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:58:16.779 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.57427 2026-02-18T00:58:16.780 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T00:58:16.780 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T00:58:16.780 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/ceph-helpers 2026-02-18T00:58:16.781 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-18T00:58:16.781 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:58:16.782 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:58:16.782 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.57427 2026-02-18T00:58:16.783 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-18T00:58:16.785 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-18T00:58:16.785 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-18T00:58:16.785 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/ceph-helpers 1' TERM HUP INT 2026-02-18T00:58:16.785 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:137: test_setup: test -d td/ceph-helpers 2026-02-18T00:58:16.785 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: test_setup: setup td/ceph-helpers 2026-02-18T00:58:16.785 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/ceph-helpers 2026-02-18T00:58:16.785 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/ceph-helpers 2026-02-18T00:58:16.785 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/ceph-helpers 2026-02-18T00:58:16.785 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T00:58:16.786 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/ceph-helpers KILL 2026-02-18T00:58:16.786 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:58:16.786 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:58:16.786 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:58:16.786 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:58:16.786 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:58:16.787 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:58:16.787 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T00:58:16.788 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T00:58:16.788 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T00:58:16.789 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T00:58:16.789 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T00:58:16.790 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T00:58:16.791 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:58:16.791 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T00:58:16.791 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T00:58:16.792 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:58:16.793 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T00:58:16.793 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T00:58:16.794 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/ceph-helpers 2026-02-18T00:58:16.795 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T00:58:16.795 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:58:16.795 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:58:16.795 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.57427 2026-02-18T00:58:16.796 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T00:58:16.796 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T00:58:16.796 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/ceph-helpers 2026-02-18T00:58:16.797 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-18T00:58:16.798 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:58:16.798 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:58:16.798 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.57427 2026-02-18T00:58:16.799 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-18T00:58:16.801 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-18T00:58:16.801 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-18T00:58:16.801 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/ceph-helpers 1' TERM HUP INT 2026-02-18T00:58:16.801 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: test_setup: test -d td/ceph-helpers 2026-02-18T00:58:16.801 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:140: test_setup: teardown td/ceph-helpers 2026-02-18T00:58:16.801 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/ceph-helpers 2026-02-18T00:58:16.801 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T00:58:16.801 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/ceph-helpers KILL 2026-02-18T00:58:16.801 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:58:16.801 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:58:16.802 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:58:16.802 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:58:16.802 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:58:16.803 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:58:16.803 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T00:58:16.804 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T00:58:16.805 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T00:58:16.806 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T00:58:16.806 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T00:58:16.806 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T00:58:16.807 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:58:16.808 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T00:58:16.808 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T00:58:16.808 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:58:16.809 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T00:58:16.810 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T00:58:16.810 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/ceph-helpers 2026-02-18T00:58:16.812 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T00:58:16.812 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:58:16.812 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:58:16.812 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.57427 2026-02-18T00:58:16.814 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T00:58:16.814 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T00:58:16.814 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2426: run_tests: for func in $funcs 2026-02-18T00:58:16.815 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2427: run_tests: test_teardown td/ceph-helpers 2026-02-18T00:58:16.815 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:211: test_teardown: local dir=td/ceph-helpers 2026-02-18T00:58:16.815 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:212: test_teardown: setup td/ceph-helpers 2026-02-18T00:58:16.815 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/ceph-helpers 2026-02-18T00:58:16.815 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/ceph-helpers 2026-02-18T00:58:16.815 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/ceph-helpers 2026-02-18T00:58:16.815 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T00:58:16.815 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/ceph-helpers KILL 2026-02-18T00:58:16.815 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:58:16.815 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:58:16.815 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:58:16.815 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:58:16.816 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:58:16.816 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:58:16.817 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T00:58:16.817 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T00:58:16.818 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T00:58:16.818 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T00:58:16.818 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T00:58:16.819 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T00:58:16.819 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:58:16.820 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T00:58:16.820 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T00:58:16.820 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:58:16.821 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T00:58:16.822 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T00:58:16.822 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/ceph-helpers 2026-02-18T00:58:16.823 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T00:58:16.823 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:58:16.823 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:58:16.823 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.57427 2026-02-18T00:58:16.824 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T00:58:16.824 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T00:58:16.824 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/ceph-helpers 2026-02-18T00:58:16.826 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-18T00:58:16.826 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:58:16.826 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:58:16.826 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.57427 2026-02-18T00:58:16.827 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-18T00:58:16.829 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-18T00:58:16.829 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-18T00:58:16.829 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/ceph-helpers 1' TERM HUP INT 2026-02-18T00:58:16.829 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:213: test_teardown: teardown td/ceph-helpers 2026-02-18T00:58:16.829 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/ceph-helpers 2026-02-18T00:58:16.829 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T00:58:16.829 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/ceph-helpers KILL 2026-02-18T00:58:16.829 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:58:16.829 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:58:16.829 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:58:16.830 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:58:16.830 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:58:16.831 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:58:16.831 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T00:58:16.832 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T00:58:16.833 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T00:58:16.834 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T00:58:16.834 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T00:58:16.835 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T00:58:16.836 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:58:16.836 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T00:58:16.836 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T00:58:16.836 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:58:16.837 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T00:58:16.838 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T00:58:16.838 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/ceph-helpers 2026-02-18T00:58:16.839 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T00:58:16.840 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:58:16.840 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:58:16.840 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.57427 2026-02-18T00:58:16.842 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T00:58:16.843 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T00:58:16.843 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:214: test_teardown: test -d td/ceph-helpers 2026-02-18T00:58:16.843 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2426: run_tests: for func in $funcs 2026-02-18T00:58:16.843 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2427: run_tests: test_wait_background td/ceph-helpers 2026-02-18T00:58:16.843 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2237: test_wait_background: local pids= 2026-02-18T00:58:16.843 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2238: test_wait_background: run_in_background pids bash -c 'sleep 1; exit 1' 2026-02-18T00:58:16.843 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2183: run_in_background: local pid_variable=pids 2026-02-18T00:58:16.843 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2184: run_in_background: shift 2026-02-18T00:58:16.843 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2188: run_in_background: eval 'pids+=" 126799"' 2026-02-18T00:58:16.843 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2188: run_in_background: pids+=' 126799' 2026-02-18T00:58:16.843 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2239: test_wait_background: run_in_background pids bash -c 'sleep 2; exit 0' 2026-02-18T00:58:16.844 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2183: run_in_background: local pid_variable=pids 2026-02-18T00:58:16.844 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2184: run_in_background: shift 2026-02-18T00:58:16.844 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2188: run_in_background: eval 'pids+=" 126801"' 2026-02-18T00:58:16.844 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: bash -c 'sleep 1; exit 1' 2026-02-18T00:58:16.844 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2188: run_in_background: pids+=' 126801' 2026-02-18T00:58:16.844 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2240: test_wait_background: wait_background pids 2026-02-18T00:58:16.844 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: wait_background: pids=' 126799 126801' 2026-02-18T00:58:16.844 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: wait_background: return_code=0 2026-02-18T00:58:16.844 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: wait_background: for pid in $pids 2026-02-18T00:58:16.844 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2223: wait_background: wait 126799 2026-02-18T00:58:16.844 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: sed 's/^/126802: /' 2026-02-18T00:58:16.844 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: bash -c 'sleep 2; exit 0' 2026-02-18T00:58:16.845 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: sed 's/^/126804: /' 2026-02-18T00:58:17.845 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: return 1 2026-02-18T00:58:17.845 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2225: wait_background: return_code=1 2026-02-18T00:58:17.845 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: wait_background: for pid in $pids 2026-02-18T00:58:17.845 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2223: wait_background: wait 126801 2026-02-18T00:58:18.847 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: return 0 2026-02-18T00:58:18.847 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2230: wait_background: eval 'pids='\'''\''' 2026-02-18T00:58:18.847 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2230: wait_background: pids= 2026-02-18T00:58:18.847 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2232: wait_background: return 1 2026-02-18T00:58:18.847 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2241: test_wait_background: '[' 1 -ne 1 ']' 2026-02-18T00:58:18.847 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2243: test_wait_background: run_in_background pids bash -c 'sleep 1; exit 0' 2026-02-18T00:58:18.848 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2183: run_in_background: local pid_variable=pids 2026-02-18T00:58:18.848 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2184: run_in_background: shift 2026-02-18T00:58:18.848 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2188: run_in_background: eval 'pids+=" 126807"' 2026-02-18T00:58:18.848 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2188: run_in_background: pids+=' 126807' 2026-02-18T00:58:18.848 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2244: test_wait_background: run_in_background pids bash -c 'sleep 2; exit 0' 2026-02-18T00:58:18.848 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2183: run_in_background: local pid_variable=pids 2026-02-18T00:58:18.848 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2184: run_in_background: shift 2026-02-18T00:58:18.848 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2188: run_in_background: eval 'pids+=" 126808"' 2026-02-18T00:58:18.848 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2188: run_in_background: pids+=' 126808' 2026-02-18T00:58:18.848 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2245: test_wait_background: wait_background pids 2026-02-18T00:58:18.848 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: wait_background: pids=' 126807 126808' 2026-02-18T00:58:18.848 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: wait_background: return_code=0 2026-02-18T00:58:18.849 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: wait_background: for pid in $pids 2026-02-18T00:58:18.849 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2223: wait_background: wait 126807 2026-02-18T00:58:18.849 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: bash -c 'sleep 1; exit 0' 2026-02-18T00:58:18.849 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: bash -c 'sleep 2; exit 0' 2026-02-18T00:58:18.849 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: sed 's/^/126811: /' 2026-02-18T00:58:18.849 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: sed 's/^/126812: /' 2026-02-18T00:58:19.850 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: return 0 2026-02-18T00:58:19.850 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: wait_background: for pid in $pids 2026-02-18T00:58:19.850 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2223: wait_background: wait 126808 2026-02-18T00:58:20.850 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: return 0 2026-02-18T00:58:20.851 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2230: wait_background: eval 'pids='\'''\''' 2026-02-18T00:58:20.851 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2230: wait_background: pids= 2026-02-18T00:58:20.851 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2232: wait_background: return 0 2026-02-18T00:58:20.851 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2246: test_wait_background: '[' 0 -ne 0 ']' 2026-02-18T00:58:20.851 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2248: test_wait_background: '[' '!' -z '' ']' 2026-02-18T00:58:20.851 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2426: run_tests: for func in $funcs 2026-02-18T00:58:20.851 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2427: run_tests: test_wait_for_clean td/ceph-helpers 2026-02-18T00:58:20.851 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1682: test_wait_for_clean: local dir=td/ceph-helpers 2026-02-18T00:58:20.851 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1684: test_wait_for_clean: setup td/ceph-helpers 2026-02-18T00:58:20.851 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/ceph-helpers 2026-02-18T00:58:20.851 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/ceph-helpers 2026-02-18T00:58:20.852 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/ceph-helpers 2026-02-18T00:58:20.852 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T00:58:20.852 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/ceph-helpers KILL 2026-02-18T00:58:20.852 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:58:20.852 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:58:20.852 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:58:20.852 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:58:20.853 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:58:20.854 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:58:20.854 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T00:58:20.855 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T00:58:20.855 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T00:58:20.857 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T00:58:20.857 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T00:58:20.857 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T00:58:20.858 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:58:20.858 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T00:58:20.859 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T00:58:20.859 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:58:20.860 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T00:58:20.861 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T00:58:20.861 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/ceph-helpers 2026-02-18T00:58:20.863 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T00:58:20.863 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:58:20.863 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:58:20.863 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.57427 2026-02-18T00:58:20.864 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T00:58:20.864 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T00:58:20.864 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/ceph-helpers 2026-02-18T00:58:20.865 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-18T00:58:20.866 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:58:20.866 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:58:20.866 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.57427 2026-02-18T00:58:20.867 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-18T00:58:20.868 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-18T00:58:20.868 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-18T00:58:20.868 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/ceph-helpers 1' TERM HUP INT 2026-02-18T00:58:20.869 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1685: test_wait_for_clean: run_mon td/ceph-helpers a --osd_pool_default_size=2 2026-02-18T00:58:20.869 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/ceph-helpers 2026-02-18T00:58:20.869 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-18T00:58:20.869 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-18T00:58:20.869 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-18T00:58:20.869 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/ceph-helpers/a 2026-02-18T00:58:20.869 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/ceph-helpers/a --run-dir=td/ceph-helpers --osd_pool_default_size=2 2026-02-18T00:58:20.889 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-18T00:58:20.889 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:58:20.889 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:58:20.890 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:58:20.890 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:58:20.890 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:58:20.890 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.57427/$cluster-$name.asok' 2026-02-18T00:58:20.890 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/ceph-helpers/a '--log-file=td/ceph-helpers/$name.log' '--admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' --mon-cluster-log-file=td/ceph-helpers/log --run-dir=td/ceph-helpers '--pid-file=td/ceph-helpers/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --osd_pool_default_size=2 2026-02-18T00:58:20.919 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-18T00:58:20.920 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-18T00:58:20.920 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T00:58:20.920 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-18T00:58:20.920 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-18T00:58:20.921 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-18T00:58:20.922 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-18T00:58:20.922 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:58:20.922 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:58:20.922 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:58:20.922 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:58:20.922 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:58:20.922 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.57427/ceph-mon.a.asok 2026-02-18T00:58:20.923 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T00:58:20.923 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.57427/ceph-mon.a.asok config get fsid 2026-02-18T00:58:20.979 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-18T00:58:20.979 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T00:58:20.979 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-18T00:58:20.979 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-18T00:58:20.979 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-18T00:58:20.981 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-18T00:58:20.981 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:58:20.981 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:58:20.981 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:58:20.981 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:58:20.981 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:58:20.981 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.57427/ceph-mon.a.asok 2026-02-18T00:58:20.981 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T00:58:20.981 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.57427/ceph-mon.a.asok config get mon_host 2026-02-18T00:58:21.042 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1686: test_wait_for_clean: run_osd td/ceph-helpers 0 2026-02-18T00:58:21.042 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/ceph-helpers 2026-02-18T00:58:21.042 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T00:58:21.042 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-18T00:58:21.042 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T00:58:21.042 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/ceph-helpers/0 2026-02-18T00:58:21.042 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--cluster ceph --fsid=863c4e35-ceb0-4172-b7b2-c3ff099e05a2 --auth-supported=none --mon-host=127.0.0.1:7109 ' 2026-02-18T00:58:21.042 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T00:58:21.043 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T00:58:21.043 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T00:58:21.043 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/ceph-helpers/0' 2026-02-18T00:58:21.043 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/ceph-helpers/0/journal' 2026-02-18T00:58:21.043 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T00:58:21.043 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-18T00:58:21.043 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/ceph-helpers' 2026-02-18T00:58:21.043 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T00:58:21.043 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:58:21.043 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:58:21.043 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:58:21.043 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:58:21.044 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:58:21.044 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.57427/$cluster-$name.asok' 2026-02-18T00:58:21.044 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' 2026-02-18T00:58:21.044 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T00:58:21.044 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T00:58:21.044 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T00:58:21.044 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/ceph-helpers/$name.log' 2026-02-18T00:58:21.044 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/ceph-helpers/$name.pid' 2026-02-18T00:58:21.044 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T00:58:21.044 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T00:58:21.044 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T00:58:21.044 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T00:58:21.044 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T00:58:21.045 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-18T00:58:21.045 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/ceph-helpers/0 2026-02-18T00:58:21.045 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T00:58:21.045 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=c0ad64f3-0cf0-4736-b9d4-83d565764e25 2026-02-18T00:58:21.046 INFO:tasks.workunit.client.0.trial069.stdout:add osd0 c0ad64f3-0cf0-4736-b9d4-83d565764e25 2026-02-18T00:58:21.046 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 c0ad64f3-0cf0-4736-b9d4-83d565764e25' 2026-02-18T00:58:21.046 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T00:58:21.055 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQCtDpVpoBaxAhAATM3N1p/bExNeDqrmpVVK4g== 2026-02-18T00:58:21.055 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQCtDpVpoBaxAhAATM3N1p/bExNeDqrmpVVK4g=="}' 2026-02-18T00:58:21.055 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new c0ad64f3-0cf0-4736-b9d4-83d565764e25 -i td/ceph-helpers/0/new.json 2026-02-18T00:58:21.172 INFO:tasks.workunit.client.0.trial069.stdout:0 2026-02-18T00:58:21.181 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/ceph-helpers/0/new.json 2026-02-18T00:58:21.183 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --cluster ceph --fsid=863c4e35-ceb0-4172-b7b2-c3ff099e05a2 --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/0 --osd-journal=td/ceph-helpers/0/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCtDpVpoBaxAhAATM3N1p/bExNeDqrmpVVK4g== --osd-uuid c0ad64f3-0cf0-4736-b9d4-83d565764e25 2026-02-18T00:58:21.207 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:58:21.192+0000 7f3f78933a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:58:21.208 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:58:21.192+0000 7f3f78933a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:58:21.209 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:58:21.196+0000 7f3f78933a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:58:21.210 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:58:21.196+0000 7f3f78933a40 -1 bdev(0x55b013a3ac00 td/ceph-helpers/0/block) open stat got: (1) Operation not permitted 2026-02-18T00:58:21.210 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:58:21.196+0000 7f3f78933a40 -1 bluestore(td/ceph-helpers/0) _read_fsid unparsable uuid 2026-02-18T00:58:21.847 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/ceph-helpers/0/keyring 2026-02-18T00:58:21.847 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T00:58:21.848 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-18T00:58:21.848 INFO:tasks.workunit.client.0.trial069.stdout:adding osd0 key to auth repository 2026-02-18T00:58:21.849 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/ceph-helpers/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T00:58:21.972 INFO:tasks.workunit.client.0.trial069.stdout:start osd.0 2026-02-18T00:58:21.973 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-18T00:58:21.973 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --cluster ceph --fsid=863c4e35-ceb0-4172-b7b2-c3ff099e05a2 --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/0 --osd-journal=td/ceph-helpers/0/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T00:58:21.973 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T00:58:21.973 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T00:58:21.973 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T00:58:21.995 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:58:21.980+0000 7f030c428a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:58:21.997 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:58:21.984+0000 7f030c428a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:58:21.998 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:58:21.984+0000 7f030c428a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:58:22.082 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-18T00:58:22.082 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:58:22.083 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-18T00:58:22.083 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:58:22.083 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:58:22.083 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:58:22.083 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:58:22.083 INFO:tasks.workunit.client.0.trial069.stdout:0 2026-02-18T00:58:22.084 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:58:22.084 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T00:58:22.193 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:58:22.378 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:58:22.364+0000 7f030c428a40 -1 Falling back to public interface 2026-02-18T00:58:23.022 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:58:23.008+0000 7f030c428a40 -1 osd.0 0 log_to_monitors true 2026-02-18T00:58:23.195 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:58:23.195 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:58:23.195 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T00:58:23.196 INFO:tasks.workunit.client.0.trial069.stdout:1 2026-02-18T00:58:23.196 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:58:23.196 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T00:58:23.307 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:58:24.309 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:58:24.309 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:58:24.309 INFO:tasks.workunit.client.0.trial069.stdout:2 2026-02-18T00:58:24.310 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-18T00:58:24.310 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:58:24.310 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T00:58:24.421 INFO:tasks.workunit.client.0.trial069.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/3057197645,v1:127.0.0.1:6801/3057197645] [v2:127.0.0.1:6802/3057197645,v1:127.0.0.1:6803/3057197645] exists,up c0ad64f3-0cf0-4736-b9d4-83d565764e25 2026-02-18T00:58:24.423 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:58:24.423 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:58:24.423 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:58:24.423 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1687: test_wait_for_clean: run_mgr td/ceph-helpers x 2026-02-18T00:58:24.423 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/ceph-helpers 2026-02-18T00:58:24.423 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-18T00:58:24.424 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-18T00:58:24.424 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-18T00:58:24.424 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/ceph-helpers/x 2026-02-18T00:58:24.424 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-18T00:58:24.537 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-18T00:58:24.538 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:58:24.538 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:58:24.538 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:58:24.538 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:58:24.538 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:58:24.539 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.57427/$cluster-$name.asok' 2026-02-18T00:58:24.539 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-18T00:58:24.540 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/ceph-helpers/x '--log-file=td/ceph-helpers/$name.log' '--admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' --run-dir=td/ceph-helpers '--pid-file=td/ceph-helpers/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-18T00:58:24.556 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1688: test_wait_for_clean: create_rbd_pool 2026-02-18T00:58:24.556 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:526: create_rbd_pool: ceph osd pool delete rbd rbd --yes-i-really-really-mean-it 2026-02-18T00:58:24.669 INFO:tasks.workunit.client.0.trial069.stderr:pool 'rbd' does not exist 2026-02-18T00:58:24.676 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:527: create_rbd_pool: create_pool rbd 4 2026-02-18T00:58:24.677 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create rbd 4 2026-02-18T00:58:24.829 INFO:tasks.workunit.client.0.trial069.stderr:pool 'rbd' already exists 2026-02-18T00:58:24.837 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-18T00:58:25.838 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:528: create_rbd_pool: rbd pool init rbd 2026-02-18T00:58:26.117 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1689: test_wait_for_clean: WAIT_FOR_CLEAN_TIMEOUT=1 2026-02-18T00:58:26.117 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1689: test_wait_for_clean: wait_for_clean 2026-02-18T00:58:26.117 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-18T00:58:26.117 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-18T00:58:26.117 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-18T00:58:26.117 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 1 .1 2026-02-18T00:58:26.118 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-18T00:58:26.118 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-18T00:58:26.118 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-18T00:58:26.118 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-18T00:58:26.118 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-18T00:58:26.146 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.3') 2026-02-18T00:58:26.146 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-18T00:58:26.147 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-18T00:58:26.147 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-18T00:58:26.147 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-18T00:58:26.147 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-18T00:58:26.260 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids=0 2026-02-18T00:58:26.261 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-18T00:58:26.261 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:58:26.261 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-18T00:58:26.336 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=0 2026-02-18T00:58:26.337 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 0 2026-02-18T00:58:26.337 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-0' 2026-02-18T00:58:26.337 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:58:26.337 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-0 2026-02-18T00:58:26.337 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:58:26.338 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-18T00:58:26.339 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-0 2026-02-18T00:58:26.339 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:58:26.340 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=0 2026-02-18T00:58:26.340 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 0' 2026-02-18T00:58:26.341 INFO:tasks.workunit.client.0.trial069.stdout:waiting osd.0 seq 0 2026-02-18T00:58:26.341 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T00:58:26.449 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 0 -lt 0 2026-02-18T00:58:26.450 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-18T00:58:26.450 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T00:58:26.450 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T00:58:26.565 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 0 == 0 2026-02-18T00:58:26.566 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1655: wait_for_clean: sleep 1 2026-02-18T00:58:27.567 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-18T00:58:27.568 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T00:58:27.568 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T00:58:27.838 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 4 == 0 2026-02-18T00:58:27.839 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-18T00:58:27.839 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-18T00:58:27.840 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-18T00:58:27.840 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-18T00:58:27.840 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-18T00:58:27.840 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-18T00:58:27.840 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-18T00:58:28.041 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-18T00:58:28.041 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-18T00:58:28.042 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T00:58:28.042 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T00:58:28.315 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 4 2026-02-18T00:58:28.316 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' -1 2026-02-18T00:58:28.316 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1665: wait_for_clean: loop=0 2026-02-18T00:58:28.316 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1666: wait_for_clean: num_active_clean=0 2026-02-18T00:58:28.316 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-18T00:58:28.316 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.1 2026-02-18T00:58:28.416 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-18T00:58:28.416 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-18T00:58:28.417 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-18T00:58:28.417 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-18T00:58:28.417 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-18T00:58:28.418 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-18T00:58:28.418 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-18T00:58:28.418 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-18T00:58:28.631 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-18T00:58:28.631 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-18T00:58:28.632 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T00:58:28.632 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T00:58:28.914 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 4 2026-02-18T00:58:28.915 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-18T00:58:28.915 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-18T00:58:28.915 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-18T00:58:28.915 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-18T00:58:28.915 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-18T00:58:28.915 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-18T00:58:28.916 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-18T00:58:28.916 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-18T00:58:29.204 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-18T00:58:29.205 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-18T00:58:29.205 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 1 >= 4 )) 2026-02-18T00:58:29.205 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-18T00:58:29.205 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.2 2026-02-18T00:58:29.405 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-18T00:58:29.405 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-18T00:58:29.406 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-18T00:58:29.406 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-18T00:58:29.406 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-18T00:58:29.407 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-18T00:58:29.407 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-18T00:58:29.407 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-18T00:58:29.618 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-18T00:58:29.619 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-18T00:58:29.620 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T00:58:29.620 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T00:58:29.905 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 4 2026-02-18T00:58:29.906 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-18T00:58:29.906 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-18T00:58:29.906 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-18T00:58:29.906 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-18T00:58:29.906 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-18T00:58:29.906 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-18T00:58:29.906 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-18T00:58:29.906 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-18T00:58:30.190 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-18T00:58:30.190 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-18T00:58:30.190 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 2 >= 4 )) 2026-02-18T00:58:30.190 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-18T00:58:30.190 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.4 2026-02-18T00:58:30.591 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-18T00:58:30.591 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-18T00:58:30.592 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-18T00:58:30.592 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-18T00:58:30.593 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-18T00:58:30.593 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-18T00:58:30.593 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-18T00:58:30.593 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-18T00:58:30.802 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-18T00:58:30.803 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-18T00:58:30.803 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T00:58:30.804 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T00:58:31.090 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 4 2026-02-18T00:58:31.090 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-18T00:58:31.090 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-18T00:58:31.091 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-18T00:58:31.091 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-18T00:58:31.091 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-18T00:58:31.091 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-18T00:58:31.091 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-18T00:58:31.091 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-18T00:58:31.376 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-18T00:58:31.376 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-18T00:58:31.376 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 3 >= 4 )) 2026-02-18T00:58:31.376 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-18T00:58:31.376 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.3 2026-02-18T00:58:31.676 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-18T00:58:31.676 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-18T00:58:31.677 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-18T00:58:31.678 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-18T00:58:31.678 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-18T00:58:31.678 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-18T00:58:31.678 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-18T00:58:31.678 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-18T00:58:31.884 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-18T00:58:31.885 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-18T00:58:31.885 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T00:58:31.885 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T00:58:32.165 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 4 2026-02-18T00:58:32.165 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-18T00:58:32.165 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-18T00:58:32.165 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-18T00:58:32.165 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-18T00:58:32.166 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-18T00:58:32.166 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-18T00:58:32.166 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-18T00:58:32.166 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-18T00:58:32.437 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-18T00:58:32.437 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-18T00:58:32.437 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 4 >= 4 )) 2026-02-18T00:58:32.437 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: ceph report 2026-02-18T00:58:32.702 INFO:tasks.workunit.client.0.trial069.stdout:{ 2026-02-18T00:58:32.702 INFO:tasks.workunit.client.0.trial069.stdout: "cluster_fingerprint": "7d49fcd7-b3a3-4d21-824f-b4251c345870", 2026-02-18T00:58:32.702 INFO:tasks.workunit.client.0.trial069.stdout: "version": "20.2.0-670-gadc19233", 2026-02-18T00:58:32.702 INFO:tasks.workunit.client.0.trial069.stdout: "commit": "adc1923395f2bcd6ae89b5d331d278364d1848ed", 2026-02-18T00:58:32.702 INFO:tasks.workunit.client.0.trial069.stdout: "timestamp": "2026-02-18T00:58:32.692008+0000", 2026-02-18T00:58:32.702 INFO:tasks.workunit.client.0.trial069.stdout: "tag": "", 2026-02-18T00:58:32.702 INFO:tasks.workunit.client.0.trial069.stdout: "health": { 2026-02-18T00:58:32.702 INFO:tasks.workunit.client.0.trial069.stdout: "status": "HEALTH_WARN", 2026-02-18T00:58:32.703 INFO:tasks.workunit.client.0.trial069.stdout: "checks": { 2026-02-18T00:58:32.703 INFO:tasks.workunit.client.0.trial069.stdout: "PG_DEGRADED": { 2026-02-18T00:58:32.703 INFO:tasks.workunit.client.0.trial069.stdout: "severity": "HEALTH_WARN", 2026-02-18T00:58:32.703 INFO:tasks.workunit.client.0.trial069.stdout: "summary": { 2026-02-18T00:58:32.703 INFO:tasks.workunit.client.0.trial069.stdout: "message": "Degraded data redundancy: 2/4 objects degraded (50.000%), 2 pgs degraded", 2026-02-18T00:58:32.703 INFO:tasks.workunit.client.0.trial069.stdout: "count": 2 2026-02-18T00:58:32.703 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:58:32.703 INFO:tasks.workunit.client.0.trial069.stdout: "detail": [ 2026-02-18T00:58:32.703 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:58:32.703 INFO:tasks.workunit.client.0.trial069.stdout: "message": "pg 1.2 is active+undersized+degraded, acting [0]" 2026-02-18T00:58:32.703 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:58:32.703 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:58:32.704 INFO:tasks.workunit.client.0.trial069.stdout: "message": "pg 1.3 is active+undersized+degraded, acting [0]" 2026-02-18T00:58:32.704 INFO:tasks.workunit.client.0.trial069.stdout: } 2026-02-18T00:58:32.704 INFO:tasks.workunit.client.0.trial069.stdout: ], 2026-02-18T00:58:32.704 INFO:tasks.workunit.client.0.trial069.stdout: "muted": false 2026-02-18T00:58:32.704 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:58:32.704 INFO:tasks.workunit.client.0.trial069.stdout: "TOO_FEW_OSDS": { 2026-02-18T00:58:32.704 INFO:tasks.workunit.client.0.trial069.stdout: "severity": "HEALTH_WARN", 2026-02-18T00:58:32.704 INFO:tasks.workunit.client.0.trial069.stdout: "summary": { 2026-02-18T00:58:32.704 INFO:tasks.workunit.client.0.trial069.stdout: "message": "OSD count 1 < osd_pool_default_size 3", 2026-02-18T00:58:32.704 INFO:tasks.workunit.client.0.trial069.stdout: "count": 2 2026-02-18T00:58:32.704 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:58:32.704 INFO:tasks.workunit.client.0.trial069.stdout: "detail": [], 2026-02-18T00:58:32.705 INFO:tasks.workunit.client.0.trial069.stdout: "muted": false 2026-02-18T00:58:32.705 INFO:tasks.workunit.client.0.trial069.stdout: } 2026-02-18T00:58:32.705 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:58:32.705 INFO:tasks.workunit.client.0.trial069.stdout: "mutes": [] 2026-02-18T00:58:32.705 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:58:32.705 INFO:tasks.workunit.client.0.trial069.stdout: "monmap_first_committed": 1, 2026-02-18T00:58:32.705 INFO:tasks.workunit.client.0.trial069.stdout: "monmap_last_committed": 1, 2026-02-18T00:58:32.705 INFO:tasks.workunit.client.0.trial069.stdout: "monmap": { 2026-02-18T00:58:32.705 INFO:tasks.workunit.client.0.trial069.stdout: "epoch": 1, 2026-02-18T00:58:32.705 INFO:tasks.workunit.client.0.trial069.stdout: "fsid": "863c4e35-ceb0-4172-b7b2-c3ff099e05a2", 2026-02-18T00:58:32.705 INFO:tasks.workunit.client.0.trial069.stdout: "modified": "2026-02-18T00:58:20.873002Z", 2026-02-18T00:58:32.705 INFO:tasks.workunit.client.0.trial069.stdout: "created": "2026-02-18T00:58:20.873002Z", 2026-02-18T00:58:32.706 INFO:tasks.workunit.client.0.trial069.stdout: "min_mon_release": 20, 2026-02-18T00:58:32.706 INFO:tasks.workunit.client.0.trial069.stdout: "min_mon_release_name": "tentacle", 2026-02-18T00:58:32.706 INFO:tasks.workunit.client.0.trial069.stdout: "election_strategy": 1, 2026-02-18T00:58:32.706 INFO:tasks.workunit.client.0.trial069.stdout: "disallowed_leaders": "", 2026-02-18T00:58:32.706 INFO:tasks.workunit.client.0.trial069.stdout: "stretch_mode": false, 2026-02-18T00:58:32.706 INFO:tasks.workunit.client.0.trial069.stdout: "tiebreaker_mon": "", 2026-02-18T00:58:32.706 INFO:tasks.workunit.client.0.trial069.stdout: "removed_ranks": "", 2026-02-18T00:58:32.706 INFO:tasks.workunit.client.0.trial069.stdout: "features": { 2026-02-18T00:58:32.706 INFO:tasks.workunit.client.0.trial069.stdout: "persistent": [ 2026-02-18T00:58:32.706 INFO:tasks.workunit.client.0.trial069.stdout: "kraken", 2026-02-18T00:58:32.706 INFO:tasks.workunit.client.0.trial069.stdout: "luminous", 2026-02-18T00:58:32.706 INFO:tasks.workunit.client.0.trial069.stdout: "mimic", 2026-02-18T00:58:32.706 INFO:tasks.workunit.client.0.trial069.stdout: "osdmap-prune", 2026-02-18T00:58:32.707 INFO:tasks.workunit.client.0.trial069.stdout: "nautilus", 2026-02-18T00:58:32.707 INFO:tasks.workunit.client.0.trial069.stdout: "octopus", 2026-02-18T00:58:32.707 INFO:tasks.workunit.client.0.trial069.stdout: "pacific", 2026-02-18T00:58:32.707 INFO:tasks.workunit.client.0.trial069.stdout: "elector-pinging", 2026-02-18T00:58:32.707 INFO:tasks.workunit.client.0.trial069.stdout: "quincy", 2026-02-18T00:58:32.707 INFO:tasks.workunit.client.0.trial069.stdout: "reef", 2026-02-18T00:58:32.707 INFO:tasks.workunit.client.0.trial069.stdout: "squid", 2026-02-18T00:58:32.707 INFO:tasks.workunit.client.0.trial069.stdout: "tentacle", 2026-02-18T00:58:32.707 INFO:tasks.workunit.client.0.trial069.stdout: "nvmeof_beacon_diff" 2026-02-18T00:58:32.707 INFO:tasks.workunit.client.0.trial069.stdout: ], 2026-02-18T00:58:32.707 INFO:tasks.workunit.client.0.trial069.stdout: "optional": [] 2026-02-18T00:58:32.707 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:58:32.707 INFO:tasks.workunit.client.0.trial069.stdout: "mons": [ 2026-02-18T00:58:32.707 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:58:32.708 INFO:tasks.workunit.client.0.trial069.stdout: "rank": 0, 2026-02-18T00:58:32.708 INFO:tasks.workunit.client.0.trial069.stdout: "name": "a", 2026-02-18T00:58:32.708 INFO:tasks.workunit.client.0.trial069.stdout: "public_addrs": { 2026-02-18T00:58:32.708 INFO:tasks.workunit.client.0.trial069.stdout: "addrvec": [ 2026-02-18T00:58:32.708 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:58:32.708 INFO:tasks.workunit.client.0.trial069.stdout: "type": "v2", 2026-02-18T00:58:32.708 INFO:tasks.workunit.client.0.trial069.stdout: "addr": "127.0.0.1:7109", 2026-02-18T00:58:32.708 INFO:tasks.workunit.client.0.trial069.stdout: "nonce": 0 2026-02-18T00:58:32.708 INFO:tasks.workunit.client.0.trial069.stdout: } 2026-02-18T00:58:32.708 INFO:tasks.workunit.client.0.trial069.stdout: ] 2026-02-18T00:58:32.708 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:58:32.708 INFO:tasks.workunit.client.0.trial069.stdout: "addr": "127.0.0.1:7109/0", 2026-02-18T00:58:32.708 INFO:tasks.workunit.client.0.trial069.stdout: "public_addr": "127.0.0.1:7109/0", 2026-02-18T00:58:32.709 INFO:tasks.workunit.client.0.trial069.stdout: "priority": 0, 2026-02-18T00:58:32.709 INFO:tasks.workunit.client.0.trial069.stdout: "weight": 0, 2026-02-18T00:58:32.709 INFO:tasks.workunit.client.0.trial069.stdout: "crush_location": "{}" 2026-02-18T00:58:32.709 INFO:tasks.workunit.client.0.trial069.stdout: } 2026-02-18T00:58:32.709 INFO:tasks.workunit.client.0.trial069.stdout: ] 2026-02-18T00:58:32.709 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:58:32.709 INFO:tasks.workunit.client.0.trial069.stdout: "quorum": [ 2026-02-18T00:58:32.709 INFO:tasks.workunit.client.0.trial069.stdout: 0 2026-02-18T00:58:32.709 INFO:tasks.workunit.client.0.trial069.stdout: ], 2026-02-18T00:58:32.709 INFO:tasks.workunit.client.0.trial069.stdout: "osdmap": { 2026-02-18T00:58:32.709 INFO:tasks.workunit.client.0.trial069.stdout: "epoch": 12, 2026-02-18T00:58:32.709 INFO:tasks.workunit.client.0.trial069.stdout: "fsid": "863c4e35-ceb0-4172-b7b2-c3ff099e05a2", 2026-02-18T00:58:32.710 INFO:tasks.workunit.client.0.trial069.stdout: "created": "2026-02-18T00:58:20.949170+0000", 2026-02-18T00:58:32.710 INFO:tasks.workunit.client.0.trial069.stdout: "modified": "2026-02-18T00:58:26.101179+0000", 2026-02-18T00:58:32.710 INFO:tasks.workunit.client.0.trial069.stdout: "last_up_change": "2026-02-18T00:58:23.616525+0000", 2026-02-18T00:58:32.710 INFO:tasks.workunit.client.0.trial069.stdout: "last_in_change": "2026-02-18T00:58:21.141352+0000", 2026-02-18T00:58:32.710 INFO:tasks.workunit.client.0.trial069.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2026-02-18T00:58:32.710 INFO:tasks.workunit.client.0.trial069.stdout: "flags_num": 5799936, 2026-02-18T00:58:32.710 INFO:tasks.workunit.client.0.trial069.stdout: "flags_set": [ 2026-02-18T00:58:32.710 INFO:tasks.workunit.client.0.trial069.stdout: "pglog_hardlimit", 2026-02-18T00:58:32.710 INFO:tasks.workunit.client.0.trial069.stdout: "purged_snapdirs", 2026-02-18T00:58:32.710 INFO:tasks.workunit.client.0.trial069.stdout: "recovery_deletes", 2026-02-18T00:58:32.710 INFO:tasks.workunit.client.0.trial069.stdout: "sortbitwise" 2026-02-18T00:58:32.710 INFO:tasks.workunit.client.0.trial069.stdout: ], 2026-02-18T00:58:32.710 INFO:tasks.workunit.client.0.trial069.stdout: "crush_version": 3, 2026-02-18T00:58:32.711 INFO:tasks.workunit.client.0.trial069.stdout: "full_ratio": 0.99000000953674316, 2026-02-18T00:58:32.711 INFO:tasks.workunit.client.0.trial069.stdout: "backfillfull_ratio": 0.99000000953674316, 2026-02-18T00:58:32.711 INFO:tasks.workunit.client.0.trial069.stdout: "nearfull_ratio": 0.85000002384185791, 2026-02-18T00:58:32.711 INFO:tasks.workunit.client.0.trial069.stdout: "cluster_snapshot": "", 2026-02-18T00:58:32.711 INFO:tasks.workunit.client.0.trial069.stdout: "pool_max": 1, 2026-02-18T00:58:32.711 INFO:tasks.workunit.client.0.trial069.stdout: "max_osd": 1, 2026-02-18T00:58:32.711 INFO:tasks.workunit.client.0.trial069.stdout: "require_min_compat_client": "luminous", 2026-02-18T00:58:32.711 INFO:tasks.workunit.client.0.trial069.stdout: "min_compat_client": "jewel", 2026-02-18T00:58:32.711 INFO:tasks.workunit.client.0.trial069.stdout: "require_osd_release": "tentacle", 2026-02-18T00:58:32.711 INFO:tasks.workunit.client.0.trial069.stdout: "allow_crimson": false, 2026-02-18T00:58:32.711 INFO:tasks.workunit.client.0.trial069.stdout: "pools": [ 2026-02-18T00:58:32.711 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:58:32.711 INFO:tasks.workunit.client.0.trial069.stdout: "pool": 1, 2026-02-18T00:58:32.712 INFO:tasks.workunit.client.0.trial069.stdout: "pool_name": "rbd", 2026-02-18T00:58:32.712 INFO:tasks.workunit.client.0.trial069.stdout: "create_time": "2026-02-18T00:58:24.766996+0000", 2026-02-18T00:58:32.712 INFO:tasks.workunit.client.0.trial069.stdout: "flags": 8193, 2026-02-18T00:58:32.712 INFO:tasks.workunit.client.0.trial069.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2026-02-18T00:58:32.712 INFO:tasks.workunit.client.0.trial069.stdout: "type": 1, 2026-02-18T00:58:32.712 INFO:tasks.workunit.client.0.trial069.stdout: "size": 2, 2026-02-18T00:58:32.712 INFO:tasks.workunit.client.0.trial069.stdout: "min_size": 1, 2026-02-18T00:58:32.712 INFO:tasks.workunit.client.0.trial069.stdout: "crush_rule": 0, 2026-02-18T00:58:32.712 INFO:tasks.workunit.client.0.trial069.stdout: "peering_crush_bucket_count": 0, 2026-02-18T00:58:32.712 INFO:tasks.workunit.client.0.trial069.stdout: "peering_crush_bucket_target": 0, 2026-02-18T00:58:32.712 INFO:tasks.workunit.client.0.trial069.stdout: "peering_crush_bucket_barrier": 0, 2026-02-18T00:58:32.712 INFO:tasks.workunit.client.0.trial069.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2026-02-18T00:58:32.712 INFO:tasks.workunit.client.0.trial069.stdout: "is_stretch_pool": false, 2026-02-18T00:58:32.713 INFO:tasks.workunit.client.0.trial069.stdout: "object_hash": 2, 2026-02-18T00:58:32.713 INFO:tasks.workunit.client.0.trial069.stdout: "pg_autoscale_mode": "off", 2026-02-18T00:58:32.713 INFO:tasks.workunit.client.0.trial069.stdout: "pg_num": 4, 2026-02-18T00:58:32.713 INFO:tasks.workunit.client.0.trial069.stdout: "pg_placement_num": 4, 2026-02-18T00:58:32.713 INFO:tasks.workunit.client.0.trial069.stdout: "pg_placement_num_target": 4, 2026-02-18T00:58:32.713 INFO:tasks.workunit.client.0.trial069.stdout: "pg_num_target": 4, 2026-02-18T00:58:32.713 INFO:tasks.workunit.client.0.trial069.stdout: "pg_num_pending": 4, 2026-02-18T00:58:32.713 INFO:tasks.workunit.client.0.trial069.stdout: "last_pg_merge_meta": { 2026-02-18T00:58:32.713 INFO:tasks.workunit.client.0.trial069.stdout: "source_pgid": "0.0", 2026-02-18T00:58:32.713 INFO:tasks.workunit.client.0.trial069.stdout: "ready_epoch": 0, 2026-02-18T00:58:32.713 INFO:tasks.workunit.client.0.trial069.stdout: "last_epoch_started": 0, 2026-02-18T00:58:32.713 INFO:tasks.workunit.client.0.trial069.stdout: "last_epoch_clean": 0, 2026-02-18T00:58:32.713 INFO:tasks.workunit.client.0.trial069.stdout: "source_version": "0'0", 2026-02-18T00:58:32.714 INFO:tasks.workunit.client.0.trial069.stdout: "target_version": "0'0" 2026-02-18T00:58:32.714 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:58:32.714 INFO:tasks.workunit.client.0.trial069.stdout: "last_change": "12", 2026-02-18T00:58:32.714 INFO:tasks.workunit.client.0.trial069.stdout: "last_force_op_resend": "0", 2026-02-18T00:58:32.714 INFO:tasks.workunit.client.0.trial069.stdout: "last_force_op_resend_prenautilus": "0", 2026-02-18T00:58:32.714 INFO:tasks.workunit.client.0.trial069.stdout: "last_force_op_resend_preluminous": "0", 2026-02-18T00:58:32.714 INFO:tasks.workunit.client.0.trial069.stdout: "auid": 0, 2026-02-18T00:58:32.714 INFO:tasks.workunit.client.0.trial069.stdout: "snap_mode": "selfmanaged", 2026-02-18T00:58:32.714 INFO:tasks.workunit.client.0.trial069.stdout: "snap_seq": 2, 2026-02-18T00:58:32.714 INFO:tasks.workunit.client.0.trial069.stdout: "snap_epoch": 12, 2026-02-18T00:58:32.714 INFO:tasks.workunit.client.0.trial069.stdout: "pool_snaps": [], 2026-02-18T00:58:32.714 INFO:tasks.workunit.client.0.trial069.stdout: "removed_snaps": "[]", 2026-02-18T00:58:32.715 INFO:tasks.workunit.client.0.trial069.stdout: "quota_max_bytes": 0, 2026-02-18T00:58:32.715 INFO:tasks.workunit.client.0.trial069.stdout: "quota_max_objects": 0, 2026-02-18T00:58:32.715 INFO:tasks.workunit.client.0.trial069.stdout: "tiers": [], 2026-02-18T00:58:32.715 INFO:tasks.workunit.client.0.trial069.stdout: "tier_of": -1, 2026-02-18T00:58:32.715 INFO:tasks.workunit.client.0.trial069.stdout: "read_tier": -1, 2026-02-18T00:58:32.715 INFO:tasks.workunit.client.0.trial069.stdout: "write_tier": -1, 2026-02-18T00:58:32.715 INFO:tasks.workunit.client.0.trial069.stdout: "cache_mode": "none", 2026-02-18T00:58:32.715 INFO:tasks.workunit.client.0.trial069.stdout: "target_max_bytes": 0, 2026-02-18T00:58:32.715 INFO:tasks.workunit.client.0.trial069.stdout: "target_max_objects": 0, 2026-02-18T00:58:32.715 INFO:tasks.workunit.client.0.trial069.stdout: "cache_target_dirty_ratio_micro": 400000, 2026-02-18T00:58:32.715 INFO:tasks.workunit.client.0.trial069.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2026-02-18T00:58:32.715 INFO:tasks.workunit.client.0.trial069.stdout: "cache_target_full_ratio_micro": 800000, 2026-02-18T00:58:32.715 INFO:tasks.workunit.client.0.trial069.stdout: "cache_min_flush_age": 0, 2026-02-18T00:58:32.715 INFO:tasks.workunit.client.0.trial069.stdout: "cache_min_evict_age": 0, 2026-02-18T00:58:32.716 INFO:tasks.workunit.client.0.trial069.stdout: "erasure_code_profile": "", 2026-02-18T00:58:32.716 INFO:tasks.workunit.client.0.trial069.stdout: "hit_set_params": { 2026-02-18T00:58:32.716 INFO:tasks.workunit.client.0.trial069.stdout: "type": "none" 2026-02-18T00:58:32.716 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:58:32.716 INFO:tasks.workunit.client.0.trial069.stdout: "hit_set_period": 0, 2026-02-18T00:58:32.716 INFO:tasks.workunit.client.0.trial069.stdout: "hit_set_count": 0, 2026-02-18T00:58:32.716 INFO:tasks.workunit.client.0.trial069.stdout: "use_gmt_hitset": true, 2026-02-18T00:58:32.716 INFO:tasks.workunit.client.0.trial069.stdout: "min_read_recency_for_promote": 0, 2026-02-18T00:58:32.716 INFO:tasks.workunit.client.0.trial069.stdout: "min_write_recency_for_promote": 0, 2026-02-18T00:58:32.716 INFO:tasks.workunit.client.0.trial069.stdout: "hit_set_grade_decay_rate": 0, 2026-02-18T00:58:32.716 INFO:tasks.workunit.client.0.trial069.stdout: "hit_set_search_last_n": 0, 2026-02-18T00:58:32.716 INFO:tasks.workunit.client.0.trial069.stdout: "grade_table": [], 2026-02-18T00:58:32.716 INFO:tasks.workunit.client.0.trial069.stdout: "stripe_width": 0, 2026-02-18T00:58:32.717 INFO:tasks.workunit.client.0.trial069.stdout: "expected_num_objects": 0, 2026-02-18T00:58:32.717 INFO:tasks.workunit.client.0.trial069.stdout: "fast_read": false, 2026-02-18T00:58:32.717 INFO:tasks.workunit.client.0.trial069.stdout: "nonprimary_shards": "{}", 2026-02-18T00:58:32.717 INFO:tasks.workunit.client.0.trial069.stdout: "options": {}, 2026-02-18T00:58:32.717 INFO:tasks.workunit.client.0.trial069.stdout: "application_metadata": { 2026-02-18T00:58:32.717 INFO:tasks.workunit.client.0.trial069.stdout: "rbd": {} 2026-02-18T00:58:32.717 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:58:32.717 INFO:tasks.workunit.client.0.trial069.stdout: "read_balance": { 2026-02-18T00:58:32.717 INFO:tasks.workunit.client.0.trial069.stdout: "score_type": "Fair distribution", 2026-02-18T00:58:32.717 INFO:tasks.workunit.client.0.trial069.stdout: "score_acting": 1, 2026-02-18T00:58:32.717 INFO:tasks.workunit.client.0.trial069.stdout: "score_stable": 1, 2026-02-18T00:58:32.717 INFO:tasks.workunit.client.0.trial069.stdout: "optimal_score": 1, 2026-02-18T00:58:32.717 INFO:tasks.workunit.client.0.trial069.stdout: "raw_score_acting": 1, 2026-02-18T00:58:32.718 INFO:tasks.workunit.client.0.trial069.stdout: "raw_score_stable": 1, 2026-02-18T00:58:32.718 INFO:tasks.workunit.client.0.trial069.stdout: "primary_affinity_weighted": 1, 2026-02-18T00:58:32.718 INFO:tasks.workunit.client.0.trial069.stdout: "average_primary_affinity": 1, 2026-02-18T00:58:32.718 INFO:tasks.workunit.client.0.trial069.stdout: "average_primary_affinity_weighted": 1 2026-02-18T00:58:32.718 INFO:tasks.workunit.client.0.trial069.stdout: } 2026-02-18T00:58:32.718 INFO:tasks.workunit.client.0.trial069.stdout: } 2026-02-18T00:58:32.718 INFO:tasks.workunit.client.0.trial069.stdout: ], 2026-02-18T00:58:32.718 INFO:tasks.workunit.client.0.trial069.stdout: "osds": [ 2026-02-18T00:58:32.718 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:58:32.718 INFO:tasks.workunit.client.0.trial069.stdout: "osd": 0, 2026-02-18T00:58:32.718 INFO:tasks.workunit.client.0.trial069.stdout: "uuid": "c0ad64f3-0cf0-4736-b9d4-83d565764e25", 2026-02-18T00:58:32.718 INFO:tasks.workunit.client.0.trial069.stdout: "up": 1, 2026-02-18T00:58:32.718 INFO:tasks.workunit.client.0.trial069.stdout: "in": 1, 2026-02-18T00:58:32.719 INFO:tasks.workunit.client.0.trial069.stdout: "weight": 1, 2026-02-18T00:58:32.719 INFO:tasks.workunit.client.0.trial069.stdout: "primary_affinity": 1, 2026-02-18T00:58:32.719 INFO:tasks.workunit.client.0.trial069.stdout: "last_clean_begin": 0, 2026-02-18T00:58:32.719 INFO:tasks.workunit.client.0.trial069.stdout: "last_clean_end": 0, 2026-02-18T00:58:32.719 INFO:tasks.workunit.client.0.trial069.stdout: "up_from": 5, 2026-02-18T00:58:32.719 INFO:tasks.workunit.client.0.trial069.stdout: "up_thru": 7, 2026-02-18T00:58:32.719 INFO:tasks.workunit.client.0.trial069.stdout: "down_at": 0, 2026-02-18T00:58:32.719 INFO:tasks.workunit.client.0.trial069.stdout: "lost_at": 0, 2026-02-18T00:58:32.719 INFO:tasks.workunit.client.0.trial069.stdout: "public_addrs": { 2026-02-18T00:58:32.719 INFO:tasks.workunit.client.0.trial069.stdout: "addrvec": [ 2026-02-18T00:58:32.719 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:58:32.719 INFO:tasks.workunit.client.0.trial069.stdout: "type": "v2", 2026-02-18T00:58:32.719 INFO:tasks.workunit.client.0.trial069.stdout: "addr": "127.0.0.1:6800", 2026-02-18T00:58:32.720 INFO:tasks.workunit.client.0.trial069.stdout: "nonce": 3057197645 2026-02-18T00:58:32.720 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:58:32.720 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:58:32.720 INFO:tasks.workunit.client.0.trial069.stdout: "type": "v1", 2026-02-18T00:58:32.720 INFO:tasks.workunit.client.0.trial069.stdout: "addr": "127.0.0.1:6801", 2026-02-18T00:58:32.720 INFO:tasks.workunit.client.0.trial069.stdout: "nonce": 3057197645 2026-02-18T00:58:32.720 INFO:tasks.workunit.client.0.trial069.stdout: } 2026-02-18T00:58:32.720 INFO:tasks.workunit.client.0.trial069.stdout: ] 2026-02-18T00:58:32.720 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:58:32.720 INFO:tasks.workunit.client.0.trial069.stdout: "cluster_addrs": { 2026-02-18T00:58:32.720 INFO:tasks.workunit.client.0.trial069.stdout: "addrvec": [ 2026-02-18T00:58:32.720 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:58:32.720 INFO:tasks.workunit.client.0.trial069.stdout: "type": "v2", 2026-02-18T00:58:32.721 INFO:tasks.workunit.client.0.trial069.stdout: "addr": "127.0.0.1:6802", 2026-02-18T00:58:32.721 INFO:tasks.workunit.client.0.trial069.stdout: "nonce": 3057197645 2026-02-18T00:58:32.721 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:58:32.721 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:58:32.721 INFO:tasks.workunit.client.0.trial069.stdout: "type": "v1", 2026-02-18T00:58:32.721 INFO:tasks.workunit.client.0.trial069.stdout: "addr": "127.0.0.1:6803", 2026-02-18T00:58:32.721 INFO:tasks.workunit.client.0.trial069.stdout: "nonce": 3057197645 2026-02-18T00:58:32.721 INFO:tasks.workunit.client.0.trial069.stdout: } 2026-02-18T00:58:32.721 INFO:tasks.workunit.client.0.trial069.stdout: ] 2026-02-18T00:58:32.721 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:58:32.721 INFO:tasks.workunit.client.0.trial069.stdout: "heartbeat_back_addrs": { 2026-02-18T00:58:32.721 INFO:tasks.workunit.client.0.trial069.stdout: "addrvec": [ 2026-02-18T00:58:32.721 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:58:32.722 INFO:tasks.workunit.client.0.trial069.stdout: "type": "v2", 2026-02-18T00:58:32.722 INFO:tasks.workunit.client.0.trial069.stdout: "addr": "127.0.0.1:6806", 2026-02-18T00:58:32.722 INFO:tasks.workunit.client.0.trial069.stdout: "nonce": 3057197645 2026-02-18T00:58:32.722 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:58:32.722 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:58:32.722 INFO:tasks.workunit.client.0.trial069.stdout: "type": "v1", 2026-02-18T00:58:32.722 INFO:tasks.workunit.client.0.trial069.stdout: "addr": "127.0.0.1:6807", 2026-02-18T00:58:32.722 INFO:tasks.workunit.client.0.trial069.stdout: "nonce": 3057197645 2026-02-18T00:58:32.722 INFO:tasks.workunit.client.0.trial069.stdout: } 2026-02-18T00:58:32.722 INFO:tasks.workunit.client.0.trial069.stdout: ] 2026-02-18T00:58:32.722 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:58:32.722 INFO:tasks.workunit.client.0.trial069.stdout: "heartbeat_front_addrs": { 2026-02-18T00:58:32.722 INFO:tasks.workunit.client.0.trial069.stdout: "addrvec": [ 2026-02-18T00:58:32.723 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:58:32.723 INFO:tasks.workunit.client.0.trial069.stdout: "type": "v2", 2026-02-18T00:58:32.723 INFO:tasks.workunit.client.0.trial069.stdout: "addr": "127.0.0.1:6804", 2026-02-18T00:58:32.723 INFO:tasks.workunit.client.0.trial069.stdout: "nonce": 3057197645 2026-02-18T00:58:32.723 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:58:32.723 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:58:32.723 INFO:tasks.workunit.client.0.trial069.stdout: "type": "v1", 2026-02-18T00:58:32.723 INFO:tasks.workunit.client.0.trial069.stdout: "addr": "127.0.0.1:6805", 2026-02-18T00:58:32.723 INFO:tasks.workunit.client.0.trial069.stdout: "nonce": 3057197645 2026-02-18T00:58:32.723 INFO:tasks.workunit.client.0.trial069.stdout: } 2026-02-18T00:58:32.723 INFO:tasks.workunit.client.0.trial069.stdout: ] 2026-02-18T00:58:32.723 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:58:32.723 INFO:tasks.workunit.client.0.trial069.stdout: "public_addr": "127.0.0.1:6801/3057197645", 2026-02-18T00:58:32.724 INFO:tasks.workunit.client.0.trial069.stdout: "cluster_addr": "127.0.0.1:6803/3057197645", 2026-02-18T00:58:32.724 INFO:tasks.workunit.client.0.trial069.stdout: "heartbeat_back_addr": "127.0.0.1:6807/3057197645", 2026-02-18T00:58:32.724 INFO:tasks.workunit.client.0.trial069.stdout: "heartbeat_front_addr": "127.0.0.1:6805/3057197645", 2026-02-18T00:58:32.724 INFO:tasks.workunit.client.0.trial069.stdout: "state": [ 2026-02-18T00:58:32.724 INFO:tasks.workunit.client.0.trial069.stdout: "exists", 2026-02-18T00:58:32.724 INFO:tasks.workunit.client.0.trial069.stdout: "up" 2026-02-18T00:58:32.724 INFO:tasks.workunit.client.0.trial069.stdout: ] 2026-02-18T00:58:32.724 INFO:tasks.workunit.client.0.trial069.stdout: } 2026-02-18T00:58:32.724 INFO:tasks.workunit.client.0.trial069.stdout: ], 2026-02-18T00:58:32.724 INFO:tasks.workunit.client.0.trial069.stdout: "osd_xinfo": [ 2026-02-18T00:58:32.724 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:58:32.724 INFO:tasks.workunit.client.0.trial069.stdout: "osd": 0, 2026-02-18T00:58:32.724 INFO:tasks.workunit.client.0.trial069.stdout: "down_stamp": "0.000000", 2026-02-18T00:58:32.725 INFO:tasks.workunit.client.0.trial069.stdout: "laggy_probability": 0, 2026-02-18T00:58:32.725 INFO:tasks.workunit.client.0.trial069.stdout: "laggy_interval": 0, 2026-02-18T00:58:32.725 INFO:tasks.workunit.client.0.trial069.stdout: "features": 4544132024016699391, 2026-02-18T00:58:32.725 INFO:tasks.workunit.client.0.trial069.stdout: "old_weight": 0, 2026-02-18T00:58:32.725 INFO:tasks.workunit.client.0.trial069.stdout: "last_purged_snaps_scrub": "2026-02-18T00:58:24.043657+0000", 2026-02-18T00:58:32.725 INFO:tasks.workunit.client.0.trial069.stdout: "dead_epoch": 0 2026-02-18T00:58:32.725 INFO:tasks.workunit.client.0.trial069.stdout: } 2026-02-18T00:58:32.725 INFO:tasks.workunit.client.0.trial069.stdout: ], 2026-02-18T00:58:32.725 INFO:tasks.workunit.client.0.trial069.stdout: "pg_upmap": [], 2026-02-18T00:58:32.725 INFO:tasks.workunit.client.0.trial069.stdout: "pg_upmap_items": [], 2026-02-18T00:58:32.725 INFO:tasks.workunit.client.0.trial069.stdout: "pg_upmap_primaries": [], 2026-02-18T00:58:32.725 INFO:tasks.workunit.client.0.trial069.stdout: "pg_temp": [], 2026-02-18T00:58:32.725 INFO:tasks.workunit.client.0.trial069.stdout: "primary_temp": [], 2026-02-18T00:58:32.725 INFO:tasks.workunit.client.0.trial069.stdout: "blocklist": {}, 2026-02-18T00:58:32.726 INFO:tasks.workunit.client.0.trial069.stdout: "range_blocklist": {}, 2026-02-18T00:58:32.726 INFO:tasks.workunit.client.0.trial069.stdout: "erasure_code_profiles": { 2026-02-18T00:58:32.726 INFO:tasks.workunit.client.0.trial069.stdout: "default": { 2026-02-18T00:58:32.726 INFO:tasks.workunit.client.0.trial069.stdout: "k": "2", 2026-02-18T00:58:32.726 INFO:tasks.workunit.client.0.trial069.stdout: "m": "2", 2026-02-18T00:58:32.726 INFO:tasks.workunit.client.0.trial069.stdout: "plugin": "isa", 2026-02-18T00:58:32.726 INFO:tasks.workunit.client.0.trial069.stdout: "technique": "reed_sol_van" 2026-02-18T00:58:32.726 INFO:tasks.workunit.client.0.trial069.stdout: } 2026-02-18T00:58:32.726 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:58:32.726 INFO:tasks.workunit.client.0.trial069.stdout: "removed_snaps_queue": [ 2026-02-18T00:58:32.726 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:58:32.726 INFO:tasks.workunit.client.0.trial069.stdout: "pool": 1, 2026-02-18T00:58:32.726 INFO:tasks.workunit.client.0.trial069.stdout: "snaps": [ 2026-02-18T00:58:32.727 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:58:32.727 INFO:tasks.workunit.client.0.trial069.stdout: "begin": 2, 2026-02-18T00:58:32.727 INFO:tasks.workunit.client.0.trial069.stdout: "length": 1 2026-02-18T00:58:32.727 INFO:tasks.workunit.client.0.trial069.stdout: } 2026-02-18T00:58:32.727 INFO:tasks.workunit.client.0.trial069.stdout: ] 2026-02-18T00:58:32.727 INFO:tasks.workunit.client.0.trial069.stdout: } 2026-02-18T00:58:32.727 INFO:tasks.workunit.client.0.trial069.stdout: ], 2026-02-18T00:58:32.727 INFO:tasks.workunit.client.0.trial069.stdout: "new_removed_snaps": [ 2026-02-18T00:58:32.727 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:58:32.727 INFO:tasks.workunit.client.0.trial069.stdout: "pool": 1, 2026-02-18T00:58:32.727 INFO:tasks.workunit.client.0.trial069.stdout: "snaps": [ 2026-02-18T00:58:32.727 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:58:32.727 INFO:tasks.workunit.client.0.trial069.stdout: "begin": 2, 2026-02-18T00:58:32.728 INFO:tasks.workunit.client.0.trial069.stdout: "length": 1 2026-02-18T00:58:32.728 INFO:tasks.workunit.client.0.trial069.stdout: } 2026-02-18T00:58:32.728 INFO:tasks.workunit.client.0.trial069.stdout: ] 2026-02-18T00:58:32.728 INFO:tasks.workunit.client.0.trial069.stdout: } 2026-02-18T00:58:32.728 INFO:tasks.workunit.client.0.trial069.stdout: ], 2026-02-18T00:58:32.728 INFO:tasks.workunit.client.0.trial069.stdout: "new_purged_snaps": [], 2026-02-18T00:58:32.728 INFO:tasks.workunit.client.0.trial069.stdout: "crush_node_flags": {}, 2026-02-18T00:58:32.728 INFO:tasks.workunit.client.0.trial069.stdout: "device_class_flags": {}, 2026-02-18T00:58:32.728 INFO:tasks.workunit.client.0.trial069.stdout: "stretch_mode": { 2026-02-18T00:58:32.728 INFO:tasks.workunit.client.0.trial069.stdout: "stretch_mode_enabled": false, 2026-02-18T00:58:32.728 INFO:tasks.workunit.client.0.trial069.stdout: "stretch_bucket_count": 0, 2026-02-18T00:58:32.728 INFO:tasks.workunit.client.0.trial069.stdout: "degraded_stretch_mode": 0, 2026-02-18T00:58:32.728 INFO:tasks.workunit.client.0.trial069.stdout: "recovering_stretch_mode": 0, 2026-02-18T00:58:32.729 INFO:tasks.workunit.client.0.trial069.stdout: "stretch_mode_bucket": 0 2026-02-18T00:58:32.729 INFO:tasks.workunit.client.0.trial069.stdout: } 2026-02-18T00:58:32.729 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:58:32.729 INFO:tasks.workunit.client.0.trial069.stdout: "osd_metadata": [ 2026-02-18T00:58:32.729 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:58:32.729 INFO:tasks.workunit.client.0.trial069.stdout: "id": 0, 2026-02-18T00:58:32.729 INFO:tasks.workunit.client.0.trial069.stdout: "arch": "x86_64", 2026-02-18T00:58:32.729 INFO:tasks.workunit.client.0.trial069.stdout: "back_addr": "[v2:127.0.0.1:6802/3057197645,v1:127.0.0.1:6803/3057197645]", 2026-02-18T00:58:32.729 INFO:tasks.workunit.client.0.trial069.stdout: "back_iface": "", 2026-02-18T00:58:32.729 INFO:tasks.workunit.client.0.trial069.stdout: "bluefs": "1", 2026-02-18T00:58:32.729 INFO:tasks.workunit.client.0.trial069.stdout: "bluefs_dedicated_db": "0", 2026-02-18T00:58:32.729 INFO:tasks.workunit.client.0.trial069.stdout: "bluefs_dedicated_wal": "0", 2026-02-18T00:58:32.729 INFO:tasks.workunit.client.0.trial069.stdout: "bluefs_single_shared_device": "1", 2026-02-18T00:58:32.730 INFO:tasks.workunit.client.0.trial069.stdout: "bluestore_allocation_from_file": "1", 2026-02-18T00:58:32.730 INFO:tasks.workunit.client.0.trial069.stdout: "bluestore_allocator": "hybrid", 2026-02-18T00:58:32.730 INFO:tasks.workunit.client.0.trial069.stdout: "bluestore_bdev_access_mode": "file", 2026-02-18T00:58:32.730 INFO:tasks.workunit.client.0.trial069.stdout: "bluestore_bdev_block_size": "4096", 2026-02-18T00:58:32.730 INFO:tasks.workunit.client.0.trial069.stdout: "bluestore_bdev_devices": "nvme0n1", 2026-02-18T00:58:32.730 INFO:tasks.workunit.client.0.trial069.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-18T00:58:32.730 INFO:tasks.workunit.client.0.trial069.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-18T00:58:32.730 INFO:tasks.workunit.client.0.trial069.stdout: "bluestore_bdev_path": "td/ceph-helpers/0/block", 2026-02-18T00:58:32.730 INFO:tasks.workunit.client.0.trial069.stdout: "bluestore_bdev_rotational": "0", 2026-02-18T00:58:32.730 INFO:tasks.workunit.client.0.trial069.stdout: "bluestore_bdev_size": "107374182400", 2026-02-18T00:58:32.730 INFO:tasks.workunit.client.0.trial069.stdout: "bluestore_bdev_support_discard": "1", 2026-02-18T00:58:32.730 INFO:tasks.workunit.client.0.trial069.stdout: "bluestore_bdev_type": "ssd", 2026-02-18T00:58:32.730 INFO:tasks.workunit.client.0.trial069.stdout: "bluestore_min_alloc_size": "4096", 2026-02-18T00:58:32.731 INFO:tasks.workunit.client.0.trial069.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-18T00:58:32.731 INFO:tasks.workunit.client.0.trial069.stdout: "bluestore_write_mode": "classic", 2026-02-18T00:58:32.731 INFO:tasks.workunit.client.0.trial069.stdout: "ceph_release": "tentacle", 2026-02-18T00:58:32.731 INFO:tasks.workunit.client.0.trial069.stdout: "ceph_version": "ceph version 20.2.0-670-gadc19233 (adc1923395f2bcd6ae89b5d331d278364d1848ed) tentacle (stable - None)", 2026-02-18T00:58:32.731 INFO:tasks.workunit.client.0.trial069.stdout: "ceph_version_short": "20.2.0-670-gadc19233", 2026-02-18T00:58:32.731 INFO:tasks.workunit.client.0.trial069.stdout: "ceph_version_when_created": "ceph version 20.2.0-670-gadc19233 (adc1923395f2bcd6ae89b5d331d278364d1848ed) tentacle (stable - None)", 2026-02-18T00:58:32.731 INFO:tasks.workunit.client.0.trial069.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-18T00:58:32.731 INFO:tasks.workunit.client.0.trial069.stdout: "created_at": "2026-02-18T00:58:21.723073Z", 2026-02-18T00:58:32.731 INFO:tasks.workunit.client.0.trial069.stdout: "default_device_class": "ssd", 2026-02-18T00:58:32.731 INFO:tasks.workunit.client.0.trial069.stdout: "device_ids": "nvme0n1=Micron_7450_MTFDKBA960TFR_25174FCD463C", 2026-02-18T00:58:32.731 INFO:tasks.workunit.client.0.trial069.stdout: "device_paths": "nvme0n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-18T00:58:32.731 INFO:tasks.workunit.client.0.trial069.stdout: "devices": "nvme0n1", 2026-02-18T00:58:32.731 INFO:tasks.workunit.client.0.trial069.stdout: "distro": "ubuntu", 2026-02-18T00:58:32.731 INFO:tasks.workunit.client.0.trial069.stdout: "distro_description": "Ubuntu 22.04.5 LTS", 2026-02-18T00:58:32.732 INFO:tasks.workunit.client.0.trial069.stdout: "distro_version": "22.04", 2026-02-18T00:58:32.732 INFO:tasks.workunit.client.0.trial069.stdout: "front_addr": "[v2:127.0.0.1:6800/3057197645,v1:127.0.0.1:6801/3057197645]", 2026-02-18T00:58:32.732 INFO:tasks.workunit.client.0.trial069.stdout: "front_iface": "", 2026-02-18T00:58:32.732 INFO:tasks.workunit.client.0.trial069.stdout: "hb_back_addr": "[v2:127.0.0.1:6806/3057197645,v1:127.0.0.1:6807/3057197645]", 2026-02-18T00:58:32.732 INFO:tasks.workunit.client.0.trial069.stdout: "hb_front_addr": "[v2:127.0.0.1:6804/3057197645,v1:127.0.0.1:6805/3057197645]", 2026-02-18T00:58:32.732 INFO:tasks.workunit.client.0.trial069.stdout: "hostname": "trial069", 2026-02-18T00:58:32.732 INFO:tasks.workunit.client.0.trial069.stdout: "journal_rotational": "0", 2026-02-18T00:58:32.732 INFO:tasks.workunit.client.0.trial069.stdout: "kernel_description": "#180-Ubuntu SMP Fri Jan 9 16:10:31 UTC 2026", 2026-02-18T00:58:32.732 INFO:tasks.workunit.client.0.trial069.stdout: "kernel_version": "5.15.0-170-generic", 2026-02-18T00:58:32.732 INFO:tasks.workunit.client.0.trial069.stdout: "mem_swap_kb": "8388604", 2026-02-18T00:58:32.732 INFO:tasks.workunit.client.0.trial069.stdout: "mem_total_kb": "130961700", 2026-02-18T00:58:32.732 INFO:tasks.workunit.client.0.trial069.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-18T00:58:32.732 INFO:tasks.workunit.client.0.trial069.stdout: "objectstore_numa_node": "0", 2026-02-18T00:58:32.733 INFO:tasks.workunit.client.0.trial069.stdout: "objectstore_numa_nodes": "0", 2026-02-18T00:58:32.733 INFO:tasks.workunit.client.0.trial069.stdout: "os": "Linux", 2026-02-18T00:58:32.733 INFO:tasks.workunit.client.0.trial069.stdout: "osd_data": "td/ceph-helpers/0", 2026-02-18T00:58:32.733 INFO:tasks.workunit.client.0.trial069.stdout: "osd_objectstore": "bluestore", 2026-02-18T00:58:32.733 INFO:tasks.workunit.client.0.trial069.stdout: "osdspec_affinity": "", 2026-02-18T00:58:32.733 INFO:tasks.workunit.client.0.trial069.stdout: "rotational": "0" 2026-02-18T00:58:32.733 INFO:tasks.workunit.client.0.trial069.stdout: } 2026-02-18T00:58:32.733 INFO:tasks.workunit.client.0.trial069.stdout: ], 2026-02-18T00:58:32.733 INFO:tasks.workunit.client.0.trial069.stdout: "osdmap_clean_epochs": { 2026-02-18T00:58:32.733 INFO:tasks.workunit.client.0.trial069.stdout: "min_last_epoch_clean": 0, 2026-02-18T00:58:32.733 INFO:tasks.workunit.client.0.trial069.stdout: "last_epoch_clean": { 2026-02-18T00:58:32.733 INFO:tasks.workunit.client.0.trial069.stdout: "per_pool": [] 2026-02-18T00:58:32.733 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:58:32.734 INFO:tasks.workunit.client.0.trial069.stdout: "osd_epochs": [ 2026-02-18T00:58:32.734 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:58:32.734 INFO:tasks.workunit.client.0.trial069.stdout: "id": 0, 2026-02-18T00:58:32.734 INFO:tasks.workunit.client.0.trial069.stdout: "epoch": 5 2026-02-18T00:58:32.734 INFO:tasks.workunit.client.0.trial069.stdout: } 2026-02-18T00:58:32.734 INFO:tasks.workunit.client.0.trial069.stdout: ] 2026-02-18T00:58:32.734 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:58:32.734 INFO:tasks.workunit.client.0.trial069.stdout: "osdmap_first_committed": 1, 2026-02-18T00:58:32.734 INFO:tasks.workunit.client.0.trial069.stdout: "osdmap_last_committed": 12, 2026-02-18T00:58:32.734 INFO:tasks.workunit.client.0.trial069.stdout: "crushmap": { 2026-02-18T00:58:32.734 INFO:tasks.workunit.client.0.trial069.stdout: "devices": [ 2026-02-18T00:58:32.734 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:58:32.734 INFO:tasks.workunit.client.0.trial069.stdout: "id": 0, 2026-02-18T00:58:32.735 INFO:tasks.workunit.client.0.trial069.stdout: "name": "osd.0", 2026-02-18T00:58:32.735 INFO:tasks.workunit.client.0.trial069.stdout: "class": "ssd" 2026-02-18T00:58:32.735 INFO:tasks.workunit.client.0.trial069.stdout: } 2026-02-18T00:58:32.735 INFO:tasks.workunit.client.0.trial069.stdout: ], 2026-02-18T00:58:32.735 INFO:tasks.workunit.client.0.trial069.stdout: "types": [ 2026-02-18T00:58:32.735 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:58:32.735 INFO:tasks.workunit.client.0.trial069.stdout: "type_id": 0, 2026-02-18T00:58:32.735 INFO:tasks.workunit.client.0.trial069.stdout: "name": "osd" 2026-02-18T00:58:32.735 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:58:32.735 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:58:32.735 INFO:tasks.workunit.client.0.trial069.stdout: "type_id": 1, 2026-02-18T00:58:32.735 INFO:tasks.workunit.client.0.trial069.stdout: "name": "host" 2026-02-18T00:58:32.735 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:58:32.735 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:58:32.736 INFO:tasks.workunit.client.0.trial069.stdout: "type_id": 2, 2026-02-18T00:58:32.736 INFO:tasks.workunit.client.0.trial069.stdout: "name": "chassis" 2026-02-18T00:58:32.736 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:58:32.736 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:58:32.736 INFO:tasks.workunit.client.0.trial069.stdout: "type_id": 3, 2026-02-18T00:58:32.736 INFO:tasks.workunit.client.0.trial069.stdout: "name": "rack" 2026-02-18T00:58:32.736 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:58:32.736 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:58:32.736 INFO:tasks.workunit.client.0.trial069.stdout: "type_id": 4, 2026-02-18T00:58:32.736 INFO:tasks.workunit.client.0.trial069.stdout: "name": "row" 2026-02-18T00:58:32.736 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:58:32.736 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:58:32.736 INFO:tasks.workunit.client.0.trial069.stdout: "type_id": 5, 2026-02-18T00:58:32.737 INFO:tasks.workunit.client.0.trial069.stdout: "name": "pdu" 2026-02-18T00:58:32.737 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:58:32.737 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:58:32.737 INFO:tasks.workunit.client.0.trial069.stdout: "type_id": 6, 2026-02-18T00:58:32.737 INFO:tasks.workunit.client.0.trial069.stdout: "name": "pod" 2026-02-18T00:58:32.737 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:58:32.737 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:58:32.737 INFO:tasks.workunit.client.0.trial069.stdout: "type_id": 7, 2026-02-18T00:58:32.737 INFO:tasks.workunit.client.0.trial069.stdout: "name": "room" 2026-02-18T00:58:32.737 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:58:32.737 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:58:32.737 INFO:tasks.workunit.client.0.trial069.stdout: "type_id": 8, 2026-02-18T00:58:32.737 INFO:tasks.workunit.client.0.trial069.stdout: "name": "datacenter" 2026-02-18T00:58:32.737 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:58:32.738 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:58:32.738 INFO:tasks.workunit.client.0.trial069.stdout: "type_id": 9, 2026-02-18T00:58:32.738 INFO:tasks.workunit.client.0.trial069.stdout: "name": "zone" 2026-02-18T00:58:32.738 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:58:32.738 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:58:32.738 INFO:tasks.workunit.client.0.trial069.stdout: "type_id": 10, 2026-02-18T00:58:32.738 INFO:tasks.workunit.client.0.trial069.stdout: "name": "region" 2026-02-18T00:58:32.738 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:58:32.738 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:58:32.738 INFO:tasks.workunit.client.0.trial069.stdout: "type_id": 11, 2026-02-18T00:58:32.738 INFO:tasks.workunit.client.0.trial069.stdout: "name": "root" 2026-02-18T00:58:32.738 INFO:tasks.workunit.client.0.trial069.stdout: } 2026-02-18T00:58:32.738 INFO:tasks.workunit.client.0.trial069.stdout: ], 2026-02-18T00:58:32.739 INFO:tasks.workunit.client.0.trial069.stdout: "buckets": [ 2026-02-18T00:58:32.739 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:58:32.739 INFO:tasks.workunit.client.0.trial069.stdout: "id": -1, 2026-02-18T00:58:32.739 INFO:tasks.workunit.client.0.trial069.stdout: "name": "default", 2026-02-18T00:58:32.739 INFO:tasks.workunit.client.0.trial069.stdout: "type_id": 11, 2026-02-18T00:58:32.739 INFO:tasks.workunit.client.0.trial069.stdout: "type_name": "root", 2026-02-18T00:58:32.739 INFO:tasks.workunit.client.0.trial069.stdout: "weight": 6402, 2026-02-18T00:58:32.739 INFO:tasks.workunit.client.0.trial069.stdout: "alg": "straw2", 2026-02-18T00:58:32.739 INFO:tasks.workunit.client.0.trial069.stdout: "hash": "rjenkins1", 2026-02-18T00:58:32.739 INFO:tasks.workunit.client.0.trial069.stdout: "items": [ 2026-02-18T00:58:32.739 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:58:32.739 INFO:tasks.workunit.client.0.trial069.stdout: "id": -3, 2026-02-18T00:58:32.739 INFO:tasks.workunit.client.0.trial069.stdout: "weight": 6402, 2026-02-18T00:58:32.740 INFO:tasks.workunit.client.0.trial069.stdout: "pos": 0 2026-02-18T00:58:32.740 INFO:tasks.workunit.client.0.trial069.stdout: } 2026-02-18T00:58:32.740 INFO:tasks.workunit.client.0.trial069.stdout: ] 2026-02-18T00:58:32.740 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:58:32.740 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:58:32.740 INFO:tasks.workunit.client.0.trial069.stdout: "id": -2, 2026-02-18T00:58:32.740 INFO:tasks.workunit.client.0.trial069.stdout: "name": "default~ssd", 2026-02-18T00:58:32.740 INFO:tasks.workunit.client.0.trial069.stdout: "type_id": 11, 2026-02-18T00:58:32.740 INFO:tasks.workunit.client.0.trial069.stdout: "type_name": "root", 2026-02-18T00:58:32.740 INFO:tasks.workunit.client.0.trial069.stdout: "weight": 6402, 2026-02-18T00:58:32.740 INFO:tasks.workunit.client.0.trial069.stdout: "alg": "straw2", 2026-02-18T00:58:32.740 INFO:tasks.workunit.client.0.trial069.stdout: "hash": "rjenkins1", 2026-02-18T00:58:32.740 INFO:tasks.workunit.client.0.trial069.stdout: "items": [ 2026-02-18T00:58:32.740 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:58:32.740 INFO:tasks.workunit.client.0.trial069.stdout: "id": -4, 2026-02-18T00:58:32.741 INFO:tasks.workunit.client.0.trial069.stdout: "weight": 6402, 2026-02-18T00:58:32.741 INFO:tasks.workunit.client.0.trial069.stdout: "pos": 0 2026-02-18T00:58:32.741 INFO:tasks.workunit.client.0.trial069.stdout: } 2026-02-18T00:58:32.741 INFO:tasks.workunit.client.0.trial069.stdout: ] 2026-02-18T00:58:32.741 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:58:32.741 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:58:32.741 INFO:tasks.workunit.client.0.trial069.stdout: "id": -3, 2026-02-18T00:58:32.741 INFO:tasks.workunit.client.0.trial069.stdout: "name": "trial069", 2026-02-18T00:58:32.741 INFO:tasks.workunit.client.0.trial069.stdout: "type_id": 1, 2026-02-18T00:58:32.741 INFO:tasks.workunit.client.0.trial069.stdout: "type_name": "host", 2026-02-18T00:58:32.741 INFO:tasks.workunit.client.0.trial069.stdout: "weight": 6402, 2026-02-18T00:58:32.741 INFO:tasks.workunit.client.0.trial069.stdout: "alg": "straw2", 2026-02-18T00:58:32.741 INFO:tasks.workunit.client.0.trial069.stdout: "hash": "rjenkins1", 2026-02-18T00:58:32.741 INFO:tasks.workunit.client.0.trial069.stdout: "items": [ 2026-02-18T00:58:32.742 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:58:32.742 INFO:tasks.workunit.client.0.trial069.stdout: "id": 0, 2026-02-18T00:58:32.742 INFO:tasks.workunit.client.0.trial069.stdout: "weight": 6402, 2026-02-18T00:58:32.742 INFO:tasks.workunit.client.0.trial069.stdout: "pos": 0 2026-02-18T00:58:32.742 INFO:tasks.workunit.client.0.trial069.stdout: } 2026-02-18T00:58:32.742 INFO:tasks.workunit.client.0.trial069.stdout: ] 2026-02-18T00:58:32.742 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:58:32.742 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:58:32.742 INFO:tasks.workunit.client.0.trial069.stdout: "id": -4, 2026-02-18T00:58:32.742 INFO:tasks.workunit.client.0.trial069.stdout: "name": "trial069~ssd", 2026-02-18T00:58:32.742 INFO:tasks.workunit.client.0.trial069.stdout: "type_id": 1, 2026-02-18T00:58:32.742 INFO:tasks.workunit.client.0.trial069.stdout: "type_name": "host", 2026-02-18T00:58:32.742 INFO:tasks.workunit.client.0.trial069.stdout: "weight": 6402, 2026-02-18T00:58:32.742 INFO:tasks.workunit.client.0.trial069.stdout: "alg": "straw2", 2026-02-18T00:58:32.742 INFO:tasks.workunit.client.0.trial069.stdout: "hash": "rjenkins1", 2026-02-18T00:58:32.742 INFO:tasks.workunit.client.0.trial069.stdout: "items": [ 2026-02-18T00:58:32.743 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:58:32.743 INFO:tasks.workunit.client.0.trial069.stdout: "id": 0, 2026-02-18T00:58:32.743 INFO:tasks.workunit.client.0.trial069.stdout: "weight": 6402, 2026-02-18T00:58:32.743 INFO:tasks.workunit.client.0.trial069.stdout: "pos": 0 2026-02-18T00:58:32.743 INFO:tasks.workunit.client.0.trial069.stdout: } 2026-02-18T00:58:32.743 INFO:tasks.workunit.client.0.trial069.stdout: ] 2026-02-18T00:58:32.743 INFO:tasks.workunit.client.0.trial069.stdout: } 2026-02-18T00:58:32.743 INFO:tasks.workunit.client.0.trial069.stdout: ], 2026-02-18T00:58:32.743 INFO:tasks.workunit.client.0.trial069.stdout: "rules": [ 2026-02-18T00:58:32.743 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:58:32.743 INFO:tasks.workunit.client.0.trial069.stdout: "rule_id": 0, 2026-02-18T00:58:32.743 INFO:tasks.workunit.client.0.trial069.stdout: "rule_name": "replicated_rule", 2026-02-18T00:58:32.743 INFO:tasks.workunit.client.0.trial069.stdout: "type": 1, 2026-02-18T00:58:32.743 INFO:tasks.workunit.client.0.trial069.stdout: "steps": [ 2026-02-18T00:58:32.743 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:58:32.743 INFO:tasks.workunit.client.0.trial069.stdout: "op": "take", 2026-02-18T00:58:32.743 INFO:tasks.workunit.client.0.trial069.stdout: "item": -1, 2026-02-18T00:58:32.744 INFO:tasks.workunit.client.0.trial069.stdout: "item_name": "default" 2026-02-18T00:58:32.744 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:58:32.744 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:58:32.744 INFO:tasks.workunit.client.0.trial069.stdout: "op": "choose_firstn", 2026-02-18T00:58:32.744 INFO:tasks.workunit.client.0.trial069.stdout: "num": 0, 2026-02-18T00:58:32.744 INFO:tasks.workunit.client.0.trial069.stdout: "type": "osd" 2026-02-18T00:58:32.744 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:58:32.744 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:58:32.744 INFO:tasks.workunit.client.0.trial069.stdout: "op": "emit" 2026-02-18T00:58:32.744 INFO:tasks.workunit.client.0.trial069.stdout: } 2026-02-18T00:58:32.744 INFO:tasks.workunit.client.0.trial069.stdout: ] 2026-02-18T00:58:32.744 INFO:tasks.workunit.client.0.trial069.stdout: } 2026-02-18T00:58:32.744 INFO:tasks.workunit.client.0.trial069.stdout: ], 2026-02-18T00:58:32.744 INFO:tasks.workunit.client.0.trial069.stdout: "tunables": { 2026-02-18T00:58:32.744 INFO:tasks.workunit.client.0.trial069.stdout: "choose_local_tries": 0, 2026-02-18T00:58:32.744 INFO:tasks.workunit.client.0.trial069.stdout: "choose_local_fallback_tries": 0, 2026-02-18T00:58:32.745 INFO:tasks.workunit.client.0.trial069.stdout: "choose_total_tries": 50, 2026-02-18T00:58:32.745 INFO:tasks.workunit.client.0.trial069.stdout: "chooseleaf_descend_once": 1, 2026-02-18T00:58:32.745 INFO:tasks.workunit.client.0.trial069.stdout: "chooseleaf_vary_r": 1, 2026-02-18T00:58:32.745 INFO:tasks.workunit.client.0.trial069.stdout: "chooseleaf_stable": 1, 2026-02-18T00:58:32.745 INFO:tasks.workunit.client.0.trial069.stdout: "msr_descents": 100, 2026-02-18T00:58:32.745 INFO:tasks.workunit.client.0.trial069.stdout: "msr_collision_tries": 100, 2026-02-18T00:58:32.745 INFO:tasks.workunit.client.0.trial069.stdout: "straw_calc_version": 1, 2026-02-18T00:58:32.745 INFO:tasks.workunit.client.0.trial069.stdout: "allowed_bucket_algs": 54, 2026-02-18T00:58:32.745 INFO:tasks.workunit.client.0.trial069.stdout: "profile": "jewel", 2026-02-18T00:58:32.745 INFO:tasks.workunit.client.0.trial069.stdout: "optimal_tunables": 1, 2026-02-18T00:58:32.745 INFO:tasks.workunit.client.0.trial069.stdout: "legacy_tunables": 0, 2026-02-18T00:58:32.745 INFO:tasks.workunit.client.0.trial069.stdout: "minimum_required_version": "jewel", 2026-02-18T00:58:32.745 INFO:tasks.workunit.client.0.trial069.stdout: "require_feature_tunables": 1, 2026-02-18T00:58:32.745 INFO:tasks.workunit.client.0.trial069.stdout: "require_feature_tunables2": 1, 2026-02-18T00:58:32.745 INFO:tasks.workunit.client.0.trial069.stdout: "has_v2_rules": 0, 2026-02-18T00:58:32.745 INFO:tasks.workunit.client.0.trial069.stdout: "require_feature_tunables3": 1, 2026-02-18T00:58:32.746 INFO:tasks.workunit.client.0.trial069.stdout: "has_v3_rules": 0, 2026-02-18T00:58:32.746 INFO:tasks.workunit.client.0.trial069.stdout: "has_v4_buckets": 1, 2026-02-18T00:58:32.746 INFO:tasks.workunit.client.0.trial069.stdout: "require_feature_tunables5": 1, 2026-02-18T00:58:32.746 INFO:tasks.workunit.client.0.trial069.stdout: "has_v5_rules": 0, 2026-02-18T00:58:32.746 INFO:tasks.workunit.client.0.trial069.stdout: "has_msr_rules": 0 2026-02-18T00:58:32.746 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:58:32.746 INFO:tasks.workunit.client.0.trial069.stdout: "choose_args": {} 2026-02-18T00:58:32.746 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:58:32.746 INFO:tasks.workunit.client.0.trial069.stdout: "fsmap": { 2026-02-18T00:58:32.746 INFO:tasks.workunit.client.0.trial069.stdout: "epoch": 1, 2026-02-18T00:58:32.746 INFO:tasks.workunit.client.0.trial069.stdout: "btime": "2026-02-18T00:58:20:948956+0000", 2026-02-18T00:58:32.746 INFO:tasks.workunit.client.0.trial069.stdout: "default_fscid": -1, 2026-02-18T00:58:32.746 INFO:tasks.workunit.client.0.trial069.stdout: "compat": { 2026-02-18T00:58:32.746 INFO:tasks.workunit.client.0.trial069.stdout: "compat": {}, 2026-02-18T00:58:32.746 INFO:tasks.workunit.client.0.trial069.stdout: "ro_compat": {}, 2026-02-18T00:58:32.746 INFO:tasks.workunit.client.0.trial069.stdout: "incompat": { 2026-02-18T00:58:32.746 INFO:tasks.workunit.client.0.trial069.stdout: "feature_1": "base v0.20", 2026-02-18T00:58:32.747 INFO:tasks.workunit.client.0.trial069.stdout: "feature_2": "client writeable ranges", 2026-02-18T00:58:32.747 INFO:tasks.workunit.client.0.trial069.stdout: "feature_3": "default file layouts on dirs", 2026-02-18T00:58:32.747 INFO:tasks.workunit.client.0.trial069.stdout: "feature_4": "dir inode in separate object", 2026-02-18T00:58:32.747 INFO:tasks.workunit.client.0.trial069.stdout: "feature_5": "mds uses versioned encoding", 2026-02-18T00:58:32.747 INFO:tasks.workunit.client.0.trial069.stdout: "feature_6": "dirfrag is stored in omap", 2026-02-18T00:58:32.747 INFO:tasks.workunit.client.0.trial069.stdout: "feature_8": "no anchor table", 2026-02-18T00:58:32.747 INFO:tasks.workunit.client.0.trial069.stdout: "feature_9": "file layout v2", 2026-02-18T00:58:32.747 INFO:tasks.workunit.client.0.trial069.stdout: "feature_10": "snaprealm v2", 2026-02-18T00:58:32.747 INFO:tasks.workunit.client.0.trial069.stdout: "feature_11": "minor log segments", 2026-02-18T00:58:32.747 INFO:tasks.workunit.client.0.trial069.stdout: "feature_12": "quiesce subvolumes" 2026-02-18T00:58:32.747 INFO:tasks.workunit.client.0.trial069.stdout: } 2026-02-18T00:58:32.747 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:58:32.747 INFO:tasks.workunit.client.0.trial069.stdout: "feature_flags": { 2026-02-18T00:58:32.747 INFO:tasks.workunit.client.0.trial069.stdout: "enable_multiple": true, 2026-02-18T00:58:32.747 INFO:tasks.workunit.client.0.trial069.stdout: "ever_enabled_multiple": true 2026-02-18T00:58:32.747 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:58:32.747 INFO:tasks.workunit.client.0.trial069.stdout: "standbys": [], 2026-02-18T00:58:32.747 INFO:tasks.workunit.client.0.trial069.stdout: "filesystems": [] 2026-02-18T00:58:32.748 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:58:32.748 INFO:tasks.workunit.client.0.trial069.stdout: "mdsmap_first_committed": 1, 2026-02-18T00:58:32.748 INFO:tasks.workunit.client.0.trial069.stdout: "mdsmap_last_committed": 1, 2026-02-18T00:58:32.748 INFO:tasks.workunit.client.0.trial069.stdout: "auth": { 2026-02-18T00:58:32.748 INFO:tasks.workunit.client.0.trial069.stdout: "first_committed": 1, 2026-02-18T00:58:32.748 INFO:tasks.workunit.client.0.trial069.stdout: "last_committed": 3, 2026-02-18T00:58:32.748 INFO:tasks.workunit.client.0.trial069.stdout: "num_secrets": 1 2026-02-18T00:58:32.748 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:58:32.748 INFO:tasks.workunit.client.0.trial069.stdout: "num_pg": 4, 2026-02-18T00:58:32.748 INFO:tasks.workunit.client.0.trial069.stdout: "num_pg_active": 4, 2026-02-18T00:58:32.748 INFO:tasks.workunit.client.0.trial069.stdout: "num_pg_unknown": 0, 2026-02-18T00:58:32.748 INFO:tasks.workunit.client.0.trial069.stdout: "num_osd": 1, 2026-02-18T00:58:32.749 INFO:tasks.workunit.client.0.trial069.stdout: "pool_sum": { 2026-02-18T00:58:32.749 INFO:tasks.workunit.client.0.trial069.stdout: "stat_sum": { 2026-02-18T00:58:32.749 INFO:tasks.workunit.client.0.trial069.stdout: "num_bytes": 19, 2026-02-18T00:58:32.749 INFO:tasks.workunit.client.0.trial069.stdout: "num_objects": 2, 2026-02-18T00:58:32.749 INFO:tasks.workunit.client.0.trial069.stdout: "num_object_clones": 0, 2026-02-18T00:58:32.749 INFO:tasks.workunit.client.0.trial069.stdout: "num_object_copies": 4, 2026-02-18T00:58:32.749 INFO:tasks.workunit.client.0.trial069.stdout: "num_objects_missing_on_primary": 0, 2026-02-18T00:58:32.749 INFO:tasks.workunit.client.0.trial069.stdout: "num_objects_missing": 0, 2026-02-18T00:58:32.749 INFO:tasks.workunit.client.0.trial069.stdout: "num_objects_degraded": 2, 2026-02-18T00:58:32.749 INFO:tasks.workunit.client.0.trial069.stdout: "num_objects_misplaced": 0, 2026-02-18T00:58:32.749 INFO:tasks.workunit.client.0.trial069.stdout: "num_objects_unfound": 0, 2026-02-18T00:58:32.749 INFO:tasks.workunit.client.0.trial069.stdout: "num_objects_dirty": 2, 2026-02-18T00:58:32.750 INFO:tasks.workunit.client.0.trial069.stdout: "num_whiteouts": 0, 2026-02-18T00:58:32.750 INFO:tasks.workunit.client.0.trial069.stdout: "num_read": 0, 2026-02-18T00:58:32.750 INFO:tasks.workunit.client.0.trial069.stdout: "num_read_kb": 0, 2026-02-18T00:58:32.750 INFO:tasks.workunit.client.0.trial069.stdout: "num_write": 2, 2026-02-18T00:58:32.750 INFO:tasks.workunit.client.0.trial069.stdout: "num_write_kb": 2, 2026-02-18T00:58:32.750 INFO:tasks.workunit.client.0.trial069.stdout: "num_scrub_errors": 0, 2026-02-18T00:58:32.750 INFO:tasks.workunit.client.0.trial069.stdout: "num_shallow_scrub_errors": 0, 2026-02-18T00:58:32.750 INFO:tasks.workunit.client.0.trial069.stdout: "num_deep_scrub_errors": 0, 2026-02-18T00:58:32.750 INFO:tasks.workunit.client.0.trial069.stdout: "num_objects_recovered": 0, 2026-02-18T00:58:32.750 INFO:tasks.workunit.client.0.trial069.stdout: "num_bytes_recovered": 0, 2026-02-18T00:58:32.750 INFO:tasks.workunit.client.0.trial069.stdout: "num_keys_recovered": 0, 2026-02-18T00:58:32.750 INFO:tasks.workunit.client.0.trial069.stdout: "num_objects_omap": 0, 2026-02-18T00:58:32.750 INFO:tasks.workunit.client.0.trial069.stdout: "num_objects_hit_set_archive": 0, 2026-02-18T00:58:32.750 INFO:tasks.workunit.client.0.trial069.stdout: "num_bytes_hit_set_archive": 0, 2026-02-18T00:58:32.750 INFO:tasks.workunit.client.0.trial069.stdout: "num_flush": 0, 2026-02-18T00:58:32.750 INFO:tasks.workunit.client.0.trial069.stdout: "num_flush_kb": 0, 2026-02-18T00:58:32.750 INFO:tasks.workunit.client.0.trial069.stdout: "num_evict": 0, 2026-02-18T00:58:32.750 INFO:tasks.workunit.client.0.trial069.stdout: "num_evict_kb": 0, 2026-02-18T00:58:32.750 INFO:tasks.workunit.client.0.trial069.stdout: "num_promote": 0, 2026-02-18T00:58:32.751 INFO:tasks.workunit.client.0.trial069.stdout: "num_flush_mode_high": 0, 2026-02-18T00:58:32.751 INFO:tasks.workunit.client.0.trial069.stdout: "num_flush_mode_low": 0, 2026-02-18T00:58:32.751 INFO:tasks.workunit.client.0.trial069.stdout: "num_evict_mode_some": 0, 2026-02-18T00:58:32.751 INFO:tasks.workunit.client.0.trial069.stdout: "num_evict_mode_full": 0, 2026-02-18T00:58:32.751 INFO:tasks.workunit.client.0.trial069.stdout: "num_objects_pinned": 0, 2026-02-18T00:58:32.751 INFO:tasks.workunit.client.0.trial069.stdout: "num_legacy_snapsets": 0, 2026-02-18T00:58:32.751 INFO:tasks.workunit.client.0.trial069.stdout: "num_large_omap_objects": 0, 2026-02-18T00:58:32.751 INFO:tasks.workunit.client.0.trial069.stdout: "num_objects_manifest": 0, 2026-02-18T00:58:32.751 INFO:tasks.workunit.client.0.trial069.stdout: "num_omap_bytes": 0, 2026-02-18T00:58:32.751 INFO:tasks.workunit.client.0.trial069.stdout: "num_omap_keys": 0, 2026-02-18T00:58:32.751 INFO:tasks.workunit.client.0.trial069.stdout: "num_objects_repaired": 0 2026-02-18T00:58:32.751 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:58:32.751 INFO:tasks.workunit.client.0.trial069.stdout: "store_stats": { 2026-02-18T00:58:32.751 INFO:tasks.workunit.client.0.trial069.stdout: "total": 0, 2026-02-18T00:58:32.751 INFO:tasks.workunit.client.0.trial069.stdout: "available": 0, 2026-02-18T00:58:32.751 INFO:tasks.workunit.client.0.trial069.stdout: "internally_reserved": 0, 2026-02-18T00:58:32.751 INFO:tasks.workunit.client.0.trial069.stdout: "allocated": 0, 2026-02-18T00:58:32.751 INFO:tasks.workunit.client.0.trial069.stdout: "data_stored": 0, 2026-02-18T00:58:32.751 INFO:tasks.workunit.client.0.trial069.stdout: "data_compressed": 0, 2026-02-18T00:58:32.752 INFO:tasks.workunit.client.0.trial069.stdout: "data_compressed_allocated": 0, 2026-02-18T00:58:32.752 INFO:tasks.workunit.client.0.trial069.stdout: "data_compressed_original": 0, 2026-02-18T00:58:32.752 INFO:tasks.workunit.client.0.trial069.stdout: "omap_allocated": 0, 2026-02-18T00:58:32.752 INFO:tasks.workunit.client.0.trial069.stdout: "internal_metadata": 0 2026-02-18T00:58:32.752 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:58:32.752 INFO:tasks.workunit.client.0.trial069.stdout: "log_size": 3, 2026-02-18T00:58:32.752 INFO:tasks.workunit.client.0.trial069.stdout: "ondisk_log_size": 3, 2026-02-18T00:58:32.752 INFO:tasks.workunit.client.0.trial069.stdout: "up": 4, 2026-02-18T00:58:32.752 INFO:tasks.workunit.client.0.trial069.stdout: "acting": 4, 2026-02-18T00:58:32.752 INFO:tasks.workunit.client.0.trial069.stdout: "num_store_stats": 0 2026-02-18T00:58:32.752 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:58:32.752 INFO:tasks.workunit.client.0.trial069.stdout: "osd_sum": { 2026-02-18T00:58:32.752 INFO:tasks.workunit.client.0.trial069.stdout: "up_from": 0, 2026-02-18T00:58:32.752 INFO:tasks.workunit.client.0.trial069.stdout: "seq": 0, 2026-02-18T00:58:32.752 INFO:tasks.workunit.client.0.trial069.stdout: "num_pgs": 0, 2026-02-18T00:58:32.752 INFO:tasks.workunit.client.0.trial069.stdout: "num_osds": 1, 2026-02-18T00:58:32.752 INFO:tasks.workunit.client.0.trial069.stdout: "num_per_pool_osds": 1, 2026-02-18T00:58:32.752 INFO:tasks.workunit.client.0.trial069.stdout: "num_per_pool_omap_osds": 1, 2026-02-18T00:58:32.752 INFO:tasks.workunit.client.0.trial069.stdout: "kb": 104857600, 2026-02-18T00:58:32.752 INFO:tasks.workunit.client.0.trial069.stdout: "kb_used": 27060, 2026-02-18T00:58:32.753 INFO:tasks.workunit.client.0.trial069.stdout: "kb_used_data": 100, 2026-02-18T00:58:32.753 INFO:tasks.workunit.client.0.trial069.stdout: "kb_used_omap": 7, 2026-02-18T00:58:32.753 INFO:tasks.workunit.client.0.trial069.stdout: "kb_used_meta": 26936, 2026-02-18T00:58:32.753 INFO:tasks.workunit.client.0.trial069.stdout: "kb_avail": 104830540, 2026-02-18T00:58:32.753 INFO:tasks.workunit.client.0.trial069.stdout: "statfs": { 2026-02-18T00:58:32.753 INFO:tasks.workunit.client.0.trial069.stdout: "total": 107374182400, 2026-02-18T00:58:32.753 INFO:tasks.workunit.client.0.trial069.stdout: "available": 107346472960, 2026-02-18T00:58:32.753 INFO:tasks.workunit.client.0.trial069.stdout: "internally_reserved": 0, 2026-02-18T00:58:32.753 INFO:tasks.workunit.client.0.trial069.stdout: "allocated": 102400, 2026-02-18T00:58:32.753 INFO:tasks.workunit.client.0.trial069.stdout: "data_stored": 20595, 2026-02-18T00:58:32.753 INFO:tasks.workunit.client.0.trial069.stdout: "data_compressed": 0, 2026-02-18T00:58:32.753 INFO:tasks.workunit.client.0.trial069.stdout: "data_compressed_allocated": 0, 2026-02-18T00:58:32.753 INFO:tasks.workunit.client.0.trial069.stdout: "data_compressed_original": 0, 2026-02-18T00:58:32.753 INFO:tasks.workunit.client.0.trial069.stdout: "omap_allocated": 8135, 2026-02-18T00:58:32.753 INFO:tasks.workunit.client.0.trial069.stdout: "internal_metadata": 27582521 2026-02-18T00:58:32.753 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:58:32.753 INFO:tasks.workunit.client.0.trial069.stdout: "hb_peers": [], 2026-02-18T00:58:32.753 INFO:tasks.workunit.client.0.trial069.stdout: "snap_trim_queue_len": 0, 2026-02-18T00:58:32.753 INFO:tasks.workunit.client.0.trial069.stdout: "num_snap_trimming": 0, 2026-02-18T00:58:32.753 INFO:tasks.workunit.client.0.trial069.stdout: "num_shards_repaired": 0, 2026-02-18T00:58:32.753 INFO:tasks.workunit.client.0.trial069.stdout: "op_queue_age_hist": { 2026-02-18T00:58:32.753 INFO:tasks.workunit.client.0.trial069.stdout: "histogram": [], 2026-02-18T00:58:32.754 INFO:tasks.workunit.client.0.trial069.stdout: "upper_bound": 1 2026-02-18T00:58:32.754 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:58:32.754 INFO:tasks.workunit.client.0.trial069.stdout: "perf_stat": { 2026-02-18T00:58:32.754 INFO:tasks.workunit.client.0.trial069.stdout: "commit_latency_ms": 0, 2026-02-18T00:58:32.754 INFO:tasks.workunit.client.0.trial069.stdout: "apply_latency_ms": 0, 2026-02-18T00:58:32.754 INFO:tasks.workunit.client.0.trial069.stdout: "commit_latency_ns": 0, 2026-02-18T00:58:32.754 INFO:tasks.workunit.client.0.trial069.stdout: "apply_latency_ns": 0 2026-02-18T00:58:32.754 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:58:32.754 INFO:tasks.workunit.client.0.trial069.stdout: "alerts": [], 2026-02-18T00:58:32.754 INFO:tasks.workunit.client.0.trial069.stdout: "network_ping_times": [] 2026-02-18T00:58:32.754 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:58:32.754 INFO:tasks.workunit.client.0.trial069.stdout: "osd_sum_by_class": { 2026-02-18T00:58:32.754 INFO:tasks.workunit.client.0.trial069.stdout: "ssd": { 2026-02-18T00:58:32.754 INFO:tasks.workunit.client.0.trial069.stdout: "up_from": 0, 2026-02-18T00:58:32.754 INFO:tasks.workunit.client.0.trial069.stdout: "seq": 0, 2026-02-18T00:58:32.754 INFO:tasks.workunit.client.0.trial069.stdout: "num_pgs": 0, 2026-02-18T00:58:32.754 INFO:tasks.workunit.client.0.trial069.stdout: "num_osds": 1, 2026-02-18T00:58:32.754 INFO:tasks.workunit.client.0.trial069.stdout: "num_per_pool_osds": 1, 2026-02-18T00:58:32.754 INFO:tasks.workunit.client.0.trial069.stdout: "num_per_pool_omap_osds": 1, 2026-02-18T00:58:32.754 INFO:tasks.workunit.client.0.trial069.stdout: "kb": 104857600, 2026-02-18T00:58:32.755 INFO:tasks.workunit.client.0.trial069.stdout: "kb_used": 27060, 2026-02-18T00:58:32.755 INFO:tasks.workunit.client.0.trial069.stdout: "kb_used_data": 100, 2026-02-18T00:58:32.755 INFO:tasks.workunit.client.0.trial069.stdout: "kb_used_omap": 7, 2026-02-18T00:58:32.755 INFO:tasks.workunit.client.0.trial069.stdout: "kb_used_meta": 26936, 2026-02-18T00:58:32.755 INFO:tasks.workunit.client.0.trial069.stdout: "kb_avail": 104830540, 2026-02-18T00:58:32.755 INFO:tasks.workunit.client.0.trial069.stdout: "statfs": { 2026-02-18T00:58:32.755 INFO:tasks.workunit.client.0.trial069.stdout: "total": 107374182400, 2026-02-18T00:58:32.755 INFO:tasks.workunit.client.0.trial069.stdout: "available": 107346472960, 2026-02-18T00:58:32.755 INFO:tasks.workunit.client.0.trial069.stdout: "internally_reserved": 0, 2026-02-18T00:58:32.755 INFO:tasks.workunit.client.0.trial069.stdout: "allocated": 102400, 2026-02-18T00:58:32.755 INFO:tasks.workunit.client.0.trial069.stdout: "data_stored": 20595, 2026-02-18T00:58:32.756 INFO:tasks.workunit.client.0.trial069.stdout: "data_compressed": 0, 2026-02-18T00:58:32.756 INFO:tasks.workunit.client.0.trial069.stdout: "data_compressed_allocated": 0, 2026-02-18T00:58:32.756 INFO:tasks.workunit.client.0.trial069.stdout: "data_compressed_original": 0, 2026-02-18T00:58:32.756 INFO:tasks.workunit.client.0.trial069.stdout: "omap_allocated": 8135, 2026-02-18T00:58:32.756 INFO:tasks.workunit.client.0.trial069.stdout: "internal_metadata": 27582521 2026-02-18T00:58:32.756 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:58:32.756 INFO:tasks.workunit.client.0.trial069.stdout: "hb_peers": [], 2026-02-18T00:58:32.756 INFO:tasks.workunit.client.0.trial069.stdout: "snap_trim_queue_len": 0, 2026-02-18T00:58:32.756 INFO:tasks.workunit.client.0.trial069.stdout: "num_snap_trimming": 0, 2026-02-18T00:58:32.756 INFO:tasks.workunit.client.0.trial069.stdout: "num_shards_repaired": 0, 2026-02-18T00:58:32.756 INFO:tasks.workunit.client.0.trial069.stdout: "op_queue_age_hist": { 2026-02-18T00:58:32.756 INFO:tasks.workunit.client.0.trial069.stdout: "histogram": [], 2026-02-18T00:58:32.757 INFO:tasks.workunit.client.0.trial069.stdout: "upper_bound": 1 2026-02-18T00:58:32.757 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:58:32.757 INFO:tasks.workunit.client.0.trial069.stdout: "perf_stat": { 2026-02-18T00:58:32.757 INFO:tasks.workunit.client.0.trial069.stdout: "commit_latency_ms": 0, 2026-02-18T00:58:32.757 INFO:tasks.workunit.client.0.trial069.stdout: "apply_latency_ms": 0, 2026-02-18T00:58:32.757 INFO:tasks.workunit.client.0.trial069.stdout: "commit_latency_ns": 0, 2026-02-18T00:58:32.757 INFO:tasks.workunit.client.0.trial069.stdout: "apply_latency_ns": 0 2026-02-18T00:58:32.757 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:58:32.757 INFO:tasks.workunit.client.0.trial069.stdout: "alerts": [], 2026-02-18T00:58:32.757 INFO:tasks.workunit.client.0.trial069.stdout: "network_ping_times": [] 2026-02-18T00:58:32.757 INFO:tasks.workunit.client.0.trial069.stdout: } 2026-02-18T00:58:32.757 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:58:32.757 INFO:tasks.workunit.client.0.trial069.stdout: "pool_stats": [ 2026-02-18T00:58:32.757 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:58:32.758 INFO:tasks.workunit.client.0.trial069.stdout: "poolid": 1, 2026-02-18T00:58:32.758 INFO:tasks.workunit.client.0.trial069.stdout: "num_pg": 4, 2026-02-18T00:58:32.758 INFO:tasks.workunit.client.0.trial069.stdout: "stat_sum": { 2026-02-18T00:58:32.758 INFO:tasks.workunit.client.0.trial069.stdout: "num_bytes": 19, 2026-02-18T00:58:32.758 INFO:tasks.workunit.client.0.trial069.stdout: "num_objects": 2, 2026-02-18T00:58:32.758 INFO:tasks.workunit.client.0.trial069.stdout: "num_object_clones": 0, 2026-02-18T00:58:32.758 INFO:tasks.workunit.client.0.trial069.stdout: "num_object_copies": 4, 2026-02-18T00:58:32.758 INFO:tasks.workunit.client.0.trial069.stdout: "num_objects_missing_on_primary": 0, 2026-02-18T00:58:32.758 INFO:tasks.workunit.client.0.trial069.stdout: "num_objects_missing": 0, 2026-02-18T00:58:32.758 INFO:tasks.workunit.client.0.trial069.stdout: "num_objects_degraded": 2, 2026-02-18T00:58:32.758 INFO:tasks.workunit.client.0.trial069.stdout: "num_objects_misplaced": 0, 2026-02-18T00:58:32.758 INFO:tasks.workunit.client.0.trial069.stdout: "num_objects_unfound": 0, 2026-02-18T00:58:32.758 INFO:tasks.workunit.client.0.trial069.stdout: "num_objects_dirty": 2, 2026-02-18T00:58:32.758 INFO:tasks.workunit.client.0.trial069.stdout: "num_whiteouts": 0, 2026-02-18T00:58:32.758 INFO:tasks.workunit.client.0.trial069.stdout: "num_read": 0, 2026-02-18T00:58:32.758 INFO:tasks.workunit.client.0.trial069.stdout: "num_read_kb": 0, 2026-02-18T00:58:32.758 INFO:tasks.workunit.client.0.trial069.stdout: "num_write": 2, 2026-02-18T00:58:32.758 INFO:tasks.workunit.client.0.trial069.stdout: "num_write_kb": 2, 2026-02-18T00:58:32.758 INFO:tasks.workunit.client.0.trial069.stdout: "num_scrub_errors": 0, 2026-02-18T00:58:32.758 INFO:tasks.workunit.client.0.trial069.stdout: "num_shallow_scrub_errors": 0, 2026-02-18T00:58:32.758 INFO:tasks.workunit.client.0.trial069.stdout: "num_deep_scrub_errors": 0, 2026-02-18T00:58:32.758 INFO:tasks.workunit.client.0.trial069.stdout: "num_objects_recovered": 0, 2026-02-18T00:58:32.758 INFO:tasks.workunit.client.0.trial069.stdout: "num_bytes_recovered": 0, 2026-02-18T00:58:32.758 INFO:tasks.workunit.client.0.trial069.stdout: "num_keys_recovered": 0, 2026-02-18T00:58:32.758 INFO:tasks.workunit.client.0.trial069.stdout: "num_objects_omap": 0, 2026-02-18T00:58:32.758 INFO:tasks.workunit.client.0.trial069.stdout: "num_objects_hit_set_archive": 0, 2026-02-18T00:58:32.759 INFO:tasks.workunit.client.0.trial069.stdout: "num_bytes_hit_set_archive": 0, 2026-02-18T00:58:32.759 INFO:tasks.workunit.client.0.trial069.stdout: "num_flush": 0, 2026-02-18T00:58:32.759 INFO:tasks.workunit.client.0.trial069.stdout: "num_flush_kb": 0, 2026-02-18T00:58:32.759 INFO:tasks.workunit.client.0.trial069.stdout: "num_evict": 0, 2026-02-18T00:58:32.759 INFO:tasks.workunit.client.0.trial069.stdout: "num_evict_kb": 0, 2026-02-18T00:58:32.759 INFO:tasks.workunit.client.0.trial069.stdout: "num_promote": 0, 2026-02-18T00:58:32.759 INFO:tasks.workunit.client.0.trial069.stdout: "num_flush_mode_high": 0, 2026-02-18T00:58:32.759 INFO:tasks.workunit.client.0.trial069.stdout: "num_flush_mode_low": 0, 2026-02-18T00:58:32.759 INFO:tasks.workunit.client.0.trial069.stdout: "num_evict_mode_some": 0, 2026-02-18T00:58:32.759 INFO:tasks.workunit.client.0.trial069.stdout: "num_evict_mode_full": 0, 2026-02-18T00:58:32.759 INFO:tasks.workunit.client.0.trial069.stdout: "num_objects_pinned": 0, 2026-02-18T00:58:32.759 INFO:tasks.workunit.client.0.trial069.stdout: "num_legacy_snapsets": 0, 2026-02-18T00:58:32.759 INFO:tasks.workunit.client.0.trial069.stdout: "num_large_omap_objects": 0, 2026-02-18T00:58:32.759 INFO:tasks.workunit.client.0.trial069.stdout: "num_objects_manifest": 0, 2026-02-18T00:58:32.759 INFO:tasks.workunit.client.0.trial069.stdout: "num_omap_bytes": 0, 2026-02-18T00:58:32.759 INFO:tasks.workunit.client.0.trial069.stdout: "num_omap_keys": 0, 2026-02-18T00:58:32.759 INFO:tasks.workunit.client.0.trial069.stdout: "num_objects_repaired": 0 2026-02-18T00:58:32.759 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:58:32.759 INFO:tasks.workunit.client.0.trial069.stdout: "store_stats": { 2026-02-18T00:58:32.759 INFO:tasks.workunit.client.0.trial069.stdout: "total": 0, 2026-02-18T00:58:32.759 INFO:tasks.workunit.client.0.trial069.stdout: "available": 0, 2026-02-18T00:58:32.759 INFO:tasks.workunit.client.0.trial069.stdout: "internally_reserved": 0, 2026-02-18T00:58:32.759 INFO:tasks.workunit.client.0.trial069.stdout: "allocated": 4096, 2026-02-18T00:58:32.759 INFO:tasks.workunit.client.0.trial069.stdout: "data_stored": 19, 2026-02-18T00:58:32.759 INFO:tasks.workunit.client.0.trial069.stdout: "data_compressed": 0, 2026-02-18T00:58:32.759 INFO:tasks.workunit.client.0.trial069.stdout: "data_compressed_allocated": 0, 2026-02-18T00:58:32.759 INFO:tasks.workunit.client.0.trial069.stdout: "data_compressed_original": 0, 2026-02-18T00:58:32.760 INFO:tasks.workunit.client.0.trial069.stdout: "omap_allocated": 0, 2026-02-18T00:58:32.760 INFO:tasks.workunit.client.0.trial069.stdout: "internal_metadata": 0 2026-02-18T00:58:32.760 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:58:32.760 INFO:tasks.workunit.client.0.trial069.stdout: "log_size": 3, 2026-02-18T00:58:32.760 INFO:tasks.workunit.client.0.trial069.stdout: "ondisk_log_size": 3, 2026-02-18T00:58:32.760 INFO:tasks.workunit.client.0.trial069.stdout: "up": 4, 2026-02-18T00:58:32.760 INFO:tasks.workunit.client.0.trial069.stdout: "acting": 4, 2026-02-18T00:58:32.760 INFO:tasks.workunit.client.0.trial069.stdout: "num_store_stats": 1 2026-02-18T00:58:32.760 INFO:tasks.workunit.client.0.trial069.stdout: } 2026-02-18T00:58:32.760 INFO:tasks.workunit.client.0.trial069.stdout: ], 2026-02-18T00:58:32.760 INFO:tasks.workunit.client.0.trial069.stdout: "osd_stats": [ 2026-02-18T00:58:32.760 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:58:32.760 INFO:tasks.workunit.client.0.trial069.stdout: "osd": 0, 2026-02-18T00:58:32.760 INFO:tasks.workunit.client.0.trial069.stdout: "seq": 21474836481 2026-02-18T00:58:32.760 INFO:tasks.workunit.client.0.trial069.stdout: } 2026-02-18T00:58:32.760 INFO:tasks.workunit.client.0.trial069.stdout: ], 2026-02-18T00:58:32.760 INFO:tasks.workunit.client.0.trial069.stdout: "num_pg_by_state": [ 2026-02-18T00:58:32.760 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:58:32.760 INFO:tasks.workunit.client.0.trial069.stdout: "state": "active+undersized+degraded", 2026-02-18T00:58:32.760 INFO:tasks.workunit.client.0.trial069.stdout: "num": 2 2026-02-18T00:58:32.760 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:58:32.760 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:58:32.760 INFO:tasks.workunit.client.0.trial069.stdout: "state": "active+undersized", 2026-02-18T00:58:32.760 INFO:tasks.workunit.client.0.trial069.stdout: "num": 2 2026-02-18T00:58:32.760 INFO:tasks.workunit.client.0.trial069.stdout: } 2026-02-18T00:58:32.760 INFO:tasks.workunit.client.0.trial069.stdout: ], 2026-02-18T00:58:32.760 INFO:tasks.workunit.client.0.trial069.stdout: "pool_pg_unavailable_map": [ 2026-02-18T00:58:32.760 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:58:32.761 INFO:tasks.workunit.client.0.trial069.stdout: "poolid": "1", 2026-02-18T00:58:32.761 INFO:tasks.workunit.client.0.trial069.stdout: "pgs": [] 2026-02-18T00:58:32.761 INFO:tasks.workunit.client.0.trial069.stdout: } 2026-02-18T00:58:32.761 INFO:tasks.workunit.client.0.trial069.stdout: ], 2026-02-18T00:58:32.761 INFO:tasks.workunit.client.0.trial069.stdout: "num_pg_by_osd": [ 2026-02-18T00:58:32.761 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:58:32.761 INFO:tasks.workunit.client.0.trial069.stdout: "osd": 0, 2026-02-18T00:58:32.761 INFO:tasks.workunit.client.0.trial069.stdout: "num_primary_pg": 4, 2026-02-18T00:58:32.761 INFO:tasks.workunit.client.0.trial069.stdout: "num_acting_pg": 4, 2026-02-18T00:58:32.761 INFO:tasks.workunit.client.0.trial069.stdout: "num_up_not_acting_pg": 0 2026-02-18T00:58:32.761 INFO:tasks.workunit.client.0.trial069.stdout: } 2026-02-18T00:58:32.761 INFO:tasks.workunit.client.0.trial069.stdout: ], 2026-02-18T00:58:32.761 INFO:tasks.workunit.client.0.trial069.stdout: "purged_snaps": [ 2026-02-18T00:58:32.761 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:58:32.761 INFO:tasks.workunit.client.0.trial069.stdout: "pool": 1, 2026-02-18T00:58:32.761 INFO:tasks.workunit.client.0.trial069.stdout: "purged_snaps": {} 2026-02-18T00:58:32.761 INFO:tasks.workunit.client.0.trial069.stdout: } 2026-02-18T00:58:32.761 INFO:tasks.workunit.client.0.trial069.stdout: ], 2026-02-18T00:58:32.761 INFO:tasks.workunit.client.0.trial069.stdout: "servicemap": { 2026-02-18T00:58:32.761 INFO:tasks.workunit.client.0.trial069.stdout: "epoch": 1, 2026-02-18T00:58:32.761 INFO:tasks.workunit.client.0.trial069.stdout: "modified": "2026-02-18T00:58:20.949347+0000", 2026-02-18T00:58:32.761 INFO:tasks.workunit.client.0.trial069.stdout: "services": {} 2026-02-18T00:58:32.761 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:58:32.761 INFO:tasks.workunit.client.0.trial069.stdout: "mgrstat_first_committed": 1, 2026-02-18T00:58:32.761 INFO:tasks.workunit.client.0.trial069.stdout: "mgrstat_last_committed": 4, 2026-02-18T00:58:32.761 INFO:tasks.workunit.client.0.trial069.stdout: "logm_first_committed": 1, 2026-02-18T00:58:32.761 INFO:tasks.workunit.client.0.trial069.stdout: "logm_last_committed": 57, 2026-02-18T00:58:32.761 INFO:tasks.workunit.client.0.trial069.stdout: "paxos": { 2026-02-18T00:58:32.761 INFO:tasks.workunit.client.0.trial069.stdout: "first_committed": 1, 2026-02-18T00:58:32.762 INFO:tasks.workunit.client.0.trial069.stdout: "last_committed": 82, 2026-02-18T00:58:32.762 INFO:tasks.workunit.client.0.trial069.stdout: "last_pn": 0, 2026-02-18T00:58:32.762 INFO:tasks.workunit.client.0.trial069.stdout: "accepted_pn": 0 2026-02-18T00:58:32.762 INFO:tasks.workunit.client.0.trial069.stdout: } 2026-02-18T00:58:32.762 INFO:tasks.workunit.client.0.trial069.stdout:} 2026-02-18T00:58:32.764 INFO:tasks.workunit.client.0.trial069.stderr:report 3234504734 2026-02-18T00:58:32.764 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: return 1 2026-02-18T00:58:32.764 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1690: test_wait_for_clean: run_osd td/ceph-helpers 1 2026-02-18T00:58:32.764 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/ceph-helpers 2026-02-18T00:58:32.764 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T00:58:32.764 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2026-02-18T00:58:32.764 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T00:58:32.764 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/ceph-helpers/1 2026-02-18T00:58:32.764 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--cluster ceph --fsid=863c4e35-ceb0-4172-b7b2-c3ff099e05a2 --auth-supported=none --mon-host=127.0.0.1:7109 ' 2026-02-18T00:58:32.764 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T00:58:32.764 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T00:58:32.764 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T00:58:32.764 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/ceph-helpers/1' 2026-02-18T00:58:32.764 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/ceph-helpers/1/journal' 2026-02-18T00:58:32.764 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T00:58:32.764 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-18T00:58:32.764 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/ceph-helpers' 2026-02-18T00:58:32.764 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T00:58:32.764 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:58:32.764 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:58:32.764 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:58:32.764 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:58:32.764 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:58:32.765 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.57427/$cluster-$name.asok' 2026-02-18T00:58:32.765 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' 2026-02-18T00:58:32.765 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T00:58:32.765 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T00:58:32.765 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T00:58:32.765 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/ceph-helpers/$name.log' 2026-02-18T00:58:32.765 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/ceph-helpers/$name.pid' 2026-02-18T00:58:32.765 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T00:58:32.765 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T00:58:32.765 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T00:58:32.765 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T00:58:32.765 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T00:58:32.765 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-18T00:58:32.765 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/ceph-helpers/1 2026-02-18T00:58:32.765 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T00:58:32.765 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=0299b0f7-f571-477e-bfea-fc65ab5582dd 2026-02-18T00:58:32.765 INFO:tasks.workunit.client.0.trial069.stdout:add osd1 0299b0f7-f571-477e-bfea-fc65ab5582dd 2026-02-18T00:58:32.765 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 0299b0f7-f571-477e-bfea-fc65ab5582dd' 2026-02-18T00:58:32.766 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T00:58:32.766 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQC4DpVpckDEKhAAVxubbfz/rerlAmTt7u1MKw== 2026-02-18T00:58:32.766 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQC4DpVpckDEKhAAVxubbfz/rerlAmTt7u1MKw=="}' 2026-02-18T00:58:32.766 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 0299b0f7-f571-477e-bfea-fc65ab5582dd -i td/ceph-helpers/1/new.json 2026-02-18T00:58:32.947 INFO:tasks.workunit.client.0.trial069.stdout:1 2026-02-18T00:58:32.956 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/ceph-helpers/1/new.json 2026-02-18T00:58:32.957 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --cluster ceph --fsid=863c4e35-ceb0-4172-b7b2-c3ff099e05a2 --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/1 --osd-journal=td/ceph-helpers/1/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQC4DpVpckDEKhAAVxubbfz/rerlAmTt7u1MKw== --osd-uuid 0299b0f7-f571-477e-bfea-fc65ab5582dd 2026-02-18T00:58:32.981 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:58:32.968+0000 7fc68f9dea40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:58:32.983 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:58:32.968+0000 7fc68f9dea40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:58:32.983 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:58:32.968+0000 7fc68f9dea40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:58:32.984 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:58:32.968+0000 7fc68f9dea40 -1 bdev(0x55cacb19cc00 td/ceph-helpers/1/block) open stat got: (1) Operation not permitted 2026-02-18T00:58:32.984 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:58:32.968+0000 7fc68f9dea40 -1 bluestore(td/ceph-helpers/1) _read_fsid unparsable uuid 2026-02-18T00:58:33.628 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/ceph-helpers/1/keyring 2026-02-18T00:58:33.628 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T00:58:33.629 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2026-02-18T00:58:33.629 INFO:tasks.workunit.client.0.trial069.stdout:adding osd1 key to auth repository 2026-02-18T00:58:33.630 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/ceph-helpers/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T00:58:33.916 INFO:tasks.workunit.client.0.trial069.stdout:start osd.1 2026-02-18T00:58:33.917 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2026-02-18T00:58:33.917 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --cluster ceph --fsid=863c4e35-ceb0-4172-b7b2-c3ff099e05a2 --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/1 --osd-journal=td/ceph-helpers/1/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T00:58:33.917 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T00:58:33.917 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T00:58:33.917 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T00:58:33.940 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:58:33.924+0000 7f854dba2a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:58:33.942 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:58:33.928+0000 7f854dba2a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:58:33.943 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:58:33.928+0000 7f854dba2a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:58:34.125 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2026-02-18T00:58:34.125 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:58:34.125 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-18T00:58:34.126 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:58:34.126 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:58:34.126 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:58:34.126 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:58:34.126 INFO:tasks.workunit.client.0.trial069.stdout:0 2026-02-18T00:58:34.127 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:58:34.127 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-18T00:58:34.306 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:58:34.292+0000 7f854dba2a40 -1 Falling back to public interface 2026-02-18T00:58:34.341 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:58:34.882 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:58:34.868+0000 7f854dba2a40 -1 osd.1 0 log_to_monitors true 2026-02-18T00:58:35.343 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:58:35.343 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:58:35.343 INFO:tasks.workunit.client.0.trial069.stdout:1 2026-02-18T00:58:35.344 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T00:58:35.344 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:58:35.344 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-18T00:58:35.575 INFO:tasks.workunit.client.0.trial069.stdout:osd.1 up in weight 1 up_from 16 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/773195669,v1:127.0.0.1:6811/773195669] [v2:127.0.0.1:6812/773195669,v1:127.0.0.1:6813/773195669] exists,up 0299b0f7-f571-477e-bfea-fc65ab5582dd 2026-02-18T00:58:35.576 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:58:35.576 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:58:35.576 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:58:35.576 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1691: test_wait_for_clean: wait_for_clean 2026-02-18T00:58:35.576 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-18T00:58:35.576 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-18T00:58:35.576 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-18T00:58:35.576 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-18T00:58:35.576 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-18T00:58:35.576 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-18T00:58:35.577 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-18T00:58:35.577 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-18T00:58:35.577 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-18T00:58:35.665 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-18T00:58:35.665 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-18T00:58:35.665 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-18T00:58:35.665 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-18T00:58:35.665 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-18T00:58:35.665 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-18T00:58:35.878 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-18T00:58:35.878 INFO:tasks.workunit.client.0.trial069.stderr:1' 2026-02-18T00:58:35.878 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-18T00:58:35.878 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:58:35.878 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-18T00:58:35.960 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836484 2026-02-18T00:58:35.960 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836484 2026-02-18T00:58:35.960 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836484' 2026-02-18T00:58:35.960 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:58:35.960 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-18T00:58:36.037 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=0 2026-02-18T00:58:36.037 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 0 2026-02-18T00:58:36.037 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836484 1-0' 2026-02-18T00:58:36.038 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:58:36.038 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836484 2026-02-18T00:58:36.038 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:58:36.039 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-18T00:58:36.039 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-21474836484 2026-02-18T00:58:36.040 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:58:36.041 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=21474836484 2026-02-18T00:58:36.041 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 21474836484' 2026-02-18T00:58:36.042 INFO:tasks.workunit.client.0.trial069.stdout:waiting osd.0 seq 21474836484 2026-02-18T00:58:36.042 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T00:58:36.250 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 21474836482 -lt 21474836484 2026-02-18T00:58:36.250 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-18T00:58:37.251 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-18T00:58:37.252 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T00:58:37.468 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 21474836484 -lt 21474836484 2026-02-18T00:58:37.469 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:58:37.469 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-0 2026-02-18T00:58:37.469 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:58:37.470 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=1 2026-02-18T00:58:37.471 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 1-0 2026-02-18T00:58:37.471 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:58:37.472 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=0 2026-02-18T00:58:37.473 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.1 seq 0' 2026-02-18T00:58:37.473 INFO:tasks.workunit.client.0.trial069.stdout:waiting osd.1 seq 0 2026-02-18T00:58:37.473 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-18T00:58:37.680 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 68719476737 -lt 0 2026-02-18T00:58:37.681 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-18T00:58:37.681 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T00:58:37.681 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T00:58:37.971 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 4 == 0 2026-02-18T00:58:37.971 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-18T00:58:37.971 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-18T00:58:37.971 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-18T00:58:37.972 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-18T00:58:37.972 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-18T00:58:37.972 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-18T00:58:37.972 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-18T00:58:38.184 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-18T00:58:38.185 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-18T00:58:38.186 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T00:58:38.186 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T00:58:38.467 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 4 2026-02-18T00:58:38.467 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' -1 2026-02-18T00:58:38.468 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1665: wait_for_clean: loop=0 2026-02-18T00:58:38.468 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1666: wait_for_clean: num_active_clean=0 2026-02-18T00:58:38.468 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-18T00:58:38.468 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.1 2026-02-18T00:58:38.568 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-18T00:58:38.568 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-18T00:58:38.569 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-18T00:58:38.569 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-18T00:58:38.569 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-18T00:58:38.569 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-18T00:58:38.570 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-18T00:58:38.570 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-18T00:58:38.779 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-18T00:58:38.780 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-18T00:58:38.780 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T00:58:38.781 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T00:58:39.067 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 4 2026-02-18T00:58:39.067 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-18T00:58:39.067 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-18T00:58:39.068 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-18T00:58:39.068 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-18T00:58:39.068 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-18T00:58:39.068 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-18T00:58:39.068 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-18T00:58:39.068 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-18T00:58:39.356 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-18T00:58:39.356 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-18T00:58:39.356 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 1 >= 13 )) 2026-02-18T00:58:39.357 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-18T00:58:39.357 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.2 2026-02-18T00:58:39.558 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-18T00:58:39.558 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-18T00:58:39.559 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-18T00:58:39.559 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-18T00:58:39.559 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-18T00:58:39.559 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-18T00:58:39.559 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-18T00:58:39.559 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-18T00:58:39.764 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-18T00:58:39.765 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-18T00:58:39.765 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T00:58:39.766 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T00:58:40.043 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 4 2026-02-18T00:58:40.043 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-18T00:58:40.043 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-18T00:58:40.043 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-18T00:58:40.043 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-18T00:58:40.043 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-18T00:58:40.044 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-18T00:58:40.044 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-18T00:58:40.044 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-18T00:58:40.311 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-18T00:58:40.311 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-18T00:58:40.311 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 2 >= 13 )) 2026-02-18T00:58:40.311 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-18T00:58:40.311 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.4 2026-02-18T00:58:40.712 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-18T00:58:40.712 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-18T00:58:40.712 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-18T00:58:40.713 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-18T00:58:40.713 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-18T00:58:40.713 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-18T00:58:40.714 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-18T00:58:40.714 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-18T00:58:40.921 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-18T00:58:40.921 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-18T00:58:40.922 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T00:58:40.922 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T00:58:41.196 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 4 2026-02-18T00:58:41.196 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-18T00:58:41.196 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-18T00:58:41.197 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-18T00:58:41.197 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-18T00:58:41.197 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-18T00:58:41.197 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-18T00:58:41.197 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-18T00:58:41.197 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-18T00:58:41.480 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-18T00:58:41.480 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-18T00:58:41.480 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 3 >= 13 )) 2026-02-18T00:58:41.480 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-18T00:58:41.480 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.8 2026-02-18T00:58:42.281 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-18T00:58:42.281 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-18T00:58:42.282 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-18T00:58:42.282 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-18T00:58:42.282 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-18T00:58:42.283 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-18T00:58:42.283 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-18T00:58:42.283 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-18T00:58:42.497 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-18T00:58:42.498 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-18T00:58:42.498 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T00:58:42.499 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T00:58:42.792 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 4 2026-02-18T00:58:42.792 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-18T00:58:42.792 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-18T00:58:42.793 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-18T00:58:42.793 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-18T00:58:42.793 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-18T00:58:42.793 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-18T00:58:42.793 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-18T00:58:42.793 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-18T00:58:43.074 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=2 2026-02-18T00:58:43.074 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 2 '!=' null 2026-02-18T00:58:43.074 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1668: wait_for_clean: loop=0 2026-02-18T00:58:43.074 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-18T00:58:43.074 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.1 2026-02-18T00:58:43.174 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-18T00:58:43.175 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-18T00:58:43.175 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-18T00:58:43.175 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-18T00:58:43.176 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-18T00:58:43.176 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-18T00:58:43.176 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-18T00:58:43.176 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-18T00:58:43.383 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=4 2026-02-18T00:58:43.383 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-18T00:58:43.383 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T00:58:43.383 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T00:58:43.663 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 4 = 4 2026-02-18T00:58:43.663 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-18T00:58:43.663 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-18T00:58:43.663 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1692: test_wait_for_clean: teardown td/ceph-helpers 2026-02-18T00:58:43.663 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/ceph-helpers 2026-02-18T00:58:43.663 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T00:58:43.663 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/ceph-helpers KILL 2026-02-18T00:58:43.664 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:58:43.664 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:58:43.664 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:58:43.664 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:58:43.664 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:58:43.771 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:58:43.771 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T00:58:43.772 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T00:58:43.772 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T00:58:43.773 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T00:58:43.773 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T00:58:43.774 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T00:58:43.775 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:58:43.775 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T00:58:43.775 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T00:58:43.775 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:58:43.776 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T00:58:43.777 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T00:58:43.777 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/ceph-helpers 2026-02-18T00:58:43.784 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T00:58:43.784 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:58:43.784 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:58:43.784 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.57427 2026-02-18T00:58:43.786 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T00:58:43.786 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T00:58:43.786 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2426: run_tests: for func in $funcs 2026-02-18T00:58:43.786 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2427: run_tests: test_wait_for_health_ok td/ceph-helpers 2026-02-18T00:58:43.786 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1854: test_wait_for_health_ok: local dir=td/ceph-helpers 2026-02-18T00:58:43.786 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1856: test_wait_for_health_ok: setup td/ceph-helpers 2026-02-18T00:58:43.786 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/ceph-helpers 2026-02-18T00:58:43.786 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/ceph-helpers 2026-02-18T00:58:43.786 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/ceph-helpers 2026-02-18T00:58:43.786 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T00:58:43.786 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/ceph-helpers KILL 2026-02-18T00:58:43.786 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:58:43.786 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:58:43.787 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:58:43.787 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:58:43.787 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:58:43.789 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:58:43.789 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T00:58:43.790 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T00:58:43.790 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T00:58:43.791 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T00:58:43.791 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T00:58:43.792 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T00:58:43.793 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:58:43.793 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T00:58:43.793 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T00:58:43.794 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:58:43.794 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T00:58:43.795 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T00:58:43.796 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/ceph-helpers 2026-02-18T00:58:43.797 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T00:58:43.797 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:58:43.797 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:58:43.797 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.57427 2026-02-18T00:58:43.798 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T00:58:43.798 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T00:58:43.798 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/ceph-helpers 2026-02-18T00:58:43.800 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-18T00:58:43.800 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:58:43.800 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:58:43.800 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.57427 2026-02-18T00:58:43.801 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-18T00:58:43.803 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-18T00:58:43.803 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-18T00:58:43.803 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/ceph-helpers 1' TERM HUP INT 2026-02-18T00:58:43.803 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1857: test_wait_for_health_ok: run_mon td/ceph-helpers a --osd_failsafe_full_ratio=.99 --mon_pg_warn_min_per_osd=0 2026-02-18T00:58:43.803 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/ceph-helpers 2026-02-18T00:58:43.803 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-18T00:58:43.803 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-18T00:58:43.803 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-18T00:58:43.804 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/ceph-helpers/a 2026-02-18T00:58:43.804 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/ceph-helpers/a --run-dir=td/ceph-helpers --osd_failsafe_full_ratio=.99 --mon_pg_warn_min_per_osd=0 2026-02-18T00:58:43.824 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-18T00:58:43.824 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:58:43.825 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:58:43.825 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:58:43.825 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:58:43.825 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:58:43.825 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.57427/$cluster-$name.asok' 2026-02-18T00:58:43.825 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/ceph-helpers/a '--log-file=td/ceph-helpers/$name.log' '--admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' --mon-cluster-log-file=td/ceph-helpers/log --run-dir=td/ceph-helpers '--pid-file=td/ceph-helpers/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --osd_failsafe_full_ratio=.99 --mon_pg_warn_min_per_osd=0 2026-02-18T00:58:43.853 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-18T00:58:43.854 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-18T00:58:43.854 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T00:58:43.854 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-18T00:58:43.854 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-18T00:58:43.855 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-18T00:58:43.856 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-18T00:58:43.856 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:58:43.856 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:58:43.856 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:58:43.856 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:58:43.856 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:58:43.856 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.57427/ceph-mon.a.asok 2026-02-18T00:58:43.856 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T00:58:43.856 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.57427/ceph-mon.a.asok config get fsid 2026-02-18T00:58:43.911 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-18T00:58:43.911 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T00:58:43.911 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-18T00:58:43.911 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-18T00:58:43.911 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-18T00:58:43.913 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-18T00:58:43.913 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:58:43.913 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:58:43.913 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:58:43.913 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:58:43.913 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:58:43.913 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.57427/ceph-mon.a.asok 2026-02-18T00:58:43.913 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T00:58:43.913 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.57427/ceph-mon.a.asok config get mon_host 2026-02-18T00:58:43.967 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1858: test_wait_for_health_ok: run_mgr td/ceph-helpers x --mon_pg_warn_min_per_osd=0 2026-02-18T00:58:43.967 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/ceph-helpers 2026-02-18T00:58:43.967 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-18T00:58:43.967 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-18T00:58:43.967 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-18T00:58:43.967 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/ceph-helpers/x 2026-02-18T00:58:43.968 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-18T00:58:44.077 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-18T00:58:44.077 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:58:44.077 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:58:44.077 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:58:44.077 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:58:44.078 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:58:44.078 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.57427/$cluster-$name.asok' 2026-02-18T00:58:44.078 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-18T00:58:44.079 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/ceph-helpers/x '--log-file=td/ceph-helpers/$name.log' '--admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' --run-dir=td/ceph-helpers '--pid-file=td/ceph-helpers/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr --mon_pg_warn_min_per_osd=0 2026-02-18T00:58:44.097 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1860: test_wait_for_health_ok: run_osd td/ceph-helpers 0 2026-02-18T00:58:44.097 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/ceph-helpers 2026-02-18T00:58:44.097 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T00:58:44.097 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-18T00:58:44.097 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T00:58:44.097 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/ceph-helpers/0 2026-02-18T00:58:44.097 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--cluster ceph --fsid=863c4e35-ceb0-4172-b7b2-c3ff099e05a2 --auth-supported=none --mon-host=127.0.0.1:7109 ' 2026-02-18T00:58:44.097 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T00:58:44.097 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T00:58:44.097 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T00:58:44.097 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/ceph-helpers/0' 2026-02-18T00:58:44.097 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/ceph-helpers/0/journal' 2026-02-18T00:58:44.097 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T00:58:44.098 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-18T00:58:44.098 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/ceph-helpers' 2026-02-18T00:58:44.098 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T00:58:44.098 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:58:44.098 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:58:44.098 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:58:44.098 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:58:44.098 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:58:44.098 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.57427/$cluster-$name.asok' 2026-02-18T00:58:44.098 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' 2026-02-18T00:58:44.098 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T00:58:44.098 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T00:58:44.099 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T00:58:44.099 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/ceph-helpers/$name.log' 2026-02-18T00:58:44.099 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/ceph-helpers/$name.pid' 2026-02-18T00:58:44.099 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T00:58:44.099 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T00:58:44.099 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T00:58:44.099 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T00:58:44.099 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T00:58:44.099 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-18T00:58:44.099 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/ceph-helpers/0 2026-02-18T00:58:44.099 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T00:58:44.100 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=a490915e-2597-4a68-b07e-8b65521f33c1 2026-02-18T00:58:44.100 INFO:tasks.workunit.client.0.trial069.stdout:add osd0 a490915e-2597-4a68-b07e-8b65521f33c1 2026-02-18T00:58:44.100 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 a490915e-2597-4a68-b07e-8b65521f33c1' 2026-02-18T00:58:44.101 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T00:58:44.113 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDEDpVpDusvBhAAcoZnRAF2t75TdK4r3nFc3A== 2026-02-18T00:58:44.113 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDEDpVpDusvBhAAcoZnRAF2t75TdK4r3nFc3A=="}' 2026-02-18T00:58:44.113 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new a490915e-2597-4a68-b07e-8b65521f33c1 -i td/ceph-helpers/0/new.json 2026-02-18T00:58:44.228 INFO:tasks.workunit.client.0.trial069.stdout:0 2026-02-18T00:58:44.236 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/ceph-helpers/0/new.json 2026-02-18T00:58:44.237 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --cluster ceph --fsid=863c4e35-ceb0-4172-b7b2-c3ff099e05a2 --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/0 --osd-journal=td/ceph-helpers/0/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDEDpVpDusvBhAAcoZnRAF2t75TdK4r3nFc3A== --osd-uuid a490915e-2597-4a68-b07e-8b65521f33c1 2026-02-18T00:58:44.253 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:58:44.240+0000 7fd2220b3a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:58:44.255 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:58:44.240+0000 7fd2220b3a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:58:44.256 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:58:44.240+0000 7fd2220b3a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:58:44.256 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:58:44.244+0000 7fd2220b3a40 -1 bdev(0x55687bedec00 td/ceph-helpers/0/block) open stat got: (1) Operation not permitted 2026-02-18T00:58:44.256 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:58:44.244+0000 7fd2220b3a40 -1 bluestore(td/ceph-helpers/0) _read_fsid unparsable uuid 2026-02-18T00:58:45.024 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/ceph-helpers/0/keyring 2026-02-18T00:58:45.025 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T00:58:45.025 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-18T00:58:45.026 INFO:tasks.workunit.client.0.trial069.stdout:adding osd0 key to auth repository 2026-02-18T00:58:45.026 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/ceph-helpers/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T00:58:45.147 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-18T00:58:45.148 INFO:tasks.workunit.client.0.trial069.stdout:start osd.0 2026-02-18T00:58:45.148 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --cluster ceph --fsid=863c4e35-ceb0-4172-b7b2-c3ff099e05a2 --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/0 --osd-journal=td/ceph-helpers/0/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T00:58:45.149 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T00:58:45.149 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T00:58:45.149 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T00:58:45.172 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:58:45.156+0000 7f278a51ba40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:58:45.174 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:58:45.160+0000 7f278a51ba40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:58:45.175 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:58:45.160+0000 7f278a51ba40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:58:45.258 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-18T00:58:45.258 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:58:45.258 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-18T00:58:45.258 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:58:45.258 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:58:45.258 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:58:45.259 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:58:45.259 INFO:tasks.workunit.client.0.trial069.stdout:0 2026-02-18T00:58:45.259 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:58:45.260 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T00:58:45.364 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:58:45.578 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:58:45.564+0000 7f278a51ba40 -1 Falling back to public interface 2026-02-18T00:58:46.212 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:58:46.196+0000 7f278a51ba40 -1 osd.0 0 log_to_monitors true 2026-02-18T00:58:46.366 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:58:46.366 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:58:46.367 INFO:tasks.workunit.client.0.trial069.stdout:1 2026-02-18T00:58:46.367 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T00:58:46.367 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:58:46.367 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T00:58:46.479 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:58:47.480 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:58:47.481 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:58:47.481 INFO:tasks.workunit.client.0.trial069.stdout:2 2026-02-18T00:58:47.482 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-18T00:58:47.482 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:58:47.482 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T00:58:47.686 INFO:tasks.workunit.client.0.trial069.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/3019957475,v1:127.0.0.1:6801/3019957475] [v2:127.0.0.1:6802/3019957475,v1:127.0.0.1:6803/3019957475] exists,up a490915e-2597-4a68-b07e-8b65521f33c1 2026-02-18T00:58:47.690 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:58:47.690 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:58:47.690 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:58:47.690 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1861: test_wait_for_health_ok: run_osd td/ceph-helpers 1 2026-02-18T00:58:47.690 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/ceph-helpers 2026-02-18T00:58:47.691 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T00:58:47.691 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2026-02-18T00:58:47.691 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T00:58:47.691 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/ceph-helpers/1 2026-02-18T00:58:47.691 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--cluster ceph --fsid=863c4e35-ceb0-4172-b7b2-c3ff099e05a2 --auth-supported=none --mon-host=127.0.0.1:7109 ' 2026-02-18T00:58:47.691 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T00:58:47.691 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T00:58:47.691 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T00:58:47.691 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/ceph-helpers/1' 2026-02-18T00:58:47.691 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/ceph-helpers/1/journal' 2026-02-18T00:58:47.691 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T00:58:47.692 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-18T00:58:47.692 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/ceph-helpers' 2026-02-18T00:58:47.692 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T00:58:47.692 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:58:47.692 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:58:47.692 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:58:47.692 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:58:47.692 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:58:47.692 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.57427/$cluster-$name.asok' 2026-02-18T00:58:47.692 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' 2026-02-18T00:58:47.692 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T00:58:47.692 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T00:58:47.692 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T00:58:47.693 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/ceph-helpers/$name.log' 2026-02-18T00:58:47.693 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/ceph-helpers/$name.pid' 2026-02-18T00:58:47.693 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T00:58:47.693 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T00:58:47.693 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T00:58:47.693 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T00:58:47.693 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T00:58:47.693 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-18T00:58:47.693 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/ceph-helpers/1 2026-02-18T00:58:47.693 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T00:58:47.694 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=563ee9ae-efa1-45e7-bbc8-d74f87f8e50b 2026-02-18T00:58:47.694 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 563ee9ae-efa1-45e7-bbc8-d74f87f8e50b' 2026-02-18T00:58:47.694 INFO:tasks.workunit.client.0.trial069.stdout:add osd1 563ee9ae-efa1-45e7-bbc8-d74f87f8e50b 2026-02-18T00:58:47.695 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T00:58:47.703 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDHDpVpPP9TKRAAadciPugu+HUfkcBUO/Asxg== 2026-02-18T00:58:47.703 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDHDpVpPP9TKRAAadciPugu+HUfkcBUO/Asxg=="}' 2026-02-18T00:58:47.703 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 563ee9ae-efa1-45e7-bbc8-d74f87f8e50b -i td/ceph-helpers/1/new.json 2026-02-18T00:58:47.921 INFO:tasks.workunit.client.0.trial069.stdout:1 2026-02-18T00:58:47.930 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/ceph-helpers/1/new.json 2026-02-18T00:58:47.931 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --cluster ceph --fsid=863c4e35-ceb0-4172-b7b2-c3ff099e05a2 --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/1 --osd-journal=td/ceph-helpers/1/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDHDpVpPP9TKRAAadciPugu+HUfkcBUO/Asxg== --osd-uuid 563ee9ae-efa1-45e7-bbc8-d74f87f8e50b 2026-02-18T00:58:47.947 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:58:47.932+0000 7f474adcda40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:58:47.948 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:58:47.932+0000 7f474adcda40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:58:47.949 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:58:47.936+0000 7f474adcda40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:58:47.950 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:58:47.936+0000 7f474adcda40 -1 bdev(0x55a9cd12cc00 td/ceph-helpers/1/block) open stat got: (1) Operation not permitted 2026-02-18T00:58:47.950 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:58:47.936+0000 7f474adcda40 -1 bluestore(td/ceph-helpers/1) _read_fsid unparsable uuid 2026-02-18T00:58:48.615 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/ceph-helpers/1/keyring 2026-02-18T00:58:48.616 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T00:58:48.616 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2026-02-18T00:58:48.617 INFO:tasks.workunit.client.0.trial069.stdout:adding osd1 key to auth repository 2026-02-18T00:58:48.617 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/ceph-helpers/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T00:58:48.899 INFO:tasks.workunit.client.0.trial069.stdout:start osd.1 2026-02-18T00:58:48.900 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2026-02-18T00:58:48.900 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --cluster ceph --fsid=863c4e35-ceb0-4172-b7b2-c3ff099e05a2 --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/1 --osd-journal=td/ceph-helpers/1/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T00:58:48.900 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T00:58:48.900 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T00:58:48.900 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T00:58:48.922 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:58:48.908+0000 7f4ef38bea40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:58:48.924 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:58:48.908+0000 7f4ef38bea40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:58:48.925 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:58:48.912+0000 7f4ef38bea40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:58:49.112 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2026-02-18T00:58:49.112 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:58:49.112 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-18T00:58:49.113 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:58:49.113 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:58:49.113 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:58:49.113 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:58:49.113 INFO:tasks.workunit.client.0.trial069.stdout:0 2026-02-18T00:58:49.114 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:58:49.114 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-18T00:58:49.286 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:58:49.272+0000 7f4ef38bea40 -1 Falling back to public interface 2026-02-18T00:58:49.320 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:58:49.898 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:58:49.884+0000 7f4ef38bea40 -1 osd.1 0 log_to_monitors true 2026-02-18T00:58:50.322 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:58:50.322 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:58:50.322 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T00:58:50.323 INFO:tasks.workunit.client.0.trial069.stdout:1 2026-02-18T00:58:50.323 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:58:50.323 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-18T00:58:50.534 INFO:tasks.workunit.client.0.trial069.stdout:osd.1 up in weight 1 up_from 10 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/3923607903,v1:127.0.0.1:6811/3923607903] [v2:127.0.0.1:6812/3923607903,v1:127.0.0.1:6813/3923607903] exists,up 563ee9ae-efa1-45e7-bbc8-d74f87f8e50b 2026-02-18T00:58:50.537 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:58:50.537 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:58:50.537 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:58:50.537 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1862: test_wait_for_health_ok: run_osd td/ceph-helpers 2 2026-02-18T00:58:50.538 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/ceph-helpers 2026-02-18T00:58:50.538 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T00:58:50.538 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2026-02-18T00:58:50.538 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T00:58:50.538 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/ceph-helpers/2 2026-02-18T00:58:50.538 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--cluster ceph --fsid=863c4e35-ceb0-4172-b7b2-c3ff099e05a2 --auth-supported=none --mon-host=127.0.0.1:7109 ' 2026-02-18T00:58:50.538 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T00:58:50.538 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T00:58:50.538 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T00:58:50.538 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/ceph-helpers/2' 2026-02-18T00:58:50.538 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/ceph-helpers/2/journal' 2026-02-18T00:58:50.539 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T00:58:50.539 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-18T00:58:50.539 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/ceph-helpers' 2026-02-18T00:58:50.539 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T00:58:50.539 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:58:50.539 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:58:50.539 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:58:50.539 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:58:50.539 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:58:50.539 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.57427/$cluster-$name.asok' 2026-02-18T00:58:50.539 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' 2026-02-18T00:58:50.539 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T00:58:50.540 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T00:58:50.540 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T00:58:50.540 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/ceph-helpers/$name.log' 2026-02-18T00:58:50.540 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/ceph-helpers/$name.pid' 2026-02-18T00:58:50.540 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T00:58:50.540 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T00:58:50.540 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T00:58:50.540 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T00:58:50.540 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T00:58:50.540 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-18T00:58:50.540 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/ceph-helpers/2 2026-02-18T00:58:50.540 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T00:58:50.541 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=9d1c2752-f990-4123-9270-2e145ee6189b 2026-02-18T00:58:50.541 INFO:tasks.workunit.client.0.trial069.stdout:add osd2 9d1c2752-f990-4123-9270-2e145ee6189b 2026-02-18T00:58:50.542 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 9d1c2752-f990-4123-9270-2e145ee6189b' 2026-02-18T00:58:50.542 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T00:58:50.551 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDKDpVpUipGIBAANbuvk7kV7gC14B6KI0Y9wQ== 2026-02-18T00:58:50.551 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDKDpVpUipGIBAANbuvk7kV7gC14B6KI0Y9wQ=="}' 2026-02-18T00:58:50.551 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 9d1c2752-f990-4123-9270-2e145ee6189b -i td/ceph-helpers/2/new.json 2026-02-18T00:58:50.771 INFO:tasks.workunit.client.0.trial069.stdout:2 2026-02-18T00:58:50.780 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/ceph-helpers/2/new.json 2026-02-18T00:58:50.781 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --cluster ceph --fsid=863c4e35-ceb0-4172-b7b2-c3ff099e05a2 --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/2 --osd-journal=td/ceph-helpers/2/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDKDpVpUipGIBAANbuvk7kV7gC14B6KI0Y9wQ== --osd-uuid 9d1c2752-f990-4123-9270-2e145ee6189b 2026-02-18T00:58:50.798 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:58:50.784+0000 7fabfa98ea40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:58:50.799 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:58:50.784+0000 7fabfa98ea40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:58:50.800 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:58:50.784+0000 7fabfa98ea40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:58:50.800 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:58:50.784+0000 7fabfa98ea40 -1 bdev(0x560f4fda6c00 td/ceph-helpers/2/block) open stat got: (1) Operation not permitted 2026-02-18T00:58:50.801 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:58:50.784+0000 7fabfa98ea40 -1 bluestore(td/ceph-helpers/2) _read_fsid unparsable uuid 2026-02-18T00:58:51.467 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/ceph-helpers/2/keyring 2026-02-18T00:58:51.468 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T00:58:51.468 INFO:tasks.workunit.client.0.trial069.stdout:adding osd2 key to auth repository 2026-02-18T00:58:51.469 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2026-02-18T00:58:51.469 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/ceph-helpers/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T00:58:51.764 INFO:tasks.workunit.client.0.trial069.stdout:start osd.2 2026-02-18T00:58:51.765 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2026-02-18T00:58:51.766 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --cluster ceph --fsid=863c4e35-ceb0-4172-b7b2-c3ff099e05a2 --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/2 --osd-journal=td/ceph-helpers/2/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T00:58:51.766 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T00:58:51.766 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T00:58:51.766 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T00:58:51.788 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:58:51.776+0000 7f6ec2975a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:58:51.790 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:58:51.776+0000 7f6ec2975a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:58:51.791 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:58:51.776+0000 7f6ec2975a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:58:51.981 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2026-02-18T00:58:51.982 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:58:51.982 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-18T00:58:51.982 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:58:51.982 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:58:51.982 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:58:51.982 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:58:51.982 INFO:tasks.workunit.client.0.trial069.stdout:0 2026-02-18T00:58:51.983 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:58:51.983 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-18T00:58:52.114 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:58:52.100+0000 7f6ec2975a40 -1 Falling back to public interface 2026-02-18T00:58:52.191 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:58:52.731 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:58:52.716+0000 7f6ec2975a40 -1 osd.2 0 log_to_monitors true 2026-02-18T00:58:53.192 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:58:53.193 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:58:53.193 INFO:tasks.workunit.client.0.trial069.stdout:1 2026-02-18T00:58:53.194 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T00:58:53.194 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:58:53.194 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-18T00:58:53.406 INFO:tasks.workunit.client.0.trial069.stdout:osd.2 up in weight 1 up_from 14 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/2365295306,v1:127.0.0.1:6819/2365295306] [v2:127.0.0.1:6820/2365295306,v1:127.0.0.1:6821/2365295306] exists,up 9d1c2752-f990-4123-9270-2e145ee6189b 2026-02-18T00:58:53.407 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:58:53.407 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:58:53.407 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:58:53.407 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1863: test_wait_for_health_ok: kill_daemons td/ceph-helpers TERM osd 2026-02-18T00:58:53.407 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:58:53.407 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:58:53.408 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:58:53.408 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:58:53.408 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:58:53.715 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:58:53.716 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1864: test_wait_for_health_ok: ceph osd down 0 2026-02-18T00:58:53.924 INFO:tasks.workunit.client.0.trial069.stderr:osd.0 is already down. 2026-02-18T00:58:53.934 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1866: test_wait_for_health_ok: TIMEOUT=1 2026-02-18T00:58:53.934 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1866: test_wait_for_health_ok: wait_for_health_ok 2026-02-18T00:58:53.934 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1850: wait_for_health_ok: wait_for_health HEALTH_OK 2026-02-18T00:58:53.934 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1829: wait_for_health: local grepstr=HEALTH_OK 2026-02-18T00:58:53.934 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1830: wait_for_health: get_timeout_delays 1 .1 2026-02-18T00:58:53.935 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-18T00:58:53.935 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-18T00:58:53.936 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-18T00:58:53.936 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-18T00:58:53.936 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-18T00:58:53.967 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1830: wait_for_health: delays=('0.1' '0.2' '0.4' '0.3') 2026-02-18T00:58:53.967 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1830: wait_for_health: local -a delays 2026-02-18T00:58:53.967 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1831: wait_for_health: local -i loop=0 2026-02-18T00:58:53.967 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1833: wait_for_health: ceph health detail 2026-02-18T00:58:53.967 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1833: wait_for_health: grep HEALTH_OK 2026-02-18T00:58:54.247 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1834: wait_for_health: (( 0 >= 4 )) 2026-02-18T00:58:54.248 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1838: wait_for_health: sleep 0.1 2026-02-18T00:58:54.348 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1839: wait_for_health: loop+=1 2026-02-18T00:58:54.349 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1833: wait_for_health: ceph health detail 2026-02-18T00:58:54.349 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1833: wait_for_health: grep HEALTH_OK 2026-02-18T00:58:54.622 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1834: wait_for_health: (( 1 >= 4 )) 2026-02-18T00:58:54.622 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1838: wait_for_health: sleep 0.2 2026-02-18T00:58:54.823 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1839: wait_for_health: loop+=1 2026-02-18T00:58:54.824 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1833: wait_for_health: ceph health detail 2026-02-18T00:58:54.824 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1833: wait_for_health: grep HEALTH_OK 2026-02-18T00:58:55.114 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1834: wait_for_health: (( 2 >= 4 )) 2026-02-18T00:58:55.115 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1838: wait_for_health: sleep 0.4 2026-02-18T00:58:55.516 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1839: wait_for_health: loop+=1 2026-02-18T00:58:55.516 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1833: wait_for_health: ceph health detail 2026-02-18T00:58:55.516 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1833: wait_for_health: grep HEALTH_OK 2026-02-18T00:58:55.806 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1834: wait_for_health: (( 3 >= 4 )) 2026-02-18T00:58:55.806 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1838: wait_for_health: sleep 0.3 2026-02-18T00:58:56.107 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1839: wait_for_health: loop+=1 2026-02-18T00:58:56.108 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1833: wait_for_health: ceph health detail 2026-02-18T00:58:56.108 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1833: wait_for_health: grep HEALTH_OK 2026-02-18T00:58:56.381 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1834: wait_for_health: (( 4 >= 4 )) 2026-02-18T00:58:56.381 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1835: wait_for_health: ceph health detail 2026-02-18T00:58:56.650 INFO:tasks.workunit.client.0.trial069.stdout:HEALTH_WARN 3 osds down; 1 host (3 osds) down; 1 root (3 osds) down 2026-02-18T00:58:56.650 INFO:tasks.workunit.client.0.trial069.stdout:[WRN] OSD_DOWN: 3 osds down 2026-02-18T00:58:56.651 INFO:tasks.workunit.client.0.trial069.stdout: osd.0 (root=default,host=trial069) is down 2026-02-18T00:58:56.651 INFO:tasks.workunit.client.0.trial069.stdout: osd.1 (root=default,host=trial069) is down 2026-02-18T00:58:56.651 INFO:tasks.workunit.client.0.trial069.stdout: osd.2 (root=default,host=trial069) is down 2026-02-18T00:58:56.651 INFO:tasks.workunit.client.0.trial069.stdout:[WRN] OSD_HOST_DOWN: 1 host (3 osds) down 2026-02-18T00:58:56.651 INFO:tasks.workunit.client.0.trial069.stdout: host trial069 (root=default) (3 osds) is down 2026-02-18T00:58:56.651 INFO:tasks.workunit.client.0.trial069.stdout:[WRN] OSD_ROOT_DOWN: 1 root (3 osds) down 2026-02-18T00:58:56.651 INFO:tasks.workunit.client.0.trial069.stdout: root default (3 osds) is down 2026-02-18T00:58:56.662 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1836: wait_for_health: return 1 2026-02-18T00:58:56.662 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1850: wait_for_health_ok: return 1 2026-02-18T00:58:56.662 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1868: test_wait_for_health_ok: activate_osd td/ceph-helpers 0 2026-02-18T00:58:56.662 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/ceph-helpers 2026-02-18T00:58:56.663 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-18T00:58:56.663 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-18T00:58:56.663 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-18T00:58:56.663 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/ceph-helpers/0 2026-02-18T00:58:56.663 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--cluster ceph --fsid=863c4e35-ceb0-4172-b7b2-c3ff099e05a2 --auth-supported=none --mon-host=127.0.0.1:7109 ' 2026-02-18T00:58:56.663 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T00:58:56.663 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T00:58:56.663 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T00:58:56.663 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/ceph-helpers/0' 2026-02-18T00:58:56.663 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/ceph-helpers/0/journal' 2026-02-18T00:58:56.663 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-18T00:58:56.664 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-18T00:58:56.664 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/ceph-helpers' 2026-02-18T00:58:56.664 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-18T00:58:56.664 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:58:56.664 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:58:56.664 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:58:56.664 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:58:56.664 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:58:56.664 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.57427/$cluster-$name.asok' 2026-02-18T00:58:56.664 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' 2026-02-18T00:58:56.664 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-18T00:58:56.664 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/ceph-helpers/$name.log' 2026-02-18T00:58:56.665 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/ceph-helpers/$name.pid' 2026-02-18T00:58:56.665 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T00:58:56.665 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T00:58:56.665 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T00:58:56.665 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T00:58:56.665 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-18T00:58:56.665 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-18T00:58:56.665 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/ceph-helpers/0 2026-02-18T00:58:56.666 INFO:tasks.workunit.client.0.trial069.stdout:start osd.0 2026-02-18T00:58:56.666 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-18T00:58:56.667 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --cluster ceph --fsid=863c4e35-ceb0-4172-b7b2-c3ff099e05a2 --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/0 --osd-journal=td/ceph-helpers/0/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' --debug-osd=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T00:58:56.667 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/ceph-helpers/0/whoami 2026-02-18T00:58:56.667 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-18T00:58:56.667 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-18T00:58:56.667 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-18T00:58:56.667 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-18T00:58:56.686 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:58:56.672+0000 7f698f453a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:58:56.688 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:58:56.672+0000 7f698f453a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:58:56.689 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:58:56.676+0000 7f698f453a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:58:56.879 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-18T00:58:56.880 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:58:56.880 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-18T00:58:56.880 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:58:56.880 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:58:56.880 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:58:56.880 INFO:tasks.workunit.client.0.trial069.stdout:0 2026-02-18T00:58:56.881 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:58:56.881 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:58:56.881 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T00:58:57.088 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:58:57.158 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:58:57.144+0000 7f698f453a40 -1 Falling back to public interface 2026-02-18T00:58:57.785 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:58:57.768+0000 7f698f453a40 -1 osd.0 14 log_to_monitors true 2026-02-18T00:58:58.089 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:58:58.090 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:58:58.090 INFO:tasks.workunit.client.0.trial069.stdout:1 2026-02-18T00:58:58.091 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T00:58:58.091 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:58:58.091 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T00:58:58.301 INFO:tasks.workunit.client.0.trial069.stdout:osd.0 up in weight 1 up_from 17 up_thru 0 down_at 15 last_clean_interval [5,14) [v2:127.0.0.1:6800/1186042511,v1:127.0.0.1:6801/1186042511] [v2:127.0.0.1:6802/1186042511,v1:127.0.0.1:6803/1186042511] exists,up a490915e-2597-4a68-b07e-8b65521f33c1 2026-02-18T00:58:58.304 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:58:58.304 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:58:58.304 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:58:58.304 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1869: test_wait_for_health_ok: activate_osd td/ceph-helpers 1 2026-02-18T00:58:58.304 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/ceph-helpers 2026-02-18T00:58:58.304 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-18T00:58:58.305 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-18T00:58:58.305 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-18T00:58:58.305 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/ceph-helpers/1 2026-02-18T00:58:58.305 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--cluster ceph --fsid=863c4e35-ceb0-4172-b7b2-c3ff099e05a2 --auth-supported=none --mon-host=127.0.0.1:7109 ' 2026-02-18T00:58:58.305 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T00:58:58.305 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T00:58:58.305 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T00:58:58.305 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/ceph-helpers/1' 2026-02-18T00:58:58.305 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/ceph-helpers/1/journal' 2026-02-18T00:58:58.305 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-18T00:58:58.305 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-18T00:58:58.305 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/ceph-helpers' 2026-02-18T00:58:58.306 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-18T00:58:58.306 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:58:58.306 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:58:58.306 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:58:58.306 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:58:58.306 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:58:58.306 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.57427/$cluster-$name.asok' 2026-02-18T00:58:58.306 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' 2026-02-18T00:58:58.306 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-18T00:58:58.306 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/ceph-helpers/$name.log' 2026-02-18T00:58:58.306 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/ceph-helpers/$name.pid' 2026-02-18T00:58:58.307 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T00:58:58.307 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T00:58:58.307 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T00:58:58.307 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T00:58:58.307 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-18T00:58:58.307 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-18T00:58:58.307 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/ceph-helpers/1 2026-02-18T00:58:58.307 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-18T00:58:58.307 INFO:tasks.workunit.client.0.trial069.stdout:start osd.1 2026-02-18T00:58:58.308 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --cluster ceph --fsid=863c4e35-ceb0-4172-b7b2-c3ff099e05a2 --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/1 --osd-journal=td/ceph-helpers/1/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' --debug-osd=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T00:58:58.308 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/ceph-helpers/1/whoami 2026-02-18T00:58:58.309 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-18T00:58:58.309 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-18T00:58:58.309 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-18T00:58:58.309 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-18T00:58:58.324 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:58:58.308+0000 7f8e6ce79a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:58:58.325 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:58:58.312+0000 7f8e6ce79a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:58:58.326 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:58:58.312+0000 7f8e6ce79a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:58:58.521 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-18T00:58:58.522 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:58:58.522 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-18T00:58:58.522 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:58:58.522 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:58:58.522 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:58:58.523 INFO:tasks.workunit.client.0.trial069.stdout:0 2026-02-18T00:58:58.523 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:58:58.523 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:58:58.523 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-18T00:58:58.686 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:58:58.672+0000 7f8e6ce79a40 -1 Falling back to public interface 2026-02-18T00:58:58.730 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:58:59.276 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:58:59.260+0000 7f8e6ce79a40 -1 osd.1 14 log_to_monitors true 2026-02-18T00:58:59.732 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:58:59.732 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:58:59.732 INFO:tasks.workunit.client.0.trial069.stdout:1 2026-02-18T00:58:59.733 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T00:58:59.733 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:58:59.733 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-18T00:58:59.950 INFO:tasks.workunit.client.0.trial069.stdout:osd.1 up in weight 1 up_from 19 up_thru 0 down_at 15 last_clean_interval [10,14) [v2:127.0.0.1:6810/572775908,v1:127.0.0.1:6811/572775908] [v2:127.0.0.1:6812/572775908,v1:127.0.0.1:6813/572775908] exists,up 563ee9ae-efa1-45e7-bbc8-d74f87f8e50b 2026-02-18T00:58:59.953 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:58:59.953 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:58:59.953 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:58:59.953 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1870: test_wait_for_health_ok: activate_osd td/ceph-helpers 2 2026-02-18T00:58:59.953 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/ceph-helpers 2026-02-18T00:58:59.953 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-18T00:58:59.953 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=2 2026-02-18T00:58:59.953 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-18T00:58:59.954 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/ceph-helpers/2 2026-02-18T00:58:59.954 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--cluster ceph --fsid=863c4e35-ceb0-4172-b7b2-c3ff099e05a2 --auth-supported=none --mon-host=127.0.0.1:7109 ' 2026-02-18T00:58:59.954 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T00:58:59.954 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T00:58:59.954 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T00:58:59.954 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/ceph-helpers/2' 2026-02-18T00:58:59.954 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/ceph-helpers/2/journal' 2026-02-18T00:58:59.954 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-18T00:58:59.954 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-18T00:58:59.954 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/ceph-helpers' 2026-02-18T00:58:59.954 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-18T00:58:59.954 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:58:59.955 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:58:59.955 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:58:59.955 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:58:59.955 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:58:59.955 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.57427/$cluster-$name.asok' 2026-02-18T00:58:59.955 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' 2026-02-18T00:58:59.955 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-18T00:58:59.955 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/ceph-helpers/$name.log' 2026-02-18T00:58:59.955 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/ceph-helpers/$name.pid' 2026-02-18T00:58:59.955 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T00:58:59.955 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T00:58:59.955 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T00:58:59.955 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T00:58:59.956 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-18T00:58:59.956 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-18T00:58:59.956 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/ceph-helpers/2 2026-02-18T00:58:59.956 INFO:tasks.workunit.client.0.trial069.stdout:start osd.2 2026-02-18T00:58:59.957 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.2 2026-02-18T00:58:59.957 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 2 --cluster ceph --fsid=863c4e35-ceb0-4172-b7b2-c3ff099e05a2 --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/2 --osd-journal=td/ceph-helpers/2/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' --debug-osd=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T00:58:59.957 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/ceph-helpers/2/whoami 2026-02-18T00:58:59.957 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 2 = 2 ']' 2026-02-18T00:58:59.958 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-18T00:58:59.958 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-18T00:58:59.958 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-18T00:58:59.973 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:58:59.960+0000 7f72cee43a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:58:59.974 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:58:59.960+0000 7f72cee43a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:58:59.975 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:58:59.960+0000 7f72cee43a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:59:00.171 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 2 2026-02-18T00:59:00.171 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:59:00.171 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-18T00:59:00.171 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:59:00.172 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:59:00.172 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:59:00.172 INFO:tasks.workunit.client.0.trial069.stdout:0 2026-02-18T00:59:00.173 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:59:00.173 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:59:00.173 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-18T00:59:00.388 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:59:00.454 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:59:00.440+0000 7f72cee43a40 -1 Falling back to public interface 2026-02-18T00:59:01.156 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:59:01.140+0000 7f72cee43a40 -1 osd.2 14 log_to_monitors true 2026-02-18T00:59:01.390 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:59:01.390 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:59:01.390 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T00:59:01.390 INFO:tasks.workunit.client.0.trial069.stdout:1 2026-02-18T00:59:01.391 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:59:01.391 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-18T00:59:01.605 INFO:tasks.workunit.client.0.trial069.stdout:osd.2 up in weight 1 up_from 22 up_thru 0 down_at 15 last_clean_interval [0,0) [v2:127.0.0.1:6818/1650968122,v1:127.0.0.1:6819/1650968122] [v2:127.0.0.1:6820/1650968122,v1:127.0.0.1:6821/1650968122] exists,up 9d1c2752-f990-4123-9270-2e145ee6189b 2026-02-18T00:59:01.606 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:59:01.606 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:59:01.607 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:59:01.607 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1871: test_wait_for_health_ok: wait_for_health_ok 2026-02-18T00:59:01.607 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1850: wait_for_health_ok: wait_for_health HEALTH_OK 2026-02-18T00:59:01.607 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1829: wait_for_health: local grepstr=HEALTH_OK 2026-02-18T00:59:01.607 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1830: wait_for_health: get_timeout_delays 300 .1 2026-02-18T00:59:01.607 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-18T00:59:01.607 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-18T00:59:01.608 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-18T00:59:01.608 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-18T00:59:01.608 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-18T00:59:01.831 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1830: wait_for_health: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '4.5') 2026-02-18T00:59:01.831 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1830: wait_for_health: local -a delays 2026-02-18T00:59:01.832 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1831: wait_for_health: local -i loop=0 2026-02-18T00:59:01.832 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1833: wait_for_health: ceph health detail 2026-02-18T00:59:01.832 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1833: wait_for_health: grep HEALTH_OK 2026-02-18T00:59:02.105 INFO:tasks.workunit.client.0.trial069.stdout:HEALTH_OK 2026-02-18T00:59:02.106 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1872: test_wait_for_health_ok: teardown td/ceph-helpers 2026-02-18T00:59:02.106 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/ceph-helpers 2026-02-18T00:59:02.106 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T00:59:02.106 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/ceph-helpers KILL 2026-02-18T00:59:02.106 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:59:02.107 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:59:02.107 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:59:02.107 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:59:02.107 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:59:02.215 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:59:02.216 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T00:59:02.217 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T00:59:02.217 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T00:59:02.218 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T00:59:02.219 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T00:59:02.219 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T00:59:02.220 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:59:02.220 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T00:59:02.221 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T00:59:02.221 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:59:02.221 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T00:59:02.222 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T00:59:02.222 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/ceph-helpers 2026-02-18T00:59:02.232 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T00:59:02.232 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:59:02.232 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:59:02.232 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.57427 2026-02-18T00:59:02.235 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T00:59:02.235 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T00:59:02.235 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2426: run_tests: for func in $funcs 2026-02-18T00:59:02.235 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2427: run_tests: test_wait_for_osd td/ceph-helpers 2026-02-18T00:59:02.235 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:986: test_wait_for_osd: local dir=td/ceph-helpers 2026-02-18T00:59:02.235 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: test_wait_for_osd: setup td/ceph-helpers 2026-02-18T00:59:02.235 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/ceph-helpers 2026-02-18T00:59:02.235 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/ceph-helpers 2026-02-18T00:59:02.235 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/ceph-helpers 2026-02-18T00:59:02.235 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T00:59:02.236 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/ceph-helpers KILL 2026-02-18T00:59:02.236 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:59:02.236 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:59:02.236 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:59:02.236 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:59:02.236 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:59:02.237 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:59:02.237 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T00:59:02.238 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T00:59:02.238 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T00:59:02.239 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T00:59:02.239 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T00:59:02.240 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T00:59:02.241 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:59:02.241 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T00:59:02.241 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T00:59:02.241 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:59:02.242 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T00:59:02.243 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T00:59:02.244 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/ceph-helpers 2026-02-18T00:59:02.245 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T00:59:02.245 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:59:02.245 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:59:02.245 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.57427 2026-02-18T00:59:02.246 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T00:59:02.246 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T00:59:02.246 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/ceph-helpers 2026-02-18T00:59:02.247 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-18T00:59:02.248 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:59:02.248 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:59:02.248 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.57427 2026-02-18T00:59:02.249 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-18T00:59:02.250 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-18T00:59:02.250 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-18T00:59:02.250 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/ceph-helpers 1' TERM HUP INT 2026-02-18T00:59:02.251 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: test_wait_for_osd: run_mon td/ceph-helpers a --osd_pool_default_size=1 --mon_allow_pool_size_one=true 2026-02-18T00:59:02.251 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/ceph-helpers 2026-02-18T00:59:02.251 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-18T00:59:02.251 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-18T00:59:02.251 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-18T00:59:02.251 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/ceph-helpers/a 2026-02-18T00:59:02.251 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/ceph-helpers/a --run-dir=td/ceph-helpers --osd_pool_default_size=1 --mon_allow_pool_size_one=true 2026-02-18T00:59:02.272 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-18T00:59:02.273 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:59:02.273 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:59:02.273 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:59:02.273 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:59:02.273 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:59:02.273 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.57427/$cluster-$name.asok' 2026-02-18T00:59:02.273 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/ceph-helpers/a '--log-file=td/ceph-helpers/$name.log' '--admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' --mon-cluster-log-file=td/ceph-helpers/log --run-dir=td/ceph-helpers '--pid-file=td/ceph-helpers/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --osd_pool_default_size=1 --mon_allow_pool_size_one=true 2026-02-18T00:59:02.302 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-18T00:59:02.306 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-18T00:59:02.306 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T00:59:02.306 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-18T00:59:02.306 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-18T00:59:02.306 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-18T00:59:02.307 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-18T00:59:02.307 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:59:02.307 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:59:02.307 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:59:02.307 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:59:02.307 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:59:02.308 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.57427/ceph-mon.a.asok 2026-02-18T00:59:02.308 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T00:59:02.308 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.57427/ceph-mon.a.asok config get fsid 2026-02-18T00:59:02.360 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-18T00:59:02.360 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T00:59:02.360 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-18T00:59:02.360 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-18T00:59:02.361 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-18T00:59:02.361 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-18T00:59:02.361 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:59:02.361 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:59:02.361 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:59:02.361 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:59:02.361 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:59:02.362 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.57427/ceph-mon.a.asok 2026-02-18T00:59:02.362 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T00:59:02.362 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.57427/ceph-mon.a.asok config get mon_host 2026-02-18T00:59:02.417 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:989: test_wait_for_osd: run_mgr td/ceph-helpers x 2026-02-18T00:59:02.417 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/ceph-helpers 2026-02-18T00:59:02.417 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-18T00:59:02.418 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-18T00:59:02.418 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-18T00:59:02.418 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/ceph-helpers/x 2026-02-18T00:59:02.418 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-18T00:59:02.535 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-18T00:59:02.535 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:59:02.535 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:59:02.535 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:59:02.535 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:59:02.536 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:59:02.536 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.57427/$cluster-$name.asok' 2026-02-18T00:59:02.536 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-18T00:59:02.537 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/ceph-helpers/x '--log-file=td/ceph-helpers/$name.log' '--admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' --run-dir=td/ceph-helpers '--pid-file=td/ceph-helpers/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-18T00:59:02.557 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:990: test_wait_for_osd: run_osd td/ceph-helpers 0 2026-02-18T00:59:02.557 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/ceph-helpers 2026-02-18T00:59:02.557 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T00:59:02.557 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-18T00:59:02.557 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T00:59:02.557 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/ceph-helpers/0 2026-02-18T00:59:02.557 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--cluster ceph --fsid=863c4e35-ceb0-4172-b7b2-c3ff099e05a2 --auth-supported=none --mon-host=127.0.0.1:7109 ' 2026-02-18T00:59:02.557 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T00:59:02.558 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T00:59:02.558 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T00:59:02.558 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/ceph-helpers/0' 2026-02-18T00:59:02.558 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/ceph-helpers/0/journal' 2026-02-18T00:59:02.558 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T00:59:02.558 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-18T00:59:02.558 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/ceph-helpers' 2026-02-18T00:59:02.558 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T00:59:02.558 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:59:02.558 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:59:02.558 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:59:02.558 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:59:02.559 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:59:02.559 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.57427/$cluster-$name.asok' 2026-02-18T00:59:02.559 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' 2026-02-18T00:59:02.559 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T00:59:02.559 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T00:59:02.559 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T00:59:02.559 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/ceph-helpers/$name.log' 2026-02-18T00:59:02.559 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/ceph-helpers/$name.pid' 2026-02-18T00:59:02.559 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T00:59:02.559 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T00:59:02.559 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T00:59:02.559 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T00:59:02.560 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T00:59:02.560 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-18T00:59:02.560 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/ceph-helpers/0 2026-02-18T00:59:02.561 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T00:59:02.561 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=b5876313-84d7-4f44-a5f4-72ccf5b4745c 2026-02-18T00:59:02.561 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 b5876313-84d7-4f44-a5f4-72ccf5b4745c' 2026-02-18T00:59:02.562 INFO:tasks.workunit.client.0.trial069.stdout:add osd0 b5876313-84d7-4f44-a5f4-72ccf5b4745c 2026-02-18T00:59:02.562 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T00:59:02.570 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDWDpVpF0NjIRAA3vk8DRS6/i0KZTva6Hkpiw== 2026-02-18T00:59:02.570 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDWDpVpF0NjIRAA3vk8DRS6/i0KZTva6Hkpiw=="}' 2026-02-18T00:59:02.570 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new b5876313-84d7-4f44-a5f4-72ccf5b4745c -i td/ceph-helpers/0/new.json 2026-02-18T00:59:02.680 INFO:tasks.workunit.client.0.trial069.stdout:0 2026-02-18T00:59:02.688 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/ceph-helpers/0/new.json 2026-02-18T00:59:02.689 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --cluster ceph --fsid=863c4e35-ceb0-4172-b7b2-c3ff099e05a2 --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/0 --osd-journal=td/ceph-helpers/0/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDWDpVpF0NjIRAA3vk8DRS6/i0KZTva6Hkpiw== --osd-uuid b5876313-84d7-4f44-a5f4-72ccf5b4745c 2026-02-18T00:59:02.705 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:59:02.692+0000 7f75ed870a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:59:02.706 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:59:02.692+0000 7f75ed870a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:59:02.707 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:59:02.692+0000 7f75ed870a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:59:02.707 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:59:02.692+0000 7f75ed870a40 -1 bdev(0x55b5fa7cec00 td/ceph-helpers/0/block) open stat got: (1) Operation not permitted 2026-02-18T00:59:02.708 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:59:02.692+0000 7f75ed870a40 -1 bluestore(td/ceph-helpers/0) _read_fsid unparsable uuid 2026-02-18T00:59:03.459 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/ceph-helpers/0/keyring 2026-02-18T00:59:03.459 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T00:59:03.460 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-18T00:59:03.460 INFO:tasks.workunit.client.0.trial069.stdout:adding osd0 key to auth repository 2026-02-18T00:59:03.460 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/ceph-helpers/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T00:59:03.585 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-18T00:59:03.586 INFO:tasks.workunit.client.0.trial069.stdout:start osd.0 2026-02-18T00:59:03.587 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --cluster ceph --fsid=863c4e35-ceb0-4172-b7b2-c3ff099e05a2 --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/0 --osd-journal=td/ceph-helpers/0/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T00:59:03.588 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T00:59:03.588 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T00:59:03.588 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T00:59:03.609 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:59:03.592+0000 7fb460afca40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:59:03.611 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:59:03.596+0000 7fb460afca40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:59:03.612 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:59:03.596+0000 7fb460afca40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:59:03.698 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-18T00:59:03.698 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:59:03.698 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-18T00:59:03.698 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:59:03.698 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:59:03.698 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:59:03.698 INFO:tasks.workunit.client.0.trial069.stdout:0 2026-02-18T00:59:03.698 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:59:03.698 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:59:03.698 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T00:59:03.807 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:59:03.978 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:59:03.964+0000 7fb460afca40 -1 Falling back to public interface 2026-02-18T00:59:04.625 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:59:04.612+0000 7fb460afca40 -1 osd.0 0 log_to_monitors true 2026-02-18T00:59:04.808 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:59:04.808 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:59:04.808 INFO:tasks.workunit.client.0.trial069.stdout:1 2026-02-18T00:59:04.808 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T00:59:04.808 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:59:04.808 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T00:59:05.030 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:59:06.031 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:59:06.031 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:59:06.032 INFO:tasks.workunit.client.0.trial069.stdout:2 2026-02-18T00:59:06.032 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-18T00:59:06.033 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:59:06.033 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T00:59:06.247 INFO:tasks.workunit.client.0.trial069.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/356086061,v1:127.0.0.1:6801/356086061] [v2:127.0.0.1:6802/356086061,v1:127.0.0.1:6803/356086061] exists,up b5876313-84d7-4f44-a5f4-72ccf5b4745c 2026-02-18T00:59:06.248 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:59:06.248 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:59:06.248 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:59:06.248 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: test_wait_for_osd: run_osd td/ceph-helpers 1 2026-02-18T00:59:06.248 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/ceph-helpers 2026-02-18T00:59:06.248 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T00:59:06.248 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2026-02-18T00:59:06.248 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T00:59:06.248 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/ceph-helpers/1 2026-02-18T00:59:06.248 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--cluster ceph --fsid=863c4e35-ceb0-4172-b7b2-c3ff099e05a2 --auth-supported=none --mon-host=127.0.0.1:7109 ' 2026-02-18T00:59:06.248 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T00:59:06.248 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T00:59:06.248 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T00:59:06.248 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/ceph-helpers/1' 2026-02-18T00:59:06.248 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/ceph-helpers/1/journal' 2026-02-18T00:59:06.248 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T00:59:06.248 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-18T00:59:06.248 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/ceph-helpers' 2026-02-18T00:59:06.248 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T00:59:06.248 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:59:06.248 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:59:06.248 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:59:06.248 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:59:06.248 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:59:06.249 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.57427/$cluster-$name.asok' 2026-02-18T00:59:06.249 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' 2026-02-18T00:59:06.249 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T00:59:06.249 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T00:59:06.249 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T00:59:06.249 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/ceph-helpers/$name.log' 2026-02-18T00:59:06.249 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/ceph-helpers/$name.pid' 2026-02-18T00:59:06.249 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T00:59:06.249 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T00:59:06.249 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T00:59:06.249 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T00:59:06.249 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T00:59:06.249 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-18T00:59:06.249 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/ceph-helpers/1 2026-02-18T00:59:06.250 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T00:59:06.251 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=679957c2-e4f7-4cbf-bc49-51a90057c674 2026-02-18T00:59:06.252 INFO:tasks.workunit.client.0.trial069.stdout:add osd1 679957c2-e4f7-4cbf-bc49-51a90057c674 2026-02-18T00:59:06.252 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 679957c2-e4f7-4cbf-bc49-51a90057c674' 2026-02-18T00:59:06.252 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T00:59:06.263 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDaDpVpv2AiDxAAmoGCAdhyMZr6EGinW8WPIw== 2026-02-18T00:59:06.263 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDaDpVpv2AiDxAAmoGCAdhyMZr6EGinW8WPIw=="}' 2026-02-18T00:59:06.263 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 679957c2-e4f7-4cbf-bc49-51a90057c674 -i td/ceph-helpers/1/new.json 2026-02-18T00:59:06.485 INFO:tasks.workunit.client.0.trial069.stdout:1 2026-02-18T00:59:06.495 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/ceph-helpers/1/new.json 2026-02-18T00:59:06.496 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --cluster ceph --fsid=863c4e35-ceb0-4172-b7b2-c3ff099e05a2 --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/1 --osd-journal=td/ceph-helpers/1/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDaDpVpv2AiDxAAmoGCAdhyMZr6EGinW8WPIw== --osd-uuid 679957c2-e4f7-4cbf-bc49-51a90057c674 2026-02-18T00:59:06.513 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:59:06.500+0000 7fd8b46fba40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:59:06.515 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:59:06.500+0000 7fd8b46fba40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:59:06.516 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:59:06.500+0000 7fd8b46fba40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:59:06.516 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:59:06.500+0000 7fd8b46fba40 -1 bdev(0x56066c414c00 td/ceph-helpers/1/block) open stat got: (1) Operation not permitted 2026-02-18T00:59:06.516 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:59:06.500+0000 7fd8b46fba40 -1 bluestore(td/ceph-helpers/1) _read_fsid unparsable uuid 2026-02-18T00:59:07.147 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/ceph-helpers/1/keyring 2026-02-18T00:59:07.148 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T00:59:07.149 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2026-02-18T00:59:07.149 INFO:tasks.workunit.client.0.trial069.stdout:adding osd1 key to auth repository 2026-02-18T00:59:07.149 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/ceph-helpers/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T00:59:07.440 INFO:tasks.workunit.client.0.trial069.stdout:start osd.1 2026-02-18T00:59:07.441 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2026-02-18T00:59:07.441 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --cluster ceph --fsid=863c4e35-ceb0-4172-b7b2-c3ff099e05a2 --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/1 --osd-journal=td/ceph-helpers/1/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T00:59:07.441 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T00:59:07.441 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T00:59:07.441 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T00:59:07.463 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:59:07.448+0000 7f63d89eea40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:59:07.465 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:59:07.452+0000 7f63d89eea40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:59:07.466 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:59:07.452+0000 7f63d89eea40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:59:07.648 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2026-02-18T00:59:07.648 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:59:07.649 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-18T00:59:07.649 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:59:07.649 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:59:07.649 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:59:07.649 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:59:07.649 INFO:tasks.workunit.client.0.trial069.stdout:0 2026-02-18T00:59:07.650 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:59:07.650 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-18T00:59:07.790 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:59:07.776+0000 7f63d89eea40 -1 Falling back to public interface 2026-02-18T00:59:07.862 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:59:08.444 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:59:08.428+0000 7f63d89eea40 -1 osd.1 0 log_to_monitors true 2026-02-18T00:59:08.864 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:59:08.864 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:59:08.864 INFO:tasks.workunit.client.0.trial069.stdout:1 2026-02-18T00:59:08.865 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T00:59:08.865 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:59:08.865 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-18T00:59:09.079 INFO:tasks.workunit.client.0.trial069.stdout:osd.1 up in weight 1 up_from 9 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/264687361,v1:127.0.0.1:6811/264687361] [v2:127.0.0.1:6812/264687361,v1:127.0.0.1:6813/264687361] exists,up 679957c2-e4f7-4cbf-bc49-51a90057c674 2026-02-18T00:59:09.080 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:59:09.080 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:59:09.080 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:59:09.080 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:992: test_wait_for_osd: wait_for_osd up 0 2026-02-18T00:59:09.080 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:59:09.080 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-18T00:59:09.080 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:59:09.080 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:59:09.081 INFO:tasks.workunit.client.0.trial069.stdout:0 2026-02-18T00:59:09.081 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:59:09.081 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:59:09.081 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:59:09.082 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T00:59:09.290 INFO:tasks.workunit.client.0.trial069.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/356086061,v1:127.0.0.1:6801/356086061] [v2:127.0.0.1:6802/356086061,v1:127.0.0.1:6803/356086061] exists,up b5876313-84d7-4f44-a5f4-72ccf5b4745c 2026-02-18T00:59:09.291 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:59:09.291 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:59:09.292 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:59:09.292 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:993: test_wait_for_osd: wait_for_osd up 1 2026-02-18T00:59:09.292 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:59:09.292 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-18T00:59:09.292 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:59:09.292 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:59:09.292 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:59:09.292 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:59:09.292 INFO:tasks.workunit.client.0.trial069.stdout:0 2026-02-18T00:59:09.292 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:59:09.293 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-18T00:59:09.502 INFO:tasks.workunit.client.0.trial069.stdout:osd.1 up in weight 1 up_from 9 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/264687361,v1:127.0.0.1:6811/264687361] [v2:127.0.0.1:6812/264687361,v1:127.0.0.1:6813/264687361] exists,up 679957c2-e4f7-4cbf-bc49-51a90057c674 2026-02-18T00:59:09.503 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:59:09.503 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:59:09.503 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:59:09.503 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:994: test_wait_for_osd: kill_daemons td/ceph-helpers TERM osd.0 2026-02-18T00:59:09.503 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:59:09.503 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:59:09.503 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:59:09.503 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:59:09.503 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:59:09.812 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:59:09.813 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:995: test_wait_for_osd: wait_for_osd down 0 2026-02-18T00:59:09.813 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=down 2026-02-18T00:59:09.813 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-18T00:59:09.813 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:59:09.813 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:59:09.813 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:59:09.814 INFO:tasks.workunit.client.0.trial069.stdout:0 2026-02-18T00:59:09.814 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:59:09.814 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:59:09.814 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 down' 2026-02-18T00:59:10.036 INFO:tasks.workunit.client.0.trial069.stdout:osd.0 down in weight 1 up_from 5 up_thru 0 down_at 10 last_clean_interval [0,0) [v2:127.0.0.1:6800/356086061,v1:127.0.0.1:6801/356086061] [v2:127.0.0.1:6802/356086061,v1:127.0.0.1:6803/356086061] exists b5876313-84d7-4f44-a5f4-72ccf5b4745c 2026-02-18T00:59:10.037 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:59:10.038 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:59:10.038 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:59:10.038 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:996: test_wait_for_osd: TIMEOUT=1 2026-02-18T00:59:10.038 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:996: test_wait_for_osd: wait_for_osd up 0 2026-02-18T00:59:10.038 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:59:10.038 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-18T00:59:10.038 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:59:10.038 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:59:10.038 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 1 )) 2026-02-18T00:59:10.038 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:59:10.039 INFO:tasks.workunit.client.0.trial069.stdout:0 2026-02-18T00:59:10.039 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:59:10.039 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T00:59:10.254 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:59:11.256 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:59:11.256 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 1 )) 2026-02-18T00:59:11.256 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 1 2026-02-18T00:59:11.256 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:997: test_wait_for_osd: teardown td/ceph-helpers 2026-02-18T00:59:11.257 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/ceph-helpers 2026-02-18T00:59:11.257 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T00:59:11.257 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/ceph-helpers KILL 2026-02-18T00:59:11.258 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:59:11.258 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:59:11.258 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:59:11.258 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:59:11.258 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:59:11.367 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:59:11.367 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T00:59:11.368 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T00:59:11.368 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T00:59:11.370 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T00:59:11.370 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T00:59:11.370 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T00:59:11.371 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:59:11.371 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T00:59:11.372 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T00:59:11.372 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:59:11.373 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T00:59:11.374 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T00:59:11.374 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/ceph-helpers 2026-02-18T00:59:11.381 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T00:59:11.381 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:59:11.381 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:59:11.381 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.57427 2026-02-18T00:59:11.384 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T00:59:11.384 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T00:59:11.384 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2426: run_tests: for func in $funcs 2026-02-18T00:59:11.384 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2427: run_tests: test_wait_for_peered td/ceph-helpers 2026-02-18T00:59:11.384 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1766: test_wait_for_peered: local dir=td/ceph-helpers 2026-02-18T00:59:11.384 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1768: test_wait_for_peered: setup td/ceph-helpers 2026-02-18T00:59:11.384 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/ceph-helpers 2026-02-18T00:59:11.384 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/ceph-helpers 2026-02-18T00:59:11.384 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/ceph-helpers 2026-02-18T00:59:11.384 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T00:59:11.384 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/ceph-helpers KILL 2026-02-18T00:59:11.385 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:59:11.385 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:59:11.385 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:59:11.385 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:59:11.385 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:59:11.386 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:59:11.386 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T00:59:11.387 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T00:59:11.387 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T00:59:11.388 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T00:59:11.388 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T00:59:11.389 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T00:59:11.390 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:59:11.390 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T00:59:11.390 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T00:59:11.391 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:59:11.392 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T00:59:11.393 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T00:59:11.393 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/ceph-helpers 2026-02-18T00:59:11.394 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T00:59:11.394 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:59:11.395 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:59:11.395 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.57427 2026-02-18T00:59:11.396 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T00:59:11.396 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T00:59:11.396 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/ceph-helpers 2026-02-18T00:59:11.397 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-18T00:59:11.397 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:59:11.397 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:59:11.397 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.57427 2026-02-18T00:59:11.399 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-18T00:59:11.400 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-18T00:59:11.400 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-18T00:59:11.400 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/ceph-helpers 1' TERM HUP INT 2026-02-18T00:59:11.400 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1769: test_wait_for_peered: run_mon td/ceph-helpers a --osd_pool_default_size=2 2026-02-18T00:59:11.400 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/ceph-helpers 2026-02-18T00:59:11.400 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-18T00:59:11.400 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-18T00:59:11.400 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-18T00:59:11.400 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/ceph-helpers/a 2026-02-18T00:59:11.400 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/ceph-helpers/a --run-dir=td/ceph-helpers --osd_pool_default_size=2 2026-02-18T00:59:11.419 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-18T00:59:11.419 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:59:11.419 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:59:11.419 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:59:11.419 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:59:11.420 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:59:11.420 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.57427/$cluster-$name.asok' 2026-02-18T00:59:11.420 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/ceph-helpers/a '--log-file=td/ceph-helpers/$name.log' '--admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' --mon-cluster-log-file=td/ceph-helpers/log --run-dir=td/ceph-helpers '--pid-file=td/ceph-helpers/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --osd_pool_default_size=2 2026-02-18T00:59:11.450 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-18T00:59:11.451 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-18T00:59:11.451 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T00:59:11.451 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-18T00:59:11.451 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-18T00:59:11.452 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-18T00:59:11.452 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-18T00:59:11.452 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:59:11.452 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:59:11.453 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:59:11.453 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:59:11.453 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:59:11.453 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.57427/ceph-mon.a.asok 2026-02-18T00:59:11.453 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T00:59:11.453 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.57427/ceph-mon.a.asok config get fsid 2026-02-18T00:59:11.508 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-18T00:59:11.508 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T00:59:11.508 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-18T00:59:11.508 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-18T00:59:11.509 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-18T00:59:11.509 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-18T00:59:11.509 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:59:11.509 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:59:11.509 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:59:11.509 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:59:11.509 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:59:11.509 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.57427/ceph-mon.a.asok 2026-02-18T00:59:11.509 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T00:59:11.509 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.57427/ceph-mon.a.asok config get mon_host 2026-02-18T00:59:11.563 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1770: test_wait_for_peered: run_osd td/ceph-helpers 0 2026-02-18T00:59:11.563 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/ceph-helpers 2026-02-18T00:59:11.563 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T00:59:11.563 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-18T00:59:11.563 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T00:59:11.563 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/ceph-helpers/0 2026-02-18T00:59:11.563 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--cluster ceph --fsid=863c4e35-ceb0-4172-b7b2-c3ff099e05a2 --auth-supported=none --mon-host=127.0.0.1:7109 ' 2026-02-18T00:59:11.563 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T00:59:11.563 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T00:59:11.563 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T00:59:11.563 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/ceph-helpers/0' 2026-02-18T00:59:11.563 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/ceph-helpers/0/journal' 2026-02-18T00:59:11.563 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T00:59:11.563 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-18T00:59:11.563 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/ceph-helpers' 2026-02-18T00:59:11.563 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T00:59:11.563 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:59:11.563 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:59:11.564 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:59:11.564 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:59:11.564 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:59:11.564 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.57427/$cluster-$name.asok' 2026-02-18T00:59:11.564 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' 2026-02-18T00:59:11.564 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T00:59:11.564 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T00:59:11.564 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T00:59:11.564 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/ceph-helpers/$name.log' 2026-02-18T00:59:11.564 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/ceph-helpers/$name.pid' 2026-02-18T00:59:11.564 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T00:59:11.564 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T00:59:11.564 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T00:59:11.564 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T00:59:11.564 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T00:59:11.564 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-18T00:59:11.565 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/ceph-helpers/0 2026-02-18T00:59:11.566 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T00:59:11.567 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=9cd9e2dc-5e78-4f9b-93cb-761d94214d4a 2026-02-18T00:59:11.567 INFO:tasks.workunit.client.0.trial069.stdout:add osd0 9cd9e2dc-5e78-4f9b-93cb-761d94214d4a 2026-02-18T00:59:11.567 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 9cd9e2dc-5e78-4f9b-93cb-761d94214d4a' 2026-02-18T00:59:11.567 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T00:59:11.579 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDfDpVp4uj4IRAAAZV3/ERjaWsxgkXdxzakeA== 2026-02-18T00:59:11.580 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDfDpVp4uj4IRAAAZV3/ERjaWsxgkXdxzakeA=="}' 2026-02-18T00:59:11.580 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 9cd9e2dc-5e78-4f9b-93cb-761d94214d4a -i td/ceph-helpers/0/new.json 2026-02-18T00:59:11.701 INFO:tasks.workunit.client.0.trial069.stdout:0 2026-02-18T00:59:11.708 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/ceph-helpers/0/new.json 2026-02-18T00:59:11.709 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --cluster ceph --fsid=863c4e35-ceb0-4172-b7b2-c3ff099e05a2 --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/0 --osd-journal=td/ceph-helpers/0/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDfDpVp4uj4IRAAAZV3/ERjaWsxgkXdxzakeA== --osd-uuid 9cd9e2dc-5e78-4f9b-93cb-761d94214d4a 2026-02-18T00:59:11.725 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:59:11.712+0000 7f74e53a9a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:59:11.727 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:59:11.712+0000 7f74e53a9a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:59:11.728 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:59:11.712+0000 7f74e53a9a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:59:11.728 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:59:11.712+0000 7f74e53a9a40 -1 bdev(0x55f2e9660c00 td/ceph-helpers/0/block) open stat got: (1) Operation not permitted 2026-02-18T00:59:11.728 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:59:11.716+0000 7f74e53a9a40 -1 bluestore(td/ceph-helpers/0) _read_fsid unparsable uuid 2026-02-18T00:59:12.376 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/ceph-helpers/0/keyring 2026-02-18T00:59:12.376 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T00:59:12.377 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-18T00:59:12.378 INFO:tasks.workunit.client.0.trial069.stdout:adding osd0 key to auth repository 2026-02-18T00:59:12.378 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/ceph-helpers/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T00:59:12.501 INFO:tasks.workunit.client.0.trial069.stdout:start osd.0 2026-02-18T00:59:12.502 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-18T00:59:12.502 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --cluster ceph --fsid=863c4e35-ceb0-4172-b7b2-c3ff099e05a2 --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/0 --osd-journal=td/ceph-helpers/0/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T00:59:12.503 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T00:59:12.503 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T00:59:12.503 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T00:59:12.518 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:59:12.504+0000 7f856cc3ea40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:59:12.520 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:59:12.504+0000 7f856cc3ea40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:59:12.521 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:59:12.508+0000 7f856cc3ea40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:59:12.612 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-18T00:59:12.613 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:59:12.613 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-18T00:59:12.613 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:59:12.613 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:59:12.613 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:59:12.613 INFO:tasks.workunit.client.0.trial069.stdout:0 2026-02-18T00:59:12.614 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:59:12.614 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:59:12.614 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T00:59:12.722 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:59:12.915 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:59:12.900+0000 7f856cc3ea40 -1 Falling back to public interface 2026-02-18T00:59:13.456 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:59:13.440+0000 7f856cc3ea40 -1 osd.0 0 log_to_monitors true 2026-02-18T00:59:13.723 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:59:13.723 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:59:13.724 INFO:tasks.workunit.client.0.trial069.stdout:1 2026-02-18T00:59:13.724 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T00:59:13.724 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:59:13.725 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T00:59:13.836 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:59:14.838 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:59:14.838 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:59:14.838 INFO:tasks.workunit.client.0.trial069.stdout:2 2026-02-18T00:59:14.839 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-18T00:59:14.839 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:59:14.839 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T00:59:14.949 INFO:tasks.workunit.client.0.trial069.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/3724653923,v1:127.0.0.1:6801/3724653923] [v2:127.0.0.1:6802/3724653923,v1:127.0.0.1:6803/3724653923] exists,up 9cd9e2dc-5e78-4f9b-93cb-761d94214d4a 2026-02-18T00:59:14.951 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:59:14.951 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:59:14.951 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:59:14.951 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1771: test_wait_for_peered: run_mgr td/ceph-helpers x 2026-02-18T00:59:14.951 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/ceph-helpers 2026-02-18T00:59:14.951 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-18T00:59:14.951 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-18T00:59:14.951 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-18T00:59:14.951 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/ceph-helpers/x 2026-02-18T00:59:14.952 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-18T00:59:15.065 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-18T00:59:15.065 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:59:15.065 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:59:15.065 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:59:15.065 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:59:15.065 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:59:15.065 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.57427/$cluster-$name.asok' 2026-02-18T00:59:15.066 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-18T00:59:15.066 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/ceph-helpers/x '--log-file=td/ceph-helpers/$name.log' '--admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' --run-dir=td/ceph-helpers '--pid-file=td/ceph-helpers/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-18T00:59:15.083 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1772: test_wait_for_peered: create_rbd_pool 2026-02-18T00:59:15.083 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:526: create_rbd_pool: ceph osd pool delete rbd rbd --yes-i-really-really-mean-it 2026-02-18T00:59:15.196 INFO:tasks.workunit.client.0.trial069.stderr:pool 'rbd' does not exist 2026-02-18T00:59:15.204 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:527: create_rbd_pool: create_pool rbd 4 2026-02-18T00:59:15.204 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create rbd 4 2026-02-18T00:59:15.356 INFO:tasks.workunit.client.0.trial069.stderr:pool 'rbd' already exists 2026-02-18T00:59:15.365 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-18T00:59:16.366 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:528: create_rbd_pool: rbd pool init rbd 2026-02-18T00:59:16.644 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1773: test_wait_for_peered: WAIT_FOR_CLEAN_TIMEOUT=1 2026-02-18T00:59:16.645 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1773: test_wait_for_peered: wait_for_clean 2026-02-18T00:59:16.645 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-18T00:59:16.645 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-18T00:59:16.645 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-18T00:59:16.645 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 1 .1 2026-02-18T00:59:16.646 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-18T00:59:16.646 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-18T00:59:16.646 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-18T00:59:16.646 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-18T00:59:16.646 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-18T00:59:16.674 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.3') 2026-02-18T00:59:16.674 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-18T00:59:16.674 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-18T00:59:16.674 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-18T00:59:16.674 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-18T00:59:16.674 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-18T00:59:16.782 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids=0 2026-02-18T00:59:16.782 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-18T00:59:16.783 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:59:16.783 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-18T00:59:16.857 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=0 2026-02-18T00:59:16.857 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 0 2026-02-18T00:59:16.857 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-0' 2026-02-18T00:59:16.858 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:59:16.858 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-0 2026-02-18T00:59:16.858 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:59:16.859 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-18T00:59:16.859 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-0 2026-02-18T00:59:16.860 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:59:16.861 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=0 2026-02-18T00:59:16.861 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 0' 2026-02-18T00:59:16.861 INFO:tasks.workunit.client.0.trial069.stdout:waiting osd.0 seq 0 2026-02-18T00:59:16.861 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T00:59:16.968 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 0 -lt 0 2026-02-18T00:59:16.969 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-18T00:59:16.969 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T00:59:16.969 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T00:59:17.079 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 0 == 0 2026-02-18T00:59:17.079 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1655: wait_for_clean: sleep 1 2026-02-18T00:59:18.080 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-18T00:59:18.081 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T00:59:18.081 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T00:59:18.360 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 4 == 0 2026-02-18T00:59:18.361 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-18T00:59:18.361 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-18T00:59:18.361 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-18T00:59:18.361 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-18T00:59:18.361 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-18T00:59:18.361 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-18T00:59:18.361 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-18T00:59:18.563 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-18T00:59:18.563 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-18T00:59:18.564 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T00:59:18.564 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T00:59:18.835 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 4 2026-02-18T00:59:18.836 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' -1 2026-02-18T00:59:18.836 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1665: wait_for_clean: loop=0 2026-02-18T00:59:18.836 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1666: wait_for_clean: num_active_clean=0 2026-02-18T00:59:18.836 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-18T00:59:18.836 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.1 2026-02-18T00:59:18.936 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-18T00:59:18.936 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-18T00:59:18.937 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-18T00:59:18.937 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-18T00:59:18.937 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-18T00:59:18.938 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-18T00:59:18.938 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-18T00:59:18.938 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-18T00:59:19.144 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-18T00:59:19.145 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-18T00:59:19.145 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T00:59:19.145 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T00:59:19.429 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 4 2026-02-18T00:59:19.429 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-18T00:59:19.429 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-18T00:59:19.429 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-18T00:59:19.430 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-18T00:59:19.430 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-18T00:59:19.430 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-18T00:59:19.430 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-18T00:59:19.430 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-18T00:59:19.708 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-18T00:59:19.708 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-18T00:59:19.708 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 1 >= 4 )) 2026-02-18T00:59:19.708 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-18T00:59:19.708 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.2 2026-02-18T00:59:19.909 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-18T00:59:19.909 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-18T00:59:19.910 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-18T00:59:19.910 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-18T00:59:19.910 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-18T00:59:19.910 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-18T00:59:19.910 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-18T00:59:19.911 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-18T00:59:20.113 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-18T00:59:20.114 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-18T00:59:20.114 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T00:59:20.114 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T00:59:20.406 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 4 2026-02-18T00:59:20.407 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-18T00:59:20.407 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-18T00:59:20.407 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-18T00:59:20.407 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-18T00:59:20.407 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-18T00:59:20.407 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-18T00:59:20.407 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-18T00:59:20.407 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-18T00:59:20.692 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-18T00:59:20.692 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-18T00:59:20.692 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 2 >= 4 )) 2026-02-18T00:59:20.692 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-18T00:59:20.692 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.4 2026-02-18T00:59:21.093 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-18T00:59:21.093 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-18T00:59:21.093 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-18T00:59:21.093 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-18T00:59:21.094 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-18T00:59:21.094 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-18T00:59:21.094 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-18T00:59:21.094 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-18T00:59:21.304 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-18T00:59:21.305 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-18T00:59:21.305 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T00:59:21.305 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T00:59:21.589 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 4 2026-02-18T00:59:21.590 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-18T00:59:21.590 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-18T00:59:21.590 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-18T00:59:21.590 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-18T00:59:21.590 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-18T00:59:21.590 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-18T00:59:21.590 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-18T00:59:21.590 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-18T00:59:21.874 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-18T00:59:21.874 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-18T00:59:21.874 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 3 >= 4 )) 2026-02-18T00:59:21.874 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-18T00:59:21.875 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.3 2026-02-18T00:59:22.175 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-18T00:59:22.175 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-18T00:59:22.176 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-18T00:59:22.176 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-18T00:59:22.176 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-18T00:59:22.176 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-18T00:59:22.176 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-18T00:59:22.177 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-18T00:59:22.383 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-18T00:59:22.383 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-18T00:59:22.384 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T00:59:22.384 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T00:59:22.675 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 4 2026-02-18T00:59:22.675 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-18T00:59:22.675 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-18T00:59:22.675 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-18T00:59:22.675 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-18T00:59:22.675 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-18T00:59:22.675 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-18T00:59:22.676 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-18T00:59:22.676 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-18T00:59:22.965 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-18T00:59:22.965 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-18T00:59:22.965 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 4 >= 4 )) 2026-02-18T00:59:22.965 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: ceph report 2026-02-18T00:59:23.236 INFO:tasks.workunit.client.0.trial069.stdout:{ 2026-02-18T00:59:23.236 INFO:tasks.workunit.client.0.trial069.stdout: "cluster_fingerprint": "40627bf7-fa66-4669-a5cc-a2546c2c3910", 2026-02-18T00:59:23.236 INFO:tasks.workunit.client.0.trial069.stdout: "version": "20.2.0-670-gadc19233", 2026-02-18T00:59:23.236 INFO:tasks.workunit.client.0.trial069.stdout: "commit": "adc1923395f2bcd6ae89b5d331d278364d1848ed", 2026-02-18T00:59:23.236 INFO:tasks.workunit.client.0.trial069.stdout: "timestamp": "2026-02-18T00:59:23.225768+0000", 2026-02-18T00:59:23.236 INFO:tasks.workunit.client.0.trial069.stdout: "tag": "", 2026-02-18T00:59:23.236 INFO:tasks.workunit.client.0.trial069.stdout: "health": { 2026-02-18T00:59:23.237 INFO:tasks.workunit.client.0.trial069.stdout: "status": "HEALTH_WARN", 2026-02-18T00:59:23.237 INFO:tasks.workunit.client.0.trial069.stdout: "checks": { 2026-02-18T00:59:23.237 INFO:tasks.workunit.client.0.trial069.stdout: "PG_DEGRADED": { 2026-02-18T00:59:23.237 INFO:tasks.workunit.client.0.trial069.stdout: "severity": "HEALTH_WARN", 2026-02-18T00:59:23.237 INFO:tasks.workunit.client.0.trial069.stdout: "summary": { 2026-02-18T00:59:23.237 INFO:tasks.workunit.client.0.trial069.stdout: "message": "Degraded data redundancy: 2/4 objects degraded (50.000%), 2 pgs degraded", 2026-02-18T00:59:23.237 INFO:tasks.workunit.client.0.trial069.stdout: "count": 2 2026-02-18T00:59:23.237 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:59:23.237 INFO:tasks.workunit.client.0.trial069.stdout: "detail": [ 2026-02-18T00:59:23.237 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:59:23.237 INFO:tasks.workunit.client.0.trial069.stdout: "message": "pg 1.2 is active+undersized+degraded, acting [0]" 2026-02-18T00:59:23.238 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:59:23.238 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:59:23.238 INFO:tasks.workunit.client.0.trial069.stdout: "message": "pg 1.3 is active+undersized+degraded, acting [0]" 2026-02-18T00:59:23.238 INFO:tasks.workunit.client.0.trial069.stdout: } 2026-02-18T00:59:23.238 INFO:tasks.workunit.client.0.trial069.stdout: ], 2026-02-18T00:59:23.238 INFO:tasks.workunit.client.0.trial069.stdout: "muted": false 2026-02-18T00:59:23.238 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:59:23.238 INFO:tasks.workunit.client.0.trial069.stdout: "TOO_FEW_OSDS": { 2026-02-18T00:59:23.238 INFO:tasks.workunit.client.0.trial069.stdout: "severity": "HEALTH_WARN", 2026-02-18T00:59:23.238 INFO:tasks.workunit.client.0.trial069.stdout: "summary": { 2026-02-18T00:59:23.238 INFO:tasks.workunit.client.0.trial069.stdout: "message": "OSD count 1 < osd_pool_default_size 3", 2026-02-18T00:59:23.238 INFO:tasks.workunit.client.0.trial069.stdout: "count": 2 2026-02-18T00:59:23.238 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:59:23.239 INFO:tasks.workunit.client.0.trial069.stdout: "detail": [], 2026-02-18T00:59:23.239 INFO:tasks.workunit.client.0.trial069.stdout: "muted": false 2026-02-18T00:59:23.239 INFO:tasks.workunit.client.0.trial069.stdout: } 2026-02-18T00:59:23.239 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:59:23.239 INFO:tasks.workunit.client.0.trial069.stdout: "mutes": [] 2026-02-18T00:59:23.239 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:59:23.239 INFO:tasks.workunit.client.0.trial069.stdout: "monmap_first_committed": 1, 2026-02-18T00:59:23.239 INFO:tasks.workunit.client.0.trial069.stdout: "monmap_last_committed": 1, 2026-02-18T00:59:23.239 INFO:tasks.workunit.client.0.trial069.stdout: "monmap": { 2026-02-18T00:59:23.239 INFO:tasks.workunit.client.0.trial069.stdout: "epoch": 1, 2026-02-18T00:59:23.239 INFO:tasks.workunit.client.0.trial069.stdout: "fsid": "863c4e35-ceb0-4172-b7b2-c3ff099e05a2", 2026-02-18T00:59:23.239 INFO:tasks.workunit.client.0.trial069.stdout: "modified": "2026-02-18T00:59:11.403237Z", 2026-02-18T00:59:23.240 INFO:tasks.workunit.client.0.trial069.stdout: "created": "2026-02-18T00:59:11.403237Z", 2026-02-18T00:59:23.240 INFO:tasks.workunit.client.0.trial069.stdout: "min_mon_release": 20, 2026-02-18T00:59:23.240 INFO:tasks.workunit.client.0.trial069.stdout: "min_mon_release_name": "tentacle", 2026-02-18T00:59:23.240 INFO:tasks.workunit.client.0.trial069.stdout: "election_strategy": 1, 2026-02-18T00:59:23.240 INFO:tasks.workunit.client.0.trial069.stdout: "disallowed_leaders": "", 2026-02-18T00:59:23.240 INFO:tasks.workunit.client.0.trial069.stdout: "stretch_mode": false, 2026-02-18T00:59:23.240 INFO:tasks.workunit.client.0.trial069.stdout: "tiebreaker_mon": "", 2026-02-18T00:59:23.240 INFO:tasks.workunit.client.0.trial069.stdout: "removed_ranks": "", 2026-02-18T00:59:23.240 INFO:tasks.workunit.client.0.trial069.stdout: "features": { 2026-02-18T00:59:23.240 INFO:tasks.workunit.client.0.trial069.stdout: "persistent": [ 2026-02-18T00:59:23.240 INFO:tasks.workunit.client.0.trial069.stdout: "kraken", 2026-02-18T00:59:23.240 INFO:tasks.workunit.client.0.trial069.stdout: "luminous", 2026-02-18T00:59:23.240 INFO:tasks.workunit.client.0.trial069.stdout: "mimic", 2026-02-18T00:59:23.241 INFO:tasks.workunit.client.0.trial069.stdout: "osdmap-prune", 2026-02-18T00:59:23.241 INFO:tasks.workunit.client.0.trial069.stdout: "nautilus", 2026-02-18T00:59:23.241 INFO:tasks.workunit.client.0.trial069.stdout: "octopus", 2026-02-18T00:59:23.241 INFO:tasks.workunit.client.0.trial069.stdout: "pacific", 2026-02-18T00:59:23.241 INFO:tasks.workunit.client.0.trial069.stdout: "elector-pinging", 2026-02-18T00:59:23.241 INFO:tasks.workunit.client.0.trial069.stdout: "quincy", 2026-02-18T00:59:23.241 INFO:tasks.workunit.client.0.trial069.stdout: "reef", 2026-02-18T00:59:23.241 INFO:tasks.workunit.client.0.trial069.stdout: "squid", 2026-02-18T00:59:23.241 INFO:tasks.workunit.client.0.trial069.stdout: "tentacle", 2026-02-18T00:59:23.241 INFO:tasks.workunit.client.0.trial069.stdout: "nvmeof_beacon_diff" 2026-02-18T00:59:23.241 INFO:tasks.workunit.client.0.trial069.stdout: ], 2026-02-18T00:59:23.241 INFO:tasks.workunit.client.0.trial069.stdout: "optional": [] 2026-02-18T00:59:23.242 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:59:23.242 INFO:tasks.workunit.client.0.trial069.stdout: "mons": [ 2026-02-18T00:59:23.242 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:59:23.242 INFO:tasks.workunit.client.0.trial069.stdout: "rank": 0, 2026-02-18T00:59:23.242 INFO:tasks.workunit.client.0.trial069.stdout: "name": "a", 2026-02-18T00:59:23.242 INFO:tasks.workunit.client.0.trial069.stdout: "public_addrs": { 2026-02-18T00:59:23.242 INFO:tasks.workunit.client.0.trial069.stdout: "addrvec": [ 2026-02-18T00:59:23.242 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:59:23.242 INFO:tasks.workunit.client.0.trial069.stdout: "type": "v2", 2026-02-18T00:59:23.242 INFO:tasks.workunit.client.0.trial069.stdout: "addr": "127.0.0.1:7109", 2026-02-18T00:59:23.242 INFO:tasks.workunit.client.0.trial069.stdout: "nonce": 0 2026-02-18T00:59:23.242 INFO:tasks.workunit.client.0.trial069.stdout: } 2026-02-18T00:59:23.242 INFO:tasks.workunit.client.0.trial069.stdout: ] 2026-02-18T00:59:23.243 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:59:23.243 INFO:tasks.workunit.client.0.trial069.stdout: "addr": "127.0.0.1:7109/0", 2026-02-18T00:59:23.243 INFO:tasks.workunit.client.0.trial069.stdout: "public_addr": "127.0.0.1:7109/0", 2026-02-18T00:59:23.243 INFO:tasks.workunit.client.0.trial069.stdout: "priority": 0, 2026-02-18T00:59:23.243 INFO:tasks.workunit.client.0.trial069.stdout: "weight": 0, 2026-02-18T00:59:23.243 INFO:tasks.workunit.client.0.trial069.stdout: "crush_location": "{}" 2026-02-18T00:59:23.243 INFO:tasks.workunit.client.0.trial069.stdout: } 2026-02-18T00:59:23.243 INFO:tasks.workunit.client.0.trial069.stdout: ] 2026-02-18T00:59:23.243 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:59:23.243 INFO:tasks.workunit.client.0.trial069.stdout: "quorum": [ 2026-02-18T00:59:23.243 INFO:tasks.workunit.client.0.trial069.stdout: 0 2026-02-18T00:59:23.243 INFO:tasks.workunit.client.0.trial069.stdout: ], 2026-02-18T00:59:23.243 INFO:tasks.workunit.client.0.trial069.stdout: "osdmap": { 2026-02-18T00:59:23.244 INFO:tasks.workunit.client.0.trial069.stdout: "epoch": 12, 2026-02-18T00:59:23.244 INFO:tasks.workunit.client.0.trial069.stdout: "fsid": "863c4e35-ceb0-4172-b7b2-c3ff099e05a2", 2026-02-18T00:59:23.244 INFO:tasks.workunit.client.0.trial069.stdout: "created": "2026-02-18T00:59:11.481177+0000", 2026-02-18T00:59:23.244 INFO:tasks.workunit.client.0.trial069.stdout: "modified": "2026-02-18T00:59:16.628347+0000", 2026-02-18T00:59:23.244 INFO:tasks.workunit.client.0.trial069.stdout: "last_up_change": "2026-02-18T00:59:14.054944+0000", 2026-02-18T00:59:23.244 INFO:tasks.workunit.client.0.trial069.stdout: "last_in_change": "2026-02-18T00:59:11.669239+0000", 2026-02-18T00:59:23.244 INFO:tasks.workunit.client.0.trial069.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2026-02-18T00:59:23.244 INFO:tasks.workunit.client.0.trial069.stdout: "flags_num": 5799936, 2026-02-18T00:59:23.244 INFO:tasks.workunit.client.0.trial069.stdout: "flags_set": [ 2026-02-18T00:59:23.244 INFO:tasks.workunit.client.0.trial069.stdout: "pglog_hardlimit", 2026-02-18T00:59:23.245 INFO:tasks.workunit.client.0.trial069.stdout: "purged_snapdirs", 2026-02-18T00:59:23.245 INFO:tasks.workunit.client.0.trial069.stdout: "recovery_deletes", 2026-02-18T00:59:23.245 INFO:tasks.workunit.client.0.trial069.stdout: "sortbitwise" 2026-02-18T00:59:23.245 INFO:tasks.workunit.client.0.trial069.stdout: ], 2026-02-18T00:59:23.245 INFO:tasks.workunit.client.0.trial069.stdout: "crush_version": 3, 2026-02-18T00:59:23.245 INFO:tasks.workunit.client.0.trial069.stdout: "full_ratio": 0.99000000953674316, 2026-02-18T00:59:23.245 INFO:tasks.workunit.client.0.trial069.stdout: "backfillfull_ratio": 0.99000000953674316, 2026-02-18T00:59:23.245 INFO:tasks.workunit.client.0.trial069.stdout: "nearfull_ratio": 0.85000002384185791, 2026-02-18T00:59:23.245 INFO:tasks.workunit.client.0.trial069.stdout: "cluster_snapshot": "", 2026-02-18T00:59:23.245 INFO:tasks.workunit.client.0.trial069.stdout: "pool_max": 1, 2026-02-18T00:59:23.245 INFO:tasks.workunit.client.0.trial069.stdout: "max_osd": 1, 2026-02-18T00:59:23.246 INFO:tasks.workunit.client.0.trial069.stdout: "require_min_compat_client": "luminous", 2026-02-18T00:59:23.246 INFO:tasks.workunit.client.0.trial069.stdout: "min_compat_client": "jewel", 2026-02-18T00:59:23.246 INFO:tasks.workunit.client.0.trial069.stdout: "require_osd_release": "tentacle", 2026-02-18T00:59:23.246 INFO:tasks.workunit.client.0.trial069.stdout: "allow_crimson": false, 2026-02-18T00:59:23.246 INFO:tasks.workunit.client.0.trial069.stdout: "pools": [ 2026-02-18T00:59:23.246 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:59:23.246 INFO:tasks.workunit.client.0.trial069.stdout: "pool": 1, 2026-02-18T00:59:23.246 INFO:tasks.workunit.client.0.trial069.stdout: "pool_name": "rbd", 2026-02-18T00:59:23.246 INFO:tasks.workunit.client.0.trial069.stdout: "create_time": "2026-02-18T00:59:15.285801+0000", 2026-02-18T00:59:23.246 INFO:tasks.workunit.client.0.trial069.stdout: "flags": 8193, 2026-02-18T00:59:23.246 INFO:tasks.workunit.client.0.trial069.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2026-02-18T00:59:23.246 INFO:tasks.workunit.client.0.trial069.stdout: "type": 1, 2026-02-18T00:59:23.247 INFO:tasks.workunit.client.0.trial069.stdout: "size": 2, 2026-02-18T00:59:23.247 INFO:tasks.workunit.client.0.trial069.stdout: "min_size": 1, 2026-02-18T00:59:23.247 INFO:tasks.workunit.client.0.trial069.stdout: "crush_rule": 0, 2026-02-18T00:59:23.247 INFO:tasks.workunit.client.0.trial069.stdout: "peering_crush_bucket_count": 0, 2026-02-18T00:59:23.247 INFO:tasks.workunit.client.0.trial069.stdout: "peering_crush_bucket_target": 0, 2026-02-18T00:59:23.247 INFO:tasks.workunit.client.0.trial069.stdout: "peering_crush_bucket_barrier": 0, 2026-02-18T00:59:23.247 INFO:tasks.workunit.client.0.trial069.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2026-02-18T00:59:23.247 INFO:tasks.workunit.client.0.trial069.stdout: "is_stretch_pool": false, 2026-02-18T00:59:23.247 INFO:tasks.workunit.client.0.trial069.stdout: "object_hash": 2, 2026-02-18T00:59:23.247 INFO:tasks.workunit.client.0.trial069.stdout: "pg_autoscale_mode": "off", 2026-02-18T00:59:23.247 INFO:tasks.workunit.client.0.trial069.stdout: "pg_num": 4, 2026-02-18T00:59:23.247 INFO:tasks.workunit.client.0.trial069.stdout: "pg_placement_num": 4, 2026-02-18T00:59:23.248 INFO:tasks.workunit.client.0.trial069.stdout: "pg_placement_num_target": 4, 2026-02-18T00:59:23.248 INFO:tasks.workunit.client.0.trial069.stdout: "pg_num_target": 4, 2026-02-18T00:59:23.248 INFO:tasks.workunit.client.0.trial069.stdout: "pg_num_pending": 4, 2026-02-18T00:59:23.248 INFO:tasks.workunit.client.0.trial069.stdout: "last_pg_merge_meta": { 2026-02-18T00:59:23.248 INFO:tasks.workunit.client.0.trial069.stdout: "source_pgid": "0.0", 2026-02-18T00:59:23.248 INFO:tasks.workunit.client.0.trial069.stdout: "ready_epoch": 0, 2026-02-18T00:59:23.248 INFO:tasks.workunit.client.0.trial069.stdout: "last_epoch_started": 0, 2026-02-18T00:59:23.248 INFO:tasks.workunit.client.0.trial069.stdout: "last_epoch_clean": 0, 2026-02-18T00:59:23.248 INFO:tasks.workunit.client.0.trial069.stdout: "source_version": "0'0", 2026-02-18T00:59:23.248 INFO:tasks.workunit.client.0.trial069.stdout: "target_version": "0'0" 2026-02-18T00:59:23.248 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:59:23.248 INFO:tasks.workunit.client.0.trial069.stdout: "last_change": "12", 2026-02-18T00:59:23.248 INFO:tasks.workunit.client.0.trial069.stdout: "last_force_op_resend": "0", 2026-02-18T00:59:23.249 INFO:tasks.workunit.client.0.trial069.stdout: "last_force_op_resend_prenautilus": "0", 2026-02-18T00:59:23.249 INFO:tasks.workunit.client.0.trial069.stdout: "last_force_op_resend_preluminous": "0", 2026-02-18T00:59:23.249 INFO:tasks.workunit.client.0.trial069.stdout: "auid": 0, 2026-02-18T00:59:23.249 INFO:tasks.workunit.client.0.trial069.stdout: "snap_mode": "selfmanaged", 2026-02-18T00:59:23.249 INFO:tasks.workunit.client.0.trial069.stdout: "snap_seq": 2, 2026-02-18T00:59:23.249 INFO:tasks.workunit.client.0.trial069.stdout: "snap_epoch": 12, 2026-02-18T00:59:23.249 INFO:tasks.workunit.client.0.trial069.stdout: "pool_snaps": [], 2026-02-18T00:59:23.249 INFO:tasks.workunit.client.0.trial069.stdout: "removed_snaps": "[]", 2026-02-18T00:59:23.249 INFO:tasks.workunit.client.0.trial069.stdout: "quota_max_bytes": 0, 2026-02-18T00:59:23.249 INFO:tasks.workunit.client.0.trial069.stdout: "quota_max_objects": 0, 2026-02-18T00:59:23.249 INFO:tasks.workunit.client.0.trial069.stdout: "tiers": [], 2026-02-18T00:59:23.249 INFO:tasks.workunit.client.0.trial069.stdout: "tier_of": -1, 2026-02-18T00:59:23.250 INFO:tasks.workunit.client.0.trial069.stdout: "read_tier": -1, 2026-02-18T00:59:23.250 INFO:tasks.workunit.client.0.trial069.stdout: "write_tier": -1, 2026-02-18T00:59:23.250 INFO:tasks.workunit.client.0.trial069.stdout: "cache_mode": "none", 2026-02-18T00:59:23.250 INFO:tasks.workunit.client.0.trial069.stdout: "target_max_bytes": 0, 2026-02-18T00:59:23.250 INFO:tasks.workunit.client.0.trial069.stdout: "target_max_objects": 0, 2026-02-18T00:59:23.250 INFO:tasks.workunit.client.0.trial069.stdout: "cache_target_dirty_ratio_micro": 400000, 2026-02-18T00:59:23.250 INFO:tasks.workunit.client.0.trial069.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2026-02-18T00:59:23.250 INFO:tasks.workunit.client.0.trial069.stdout: "cache_target_full_ratio_micro": 800000, 2026-02-18T00:59:23.250 INFO:tasks.workunit.client.0.trial069.stdout: "cache_min_flush_age": 0, 2026-02-18T00:59:23.250 INFO:tasks.workunit.client.0.trial069.stdout: "cache_min_evict_age": 0, 2026-02-18T00:59:23.250 INFO:tasks.workunit.client.0.trial069.stdout: "erasure_code_profile": "", 2026-02-18T00:59:23.250 INFO:tasks.workunit.client.0.trial069.stdout: "hit_set_params": { 2026-02-18T00:59:23.250 INFO:tasks.workunit.client.0.trial069.stdout: "type": "none" 2026-02-18T00:59:23.251 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:59:23.251 INFO:tasks.workunit.client.0.trial069.stdout: "hit_set_period": 0, 2026-02-18T00:59:23.251 INFO:tasks.workunit.client.0.trial069.stdout: "hit_set_count": 0, 2026-02-18T00:59:23.251 INFO:tasks.workunit.client.0.trial069.stdout: "use_gmt_hitset": true, 2026-02-18T00:59:23.251 INFO:tasks.workunit.client.0.trial069.stdout: "min_read_recency_for_promote": 0, 2026-02-18T00:59:23.251 INFO:tasks.workunit.client.0.trial069.stdout: "min_write_recency_for_promote": 0, 2026-02-18T00:59:23.251 INFO:tasks.workunit.client.0.trial069.stdout: "hit_set_grade_decay_rate": 0, 2026-02-18T00:59:23.251 INFO:tasks.workunit.client.0.trial069.stdout: "hit_set_search_last_n": 0, 2026-02-18T00:59:23.251 INFO:tasks.workunit.client.0.trial069.stdout: "grade_table": [], 2026-02-18T00:59:23.251 INFO:tasks.workunit.client.0.trial069.stdout: "stripe_width": 0, 2026-02-18T00:59:23.251 INFO:tasks.workunit.client.0.trial069.stdout: "expected_num_objects": 0, 2026-02-18T00:59:23.251 INFO:tasks.workunit.client.0.trial069.stdout: "fast_read": false, 2026-02-18T00:59:23.251 INFO:tasks.workunit.client.0.trial069.stdout: "nonprimary_shards": "{}", 2026-02-18T00:59:23.252 INFO:tasks.workunit.client.0.trial069.stdout: "options": {}, 2026-02-18T00:59:23.252 INFO:tasks.workunit.client.0.trial069.stdout: "application_metadata": { 2026-02-18T00:59:23.252 INFO:tasks.workunit.client.0.trial069.stdout: "rbd": {} 2026-02-18T00:59:23.252 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:59:23.252 INFO:tasks.workunit.client.0.trial069.stdout: "read_balance": { 2026-02-18T00:59:23.252 INFO:tasks.workunit.client.0.trial069.stdout: "score_type": "Fair distribution", 2026-02-18T00:59:23.252 INFO:tasks.workunit.client.0.trial069.stdout: "score_acting": 1, 2026-02-18T00:59:23.252 INFO:tasks.workunit.client.0.trial069.stdout: "score_stable": 1, 2026-02-18T00:59:23.252 INFO:tasks.workunit.client.0.trial069.stdout: "optimal_score": 1, 2026-02-18T00:59:23.252 INFO:tasks.workunit.client.0.trial069.stdout: "raw_score_acting": 1, 2026-02-18T00:59:23.252 INFO:tasks.workunit.client.0.trial069.stdout: "raw_score_stable": 1, 2026-02-18T00:59:23.252 INFO:tasks.workunit.client.0.trial069.stdout: "primary_affinity_weighted": 1, 2026-02-18T00:59:23.252 INFO:tasks.workunit.client.0.trial069.stdout: "average_primary_affinity": 1, 2026-02-18T00:59:23.253 INFO:tasks.workunit.client.0.trial069.stdout: "average_primary_affinity_weighted": 1 2026-02-18T00:59:23.253 INFO:tasks.workunit.client.0.trial069.stdout: } 2026-02-18T00:59:23.253 INFO:tasks.workunit.client.0.trial069.stdout: } 2026-02-18T00:59:23.253 INFO:tasks.workunit.client.0.trial069.stdout: ], 2026-02-18T00:59:23.253 INFO:tasks.workunit.client.0.trial069.stdout: "osds": [ 2026-02-18T00:59:23.253 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:59:23.253 INFO:tasks.workunit.client.0.trial069.stdout: "osd": 0, 2026-02-18T00:59:23.253 INFO:tasks.workunit.client.0.trial069.stdout: "uuid": "9cd9e2dc-5e78-4f9b-93cb-761d94214d4a", 2026-02-18T00:59:23.253 INFO:tasks.workunit.client.0.trial069.stdout: "up": 1, 2026-02-18T00:59:23.253 INFO:tasks.workunit.client.0.trial069.stdout: "in": 1, 2026-02-18T00:59:23.253 INFO:tasks.workunit.client.0.trial069.stdout: "weight": 1, 2026-02-18T00:59:23.253 INFO:tasks.workunit.client.0.trial069.stdout: "primary_affinity": 1, 2026-02-18T00:59:23.253 INFO:tasks.workunit.client.0.trial069.stdout: "last_clean_begin": 0, 2026-02-18T00:59:23.254 INFO:tasks.workunit.client.0.trial069.stdout: "last_clean_end": 0, 2026-02-18T00:59:23.254 INFO:tasks.workunit.client.0.trial069.stdout: "up_from": 5, 2026-02-18T00:59:23.254 INFO:tasks.workunit.client.0.trial069.stdout: "up_thru": 7, 2026-02-18T00:59:23.254 INFO:tasks.workunit.client.0.trial069.stdout: "down_at": 0, 2026-02-18T00:59:23.254 INFO:tasks.workunit.client.0.trial069.stdout: "lost_at": 0, 2026-02-18T00:59:23.254 INFO:tasks.workunit.client.0.trial069.stdout: "public_addrs": { 2026-02-18T00:59:23.254 INFO:tasks.workunit.client.0.trial069.stdout: "addrvec": [ 2026-02-18T00:59:23.254 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:59:23.254 INFO:tasks.workunit.client.0.trial069.stdout: "type": "v2", 2026-02-18T00:59:23.254 INFO:tasks.workunit.client.0.trial069.stdout: "addr": "127.0.0.1:6800", 2026-02-18T00:59:23.254 INFO:tasks.workunit.client.0.trial069.stdout: "nonce": 3724653923 2026-02-18T00:59:23.254 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:59:23.254 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:59:23.255 INFO:tasks.workunit.client.0.trial069.stdout: "type": "v1", 2026-02-18T00:59:23.255 INFO:tasks.workunit.client.0.trial069.stdout: "addr": "127.0.0.1:6801", 2026-02-18T00:59:23.255 INFO:tasks.workunit.client.0.trial069.stdout: "nonce": 3724653923 2026-02-18T00:59:23.255 INFO:tasks.workunit.client.0.trial069.stdout: } 2026-02-18T00:59:23.255 INFO:tasks.workunit.client.0.trial069.stdout: ] 2026-02-18T00:59:23.255 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:59:23.255 INFO:tasks.workunit.client.0.trial069.stdout: "cluster_addrs": { 2026-02-18T00:59:23.255 INFO:tasks.workunit.client.0.trial069.stdout: "addrvec": [ 2026-02-18T00:59:23.255 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:59:23.255 INFO:tasks.workunit.client.0.trial069.stdout: "type": "v2", 2026-02-18T00:59:23.255 INFO:tasks.workunit.client.0.trial069.stdout: "addr": "127.0.0.1:6802", 2026-02-18T00:59:23.256 INFO:tasks.workunit.client.0.trial069.stdout: "nonce": 3724653923 2026-02-18T00:59:23.256 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:59:23.256 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:59:23.256 INFO:tasks.workunit.client.0.trial069.stdout: "type": "v1", 2026-02-18T00:59:23.256 INFO:tasks.workunit.client.0.trial069.stdout: "addr": "127.0.0.1:6803", 2026-02-18T00:59:23.256 INFO:tasks.workunit.client.0.trial069.stdout: "nonce": 3724653923 2026-02-18T00:59:23.256 INFO:tasks.workunit.client.0.trial069.stdout: } 2026-02-18T00:59:23.256 INFO:tasks.workunit.client.0.trial069.stdout: ] 2026-02-18T00:59:23.256 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:59:23.256 INFO:tasks.workunit.client.0.trial069.stdout: "heartbeat_back_addrs": { 2026-02-18T00:59:23.257 INFO:tasks.workunit.client.0.trial069.stdout: "addrvec": [ 2026-02-18T00:59:23.257 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:59:23.257 INFO:tasks.workunit.client.0.trial069.stdout: "type": "v2", 2026-02-18T00:59:23.257 INFO:tasks.workunit.client.0.trial069.stdout: "addr": "127.0.0.1:6806", 2026-02-18T00:59:23.257 INFO:tasks.workunit.client.0.trial069.stdout: "nonce": 3724653923 2026-02-18T00:59:23.257 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:59:23.257 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:59:23.257 INFO:tasks.workunit.client.0.trial069.stdout: "type": "v1", 2026-02-18T00:59:23.257 INFO:tasks.workunit.client.0.trial069.stdout: "addr": "127.0.0.1:6807", 2026-02-18T00:59:23.257 INFO:tasks.workunit.client.0.trial069.stdout: "nonce": 3724653923 2026-02-18T00:59:23.257 INFO:tasks.workunit.client.0.trial069.stdout: } 2026-02-18T00:59:23.257 INFO:tasks.workunit.client.0.trial069.stdout: ] 2026-02-18T00:59:23.258 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:59:23.258 INFO:tasks.workunit.client.0.trial069.stdout: "heartbeat_front_addrs": { 2026-02-18T00:59:23.258 INFO:tasks.workunit.client.0.trial069.stdout: "addrvec": [ 2026-02-18T00:59:23.258 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:59:23.258 INFO:tasks.workunit.client.0.trial069.stdout: "type": "v2", 2026-02-18T00:59:23.258 INFO:tasks.workunit.client.0.trial069.stdout: "addr": "127.0.0.1:6804", 2026-02-18T00:59:23.258 INFO:tasks.workunit.client.0.trial069.stdout: "nonce": 3724653923 2026-02-18T00:59:23.258 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:59:23.258 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:59:23.258 INFO:tasks.workunit.client.0.trial069.stdout: "type": "v1", 2026-02-18T00:59:23.258 INFO:tasks.workunit.client.0.trial069.stdout: "addr": "127.0.0.1:6805", 2026-02-18T00:59:23.258 INFO:tasks.workunit.client.0.trial069.stdout: "nonce": 3724653923 2026-02-18T00:59:23.258 INFO:tasks.workunit.client.0.trial069.stdout: } 2026-02-18T00:59:23.259 INFO:tasks.workunit.client.0.trial069.stdout: ] 2026-02-18T00:59:23.259 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:59:23.259 INFO:tasks.workunit.client.0.trial069.stdout: "public_addr": "127.0.0.1:6801/3724653923", 2026-02-18T00:59:23.259 INFO:tasks.workunit.client.0.trial069.stdout: "cluster_addr": "127.0.0.1:6803/3724653923", 2026-02-18T00:59:23.259 INFO:tasks.workunit.client.0.trial069.stdout: "heartbeat_back_addr": "127.0.0.1:6807/3724653923", 2026-02-18T00:59:23.259 INFO:tasks.workunit.client.0.trial069.stdout: "heartbeat_front_addr": "127.0.0.1:6805/3724653923", 2026-02-18T00:59:23.259 INFO:tasks.workunit.client.0.trial069.stdout: "state": [ 2026-02-18T00:59:23.259 INFO:tasks.workunit.client.0.trial069.stdout: "exists", 2026-02-18T00:59:23.259 INFO:tasks.workunit.client.0.trial069.stdout: "up" 2026-02-18T00:59:23.259 INFO:tasks.workunit.client.0.trial069.stdout: ] 2026-02-18T00:59:23.259 INFO:tasks.workunit.client.0.trial069.stdout: } 2026-02-18T00:59:23.259 INFO:tasks.workunit.client.0.trial069.stdout: ], 2026-02-18T00:59:23.260 INFO:tasks.workunit.client.0.trial069.stdout: "osd_xinfo": [ 2026-02-18T00:59:23.260 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:59:23.260 INFO:tasks.workunit.client.0.trial069.stdout: "osd": 0, 2026-02-18T00:59:23.260 INFO:tasks.workunit.client.0.trial069.stdout: "down_stamp": "0.000000", 2026-02-18T00:59:23.260 INFO:tasks.workunit.client.0.trial069.stdout: "laggy_probability": 0, 2026-02-18T00:59:23.260 INFO:tasks.workunit.client.0.trial069.stdout: "laggy_interval": 0, 2026-02-18T00:59:23.260 INFO:tasks.workunit.client.0.trial069.stdout: "features": 4544132024016699391, 2026-02-18T00:59:23.260 INFO:tasks.workunit.client.0.trial069.stdout: "old_weight": 0, 2026-02-18T00:59:23.260 INFO:tasks.workunit.client.0.trial069.stdout: "last_purged_snaps_scrub": "2026-02-18T00:59:14.435799+0000", 2026-02-18T00:59:23.260 INFO:tasks.workunit.client.0.trial069.stdout: "dead_epoch": 0 2026-02-18T00:59:23.260 INFO:tasks.workunit.client.0.trial069.stdout: } 2026-02-18T00:59:23.260 INFO:tasks.workunit.client.0.trial069.stdout: ], 2026-02-18T00:59:23.260 INFO:tasks.workunit.client.0.trial069.stdout: "pg_upmap": [], 2026-02-18T00:59:23.261 INFO:tasks.workunit.client.0.trial069.stdout: "pg_upmap_items": [], 2026-02-18T00:59:23.261 INFO:tasks.workunit.client.0.trial069.stdout: "pg_upmap_primaries": [], 2026-02-18T00:59:23.261 INFO:tasks.workunit.client.0.trial069.stdout: "pg_temp": [], 2026-02-18T00:59:23.261 INFO:tasks.workunit.client.0.trial069.stdout: "primary_temp": [], 2026-02-18T00:59:23.261 INFO:tasks.workunit.client.0.trial069.stdout: "blocklist": {}, 2026-02-18T00:59:23.261 INFO:tasks.workunit.client.0.trial069.stdout: "range_blocklist": {}, 2026-02-18T00:59:23.261 INFO:tasks.workunit.client.0.trial069.stdout: "erasure_code_profiles": { 2026-02-18T00:59:23.261 INFO:tasks.workunit.client.0.trial069.stdout: "default": { 2026-02-18T00:59:23.261 INFO:tasks.workunit.client.0.trial069.stdout: "k": "2", 2026-02-18T00:59:23.261 INFO:tasks.workunit.client.0.trial069.stdout: "m": "2", 2026-02-18T00:59:23.261 INFO:tasks.workunit.client.0.trial069.stdout: "plugin": "isa", 2026-02-18T00:59:23.261 INFO:tasks.workunit.client.0.trial069.stdout: "technique": "reed_sol_van" 2026-02-18T00:59:23.261 INFO:tasks.workunit.client.0.trial069.stdout: } 2026-02-18T00:59:23.262 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:59:23.262 INFO:tasks.workunit.client.0.trial069.stdout: "removed_snaps_queue": [ 2026-02-18T00:59:23.262 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:59:23.262 INFO:tasks.workunit.client.0.trial069.stdout: "pool": 1, 2026-02-18T00:59:23.262 INFO:tasks.workunit.client.0.trial069.stdout: "snaps": [ 2026-02-18T00:59:23.262 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:59:23.262 INFO:tasks.workunit.client.0.trial069.stdout: "begin": 2, 2026-02-18T00:59:23.262 INFO:tasks.workunit.client.0.trial069.stdout: "length": 1 2026-02-18T00:59:23.262 INFO:tasks.workunit.client.0.trial069.stdout: } 2026-02-18T00:59:23.262 INFO:tasks.workunit.client.0.trial069.stdout: ] 2026-02-18T00:59:23.262 INFO:tasks.workunit.client.0.trial069.stdout: } 2026-02-18T00:59:23.262 INFO:tasks.workunit.client.0.trial069.stdout: ], 2026-02-18T00:59:23.263 INFO:tasks.workunit.client.0.trial069.stdout: "new_removed_snaps": [ 2026-02-18T00:59:23.263 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:59:23.263 INFO:tasks.workunit.client.0.trial069.stdout: "pool": 1, 2026-02-18T00:59:23.263 INFO:tasks.workunit.client.0.trial069.stdout: "snaps": [ 2026-02-18T00:59:23.263 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:59:23.263 INFO:tasks.workunit.client.0.trial069.stdout: "begin": 2, 2026-02-18T00:59:23.263 INFO:tasks.workunit.client.0.trial069.stdout: "length": 1 2026-02-18T00:59:23.263 INFO:tasks.workunit.client.0.trial069.stdout: } 2026-02-18T00:59:23.263 INFO:tasks.workunit.client.0.trial069.stdout: ] 2026-02-18T00:59:23.263 INFO:tasks.workunit.client.0.trial069.stdout: } 2026-02-18T00:59:23.263 INFO:tasks.workunit.client.0.trial069.stdout: ], 2026-02-18T00:59:23.263 INFO:tasks.workunit.client.0.trial069.stdout: "new_purged_snaps": [], 2026-02-18T00:59:23.263 INFO:tasks.workunit.client.0.trial069.stdout: "crush_node_flags": {}, 2026-02-18T00:59:23.264 INFO:tasks.workunit.client.0.trial069.stdout: "device_class_flags": {}, 2026-02-18T00:59:23.264 INFO:tasks.workunit.client.0.trial069.stdout: "stretch_mode": { 2026-02-18T00:59:23.264 INFO:tasks.workunit.client.0.trial069.stdout: "stretch_mode_enabled": false, 2026-02-18T00:59:23.264 INFO:tasks.workunit.client.0.trial069.stdout: "stretch_bucket_count": 0, 2026-02-18T00:59:23.264 INFO:tasks.workunit.client.0.trial069.stdout: "degraded_stretch_mode": 0, 2026-02-18T00:59:23.264 INFO:tasks.workunit.client.0.trial069.stdout: "recovering_stretch_mode": 0, 2026-02-18T00:59:23.264 INFO:tasks.workunit.client.0.trial069.stdout: "stretch_mode_bucket": 0 2026-02-18T00:59:23.264 INFO:tasks.workunit.client.0.trial069.stdout: } 2026-02-18T00:59:23.264 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:59:23.264 INFO:tasks.workunit.client.0.trial069.stdout: "osd_metadata": [ 2026-02-18T00:59:23.264 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:59:23.264 INFO:tasks.workunit.client.0.trial069.stdout: "id": 0, 2026-02-18T00:59:23.264 INFO:tasks.workunit.client.0.trial069.stdout: "arch": "x86_64", 2026-02-18T00:59:23.265 INFO:tasks.workunit.client.0.trial069.stdout: "back_addr": "[v2:127.0.0.1:6802/3724653923,v1:127.0.0.1:6803/3724653923]", 2026-02-18T00:59:23.265 INFO:tasks.workunit.client.0.trial069.stdout: "back_iface": "", 2026-02-18T00:59:23.265 INFO:tasks.workunit.client.0.trial069.stdout: "bluefs": "1", 2026-02-18T00:59:23.265 INFO:tasks.workunit.client.0.trial069.stdout: "bluefs_dedicated_db": "0", 2026-02-18T00:59:23.265 INFO:tasks.workunit.client.0.trial069.stdout: "bluefs_dedicated_wal": "0", 2026-02-18T00:59:23.265 INFO:tasks.workunit.client.0.trial069.stdout: "bluefs_single_shared_device": "1", 2026-02-18T00:59:23.265 INFO:tasks.workunit.client.0.trial069.stdout: "bluestore_allocation_from_file": "1", 2026-02-18T00:59:23.265 INFO:tasks.workunit.client.0.trial069.stdout: "bluestore_allocator": "hybrid", 2026-02-18T00:59:23.265 INFO:tasks.workunit.client.0.trial069.stdout: "bluestore_bdev_access_mode": "file", 2026-02-18T00:59:23.265 INFO:tasks.workunit.client.0.trial069.stdout: "bluestore_bdev_block_size": "4096", 2026-02-18T00:59:23.265 INFO:tasks.workunit.client.0.trial069.stdout: "bluestore_bdev_devices": "nvme0n1", 2026-02-18T00:59:23.265 INFO:tasks.workunit.client.0.trial069.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-18T00:59:23.266 INFO:tasks.workunit.client.0.trial069.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-18T00:59:23.266 INFO:tasks.workunit.client.0.trial069.stdout: "bluestore_bdev_path": "td/ceph-helpers/0/block", 2026-02-18T00:59:23.266 INFO:tasks.workunit.client.0.trial069.stdout: "bluestore_bdev_rotational": "0", 2026-02-18T00:59:23.266 INFO:tasks.workunit.client.0.trial069.stdout: "bluestore_bdev_size": "107374182400", 2026-02-18T00:59:23.266 INFO:tasks.workunit.client.0.trial069.stdout: "bluestore_bdev_support_discard": "1", 2026-02-18T00:59:23.266 INFO:tasks.workunit.client.0.trial069.stdout: "bluestore_bdev_type": "ssd", 2026-02-18T00:59:23.266 INFO:tasks.workunit.client.0.trial069.stdout: "bluestore_min_alloc_size": "4096", 2026-02-18T00:59:23.266 INFO:tasks.workunit.client.0.trial069.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-18T00:59:23.266 INFO:tasks.workunit.client.0.trial069.stdout: "bluestore_write_mode": "classic", 2026-02-18T00:59:23.266 INFO:tasks.workunit.client.0.trial069.stdout: "ceph_release": "tentacle", 2026-02-18T00:59:23.266 INFO:tasks.workunit.client.0.trial069.stdout: "ceph_version": "ceph version 20.2.0-670-gadc19233 (adc1923395f2bcd6ae89b5d331d278364d1848ed) tentacle (stable - None)", 2026-02-18T00:59:23.266 INFO:tasks.workunit.client.0.trial069.stdout: "ceph_version_short": "20.2.0-670-gadc19233", 2026-02-18T00:59:23.266 INFO:tasks.workunit.client.0.trial069.stdout: "ceph_version_when_created": "ceph version 20.2.0-670-gadc19233 (adc1923395f2bcd6ae89b5d331d278364d1848ed) tentacle (stable - None)", 2026-02-18T00:59:23.267 INFO:tasks.workunit.client.0.trial069.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-18T00:59:23.267 INFO:tasks.workunit.client.0.trial069.stdout: "created_at": "2026-02-18T00:59:12.267264Z", 2026-02-18T00:59:23.267 INFO:tasks.workunit.client.0.trial069.stdout: "default_device_class": "ssd", 2026-02-18T00:59:23.267 INFO:tasks.workunit.client.0.trial069.stdout: "device_ids": "nvme0n1=Micron_7450_MTFDKBA960TFR_25174FCD463C", 2026-02-18T00:59:23.267 INFO:tasks.workunit.client.0.trial069.stdout: "device_paths": "nvme0n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-18T00:59:23.267 INFO:tasks.workunit.client.0.trial069.stdout: "devices": "nvme0n1", 2026-02-18T00:59:23.267 INFO:tasks.workunit.client.0.trial069.stdout: "distro": "ubuntu", 2026-02-18T00:59:23.267 INFO:tasks.workunit.client.0.trial069.stdout: "distro_description": "Ubuntu 22.04.5 LTS", 2026-02-18T00:59:23.267 INFO:tasks.workunit.client.0.trial069.stdout: "distro_version": "22.04", 2026-02-18T00:59:23.267 INFO:tasks.workunit.client.0.trial069.stdout: "front_addr": "[v2:127.0.0.1:6800/3724653923,v1:127.0.0.1:6801/3724653923]", 2026-02-18T00:59:23.267 INFO:tasks.workunit.client.0.trial069.stdout: "front_iface": "", 2026-02-18T00:59:23.267 INFO:tasks.workunit.client.0.trial069.stdout: "hb_back_addr": "[v2:127.0.0.1:6806/3724653923,v1:127.0.0.1:6807/3724653923]", 2026-02-18T00:59:23.267 INFO:tasks.workunit.client.0.trial069.stdout: "hb_front_addr": "[v2:127.0.0.1:6804/3724653923,v1:127.0.0.1:6805/3724653923]", 2026-02-18T00:59:23.268 INFO:tasks.workunit.client.0.trial069.stdout: "hostname": "trial069", 2026-02-18T00:59:23.268 INFO:tasks.workunit.client.0.trial069.stdout: "journal_rotational": "0", 2026-02-18T00:59:23.268 INFO:tasks.workunit.client.0.trial069.stdout: "kernel_description": "#180-Ubuntu SMP Fri Jan 9 16:10:31 UTC 2026", 2026-02-18T00:59:23.268 INFO:tasks.workunit.client.0.trial069.stdout: "kernel_version": "5.15.0-170-generic", 2026-02-18T00:59:23.268 INFO:tasks.workunit.client.0.trial069.stdout: "mem_swap_kb": "8388604", 2026-02-18T00:59:23.268 INFO:tasks.workunit.client.0.trial069.stdout: "mem_total_kb": "130961700", 2026-02-18T00:59:23.268 INFO:tasks.workunit.client.0.trial069.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-18T00:59:23.268 INFO:tasks.workunit.client.0.trial069.stdout: "objectstore_numa_node": "0", 2026-02-18T00:59:23.268 INFO:tasks.workunit.client.0.trial069.stdout: "objectstore_numa_nodes": "0", 2026-02-18T00:59:23.268 INFO:tasks.workunit.client.0.trial069.stdout: "os": "Linux", 2026-02-18T00:59:23.268 INFO:tasks.workunit.client.0.trial069.stdout: "osd_data": "td/ceph-helpers/0", 2026-02-18T00:59:23.268 INFO:tasks.workunit.client.0.trial069.stdout: "osd_objectstore": "bluestore", 2026-02-18T00:59:23.268 INFO:tasks.workunit.client.0.trial069.stdout: "osdspec_affinity": "", 2026-02-18T00:59:23.268 INFO:tasks.workunit.client.0.trial069.stdout: "rotational": "0" 2026-02-18T00:59:23.269 INFO:tasks.workunit.client.0.trial069.stdout: } 2026-02-18T00:59:23.269 INFO:tasks.workunit.client.0.trial069.stdout: ], 2026-02-18T00:59:23.269 INFO:tasks.workunit.client.0.trial069.stdout: "osdmap_clean_epochs": { 2026-02-18T00:59:23.269 INFO:tasks.workunit.client.0.trial069.stdout: "min_last_epoch_clean": 0, 2026-02-18T00:59:23.269 INFO:tasks.workunit.client.0.trial069.stdout: "last_epoch_clean": { 2026-02-18T00:59:23.269 INFO:tasks.workunit.client.0.trial069.stdout: "per_pool": [] 2026-02-18T00:59:23.269 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:59:23.269 INFO:tasks.workunit.client.0.trial069.stdout: "osd_epochs": [ 2026-02-18T00:59:23.269 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:59:23.269 INFO:tasks.workunit.client.0.trial069.stdout: "id": 0, 2026-02-18T00:59:23.269 INFO:tasks.workunit.client.0.trial069.stdout: "epoch": 5 2026-02-18T00:59:23.269 INFO:tasks.workunit.client.0.trial069.stdout: } 2026-02-18T00:59:23.270 INFO:tasks.workunit.client.0.trial069.stdout: ] 2026-02-18T00:59:23.270 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:59:23.270 INFO:tasks.workunit.client.0.trial069.stdout: "osdmap_first_committed": 1, 2026-02-18T00:59:23.270 INFO:tasks.workunit.client.0.trial069.stdout: "osdmap_last_committed": 12, 2026-02-18T00:59:23.270 INFO:tasks.workunit.client.0.trial069.stdout: "crushmap": { 2026-02-18T00:59:23.270 INFO:tasks.workunit.client.0.trial069.stdout: "devices": [ 2026-02-18T00:59:23.270 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:59:23.270 INFO:tasks.workunit.client.0.trial069.stdout: "id": 0, 2026-02-18T00:59:23.270 INFO:tasks.workunit.client.0.trial069.stdout: "name": "osd.0", 2026-02-18T00:59:23.270 INFO:tasks.workunit.client.0.trial069.stdout: "class": "ssd" 2026-02-18T00:59:23.270 INFO:tasks.workunit.client.0.trial069.stdout: } 2026-02-18T00:59:23.270 INFO:tasks.workunit.client.0.trial069.stdout: ], 2026-02-18T00:59:23.270 INFO:tasks.workunit.client.0.trial069.stdout: "types": [ 2026-02-18T00:59:23.270 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:59:23.271 INFO:tasks.workunit.client.0.trial069.stdout: "type_id": 0, 2026-02-18T00:59:23.271 INFO:tasks.workunit.client.0.trial069.stdout: "name": "osd" 2026-02-18T00:59:23.271 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:59:23.271 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:59:23.271 INFO:tasks.workunit.client.0.trial069.stdout: "type_id": 1, 2026-02-18T00:59:23.271 INFO:tasks.workunit.client.0.trial069.stdout: "name": "host" 2026-02-18T00:59:23.271 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:59:23.271 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:59:23.271 INFO:tasks.workunit.client.0.trial069.stdout: "type_id": 2, 2026-02-18T00:59:23.271 INFO:tasks.workunit.client.0.trial069.stdout: "name": "chassis" 2026-02-18T00:59:23.271 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:59:23.271 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:59:23.271 INFO:tasks.workunit.client.0.trial069.stdout: "type_id": 3, 2026-02-18T00:59:23.272 INFO:tasks.workunit.client.0.trial069.stdout: "name": "rack" 2026-02-18T00:59:23.272 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:59:23.272 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:59:23.272 INFO:tasks.workunit.client.0.trial069.stdout: "type_id": 4, 2026-02-18T00:59:23.272 INFO:tasks.workunit.client.0.trial069.stdout: "name": "row" 2026-02-18T00:59:23.272 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:59:23.272 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:59:23.272 INFO:tasks.workunit.client.0.trial069.stdout: "type_id": 5, 2026-02-18T00:59:23.272 INFO:tasks.workunit.client.0.trial069.stdout: "name": "pdu" 2026-02-18T00:59:23.272 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:59:23.272 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:59:23.272 INFO:tasks.workunit.client.0.trial069.stdout: "type_id": 6, 2026-02-18T00:59:23.272 INFO:tasks.workunit.client.0.trial069.stdout: "name": "pod" 2026-02-18T00:59:23.273 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:59:23.273 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:59:23.273 INFO:tasks.workunit.client.0.trial069.stdout: "type_id": 7, 2026-02-18T00:59:23.273 INFO:tasks.workunit.client.0.trial069.stdout: "name": "room" 2026-02-18T00:59:23.273 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:59:23.273 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:59:23.273 INFO:tasks.workunit.client.0.trial069.stdout: "type_id": 8, 2026-02-18T00:59:23.273 INFO:tasks.workunit.client.0.trial069.stdout: "name": "datacenter" 2026-02-18T00:59:23.273 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:59:23.273 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:59:23.273 INFO:tasks.workunit.client.0.trial069.stdout: "type_id": 9, 2026-02-18T00:59:23.273 INFO:tasks.workunit.client.0.trial069.stdout: "name": "zone" 2026-02-18T00:59:23.273 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:59:23.273 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:59:23.274 INFO:tasks.workunit.client.0.trial069.stdout: "type_id": 10, 2026-02-18T00:59:23.274 INFO:tasks.workunit.client.0.trial069.stdout: "name": "region" 2026-02-18T00:59:23.274 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:59:23.274 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:59:23.274 INFO:tasks.workunit.client.0.trial069.stdout: "type_id": 11, 2026-02-18T00:59:23.274 INFO:tasks.workunit.client.0.trial069.stdout: "name": "root" 2026-02-18T00:59:23.274 INFO:tasks.workunit.client.0.trial069.stdout: } 2026-02-18T00:59:23.274 INFO:tasks.workunit.client.0.trial069.stdout: ], 2026-02-18T00:59:23.274 INFO:tasks.workunit.client.0.trial069.stdout: "buckets": [ 2026-02-18T00:59:23.274 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:59:23.274 INFO:tasks.workunit.client.0.trial069.stdout: "id": -1, 2026-02-18T00:59:23.274 INFO:tasks.workunit.client.0.trial069.stdout: "name": "default", 2026-02-18T00:59:23.274 INFO:tasks.workunit.client.0.trial069.stdout: "type_id": 11, 2026-02-18T00:59:23.274 INFO:tasks.workunit.client.0.trial069.stdout: "type_name": "root", 2026-02-18T00:59:23.275 INFO:tasks.workunit.client.0.trial069.stdout: "weight": 6402, 2026-02-18T00:59:23.275 INFO:tasks.workunit.client.0.trial069.stdout: "alg": "straw2", 2026-02-18T00:59:23.275 INFO:tasks.workunit.client.0.trial069.stdout: "hash": "rjenkins1", 2026-02-18T00:59:23.275 INFO:tasks.workunit.client.0.trial069.stdout: "items": [ 2026-02-18T00:59:23.275 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:59:23.275 INFO:tasks.workunit.client.0.trial069.stdout: "id": -3, 2026-02-18T00:59:23.275 INFO:tasks.workunit.client.0.trial069.stdout: "weight": 6402, 2026-02-18T00:59:23.275 INFO:tasks.workunit.client.0.trial069.stdout: "pos": 0 2026-02-18T00:59:23.275 INFO:tasks.workunit.client.0.trial069.stdout: } 2026-02-18T00:59:23.275 INFO:tasks.workunit.client.0.trial069.stdout: ] 2026-02-18T00:59:23.275 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:59:23.275 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:59:23.275 INFO:tasks.workunit.client.0.trial069.stdout: "id": -2, 2026-02-18T00:59:23.275 INFO:tasks.workunit.client.0.trial069.stdout: "name": "default~ssd", 2026-02-18T00:59:23.275 INFO:tasks.workunit.client.0.trial069.stdout: "type_id": 11, 2026-02-18T00:59:23.276 INFO:tasks.workunit.client.0.trial069.stdout: "type_name": "root", 2026-02-18T00:59:23.276 INFO:tasks.workunit.client.0.trial069.stdout: "weight": 6402, 2026-02-18T00:59:23.276 INFO:tasks.workunit.client.0.trial069.stdout: "alg": "straw2", 2026-02-18T00:59:23.276 INFO:tasks.workunit.client.0.trial069.stdout: "hash": "rjenkins1", 2026-02-18T00:59:23.276 INFO:tasks.workunit.client.0.trial069.stdout: "items": [ 2026-02-18T00:59:23.276 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:59:23.276 INFO:tasks.workunit.client.0.trial069.stdout: "id": -4, 2026-02-18T00:59:23.276 INFO:tasks.workunit.client.0.trial069.stdout: "weight": 6402, 2026-02-18T00:59:23.276 INFO:tasks.workunit.client.0.trial069.stdout: "pos": 0 2026-02-18T00:59:23.276 INFO:tasks.workunit.client.0.trial069.stdout: } 2026-02-18T00:59:23.276 INFO:tasks.workunit.client.0.trial069.stdout: ] 2026-02-18T00:59:23.276 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:59:23.276 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:59:23.276 INFO:tasks.workunit.client.0.trial069.stdout: "id": -3, 2026-02-18T00:59:23.277 INFO:tasks.workunit.client.0.trial069.stdout: "name": "trial069", 2026-02-18T00:59:23.277 INFO:tasks.workunit.client.0.trial069.stdout: "type_id": 1, 2026-02-18T00:59:23.277 INFO:tasks.workunit.client.0.trial069.stdout: "type_name": "host", 2026-02-18T00:59:23.277 INFO:tasks.workunit.client.0.trial069.stdout: "weight": 6402, 2026-02-18T00:59:23.277 INFO:tasks.workunit.client.0.trial069.stdout: "alg": "straw2", 2026-02-18T00:59:23.277 INFO:tasks.workunit.client.0.trial069.stdout: "hash": "rjenkins1", 2026-02-18T00:59:23.277 INFO:tasks.workunit.client.0.trial069.stdout: "items": [ 2026-02-18T00:59:23.277 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:59:23.277 INFO:tasks.workunit.client.0.trial069.stdout: "id": 0, 2026-02-18T00:59:23.277 INFO:tasks.workunit.client.0.trial069.stdout: "weight": 6402, 2026-02-18T00:59:23.277 INFO:tasks.workunit.client.0.trial069.stdout: "pos": 0 2026-02-18T00:59:23.277 INFO:tasks.workunit.client.0.trial069.stdout: } 2026-02-18T00:59:23.277 INFO:tasks.workunit.client.0.trial069.stdout: ] 2026-02-18T00:59:23.277 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:59:23.277 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:59:23.277 INFO:tasks.workunit.client.0.trial069.stdout: "id": -4, 2026-02-18T00:59:23.278 INFO:tasks.workunit.client.0.trial069.stdout: "name": "trial069~ssd", 2026-02-18T00:59:23.278 INFO:tasks.workunit.client.0.trial069.stdout: "type_id": 1, 2026-02-18T00:59:23.278 INFO:tasks.workunit.client.0.trial069.stdout: "type_name": "host", 2026-02-18T00:59:23.278 INFO:tasks.workunit.client.0.trial069.stdout: "weight": 6402, 2026-02-18T00:59:23.278 INFO:tasks.workunit.client.0.trial069.stdout: "alg": "straw2", 2026-02-18T00:59:23.278 INFO:tasks.workunit.client.0.trial069.stdout: "hash": "rjenkins1", 2026-02-18T00:59:23.278 INFO:tasks.workunit.client.0.trial069.stdout: "items": [ 2026-02-18T00:59:23.278 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:59:23.278 INFO:tasks.workunit.client.0.trial069.stdout: "id": 0, 2026-02-18T00:59:23.278 INFO:tasks.workunit.client.0.trial069.stdout: "weight": 6402, 2026-02-18T00:59:23.278 INFO:tasks.workunit.client.0.trial069.stdout: "pos": 0 2026-02-18T00:59:23.278 INFO:tasks.workunit.client.0.trial069.stdout: } 2026-02-18T00:59:23.278 INFO:tasks.workunit.client.0.trial069.stdout: ] 2026-02-18T00:59:23.278 INFO:tasks.workunit.client.0.trial069.stdout: } 2026-02-18T00:59:23.278 INFO:tasks.workunit.client.0.trial069.stdout: ], 2026-02-18T00:59:23.278 INFO:tasks.workunit.client.0.trial069.stdout: "rules": [ 2026-02-18T00:59:23.279 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:59:23.279 INFO:tasks.workunit.client.0.trial069.stdout: "rule_id": 0, 2026-02-18T00:59:23.279 INFO:tasks.workunit.client.0.trial069.stdout: "rule_name": "replicated_rule", 2026-02-18T00:59:23.279 INFO:tasks.workunit.client.0.trial069.stdout: "type": 1, 2026-02-18T00:59:23.279 INFO:tasks.workunit.client.0.trial069.stdout: "steps": [ 2026-02-18T00:59:23.279 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:59:23.279 INFO:tasks.workunit.client.0.trial069.stdout: "op": "take", 2026-02-18T00:59:23.279 INFO:tasks.workunit.client.0.trial069.stdout: "item": -1, 2026-02-18T00:59:23.279 INFO:tasks.workunit.client.0.trial069.stdout: "item_name": "default" 2026-02-18T00:59:23.279 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:59:23.279 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:59:23.279 INFO:tasks.workunit.client.0.trial069.stdout: "op": "choose_firstn", 2026-02-18T00:59:23.279 INFO:tasks.workunit.client.0.trial069.stdout: "num": 0, 2026-02-18T00:59:23.279 INFO:tasks.workunit.client.0.trial069.stdout: "type": "osd" 2026-02-18T00:59:23.279 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:59:23.279 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:59:23.280 INFO:tasks.workunit.client.0.trial069.stdout: "op": "emit" 2026-02-18T00:59:23.280 INFO:tasks.workunit.client.0.trial069.stdout: } 2026-02-18T00:59:23.280 INFO:tasks.workunit.client.0.trial069.stdout: ] 2026-02-18T00:59:23.280 INFO:tasks.workunit.client.0.trial069.stdout: } 2026-02-18T00:59:23.280 INFO:tasks.workunit.client.0.trial069.stdout: ], 2026-02-18T00:59:23.280 INFO:tasks.workunit.client.0.trial069.stdout: "tunables": { 2026-02-18T00:59:23.280 INFO:tasks.workunit.client.0.trial069.stdout: "choose_local_tries": 0, 2026-02-18T00:59:23.280 INFO:tasks.workunit.client.0.trial069.stdout: "choose_local_fallback_tries": 0, 2026-02-18T00:59:23.280 INFO:tasks.workunit.client.0.trial069.stdout: "choose_total_tries": 50, 2026-02-18T00:59:23.280 INFO:tasks.workunit.client.0.trial069.stdout: "chooseleaf_descend_once": 1, 2026-02-18T00:59:23.280 INFO:tasks.workunit.client.0.trial069.stdout: "chooseleaf_vary_r": 1, 2026-02-18T00:59:23.280 INFO:tasks.workunit.client.0.trial069.stdout: "chooseleaf_stable": 1, 2026-02-18T00:59:23.280 INFO:tasks.workunit.client.0.trial069.stdout: "msr_descents": 100, 2026-02-18T00:59:23.280 INFO:tasks.workunit.client.0.trial069.stdout: "msr_collision_tries": 100, 2026-02-18T00:59:23.280 INFO:tasks.workunit.client.0.trial069.stdout: "straw_calc_version": 1, 2026-02-18T00:59:23.280 INFO:tasks.workunit.client.0.trial069.stdout: "allowed_bucket_algs": 54, 2026-02-18T00:59:23.280 INFO:tasks.workunit.client.0.trial069.stdout: "profile": "jewel", 2026-02-18T00:59:23.281 INFO:tasks.workunit.client.0.trial069.stdout: "optimal_tunables": 1, 2026-02-18T00:59:23.281 INFO:tasks.workunit.client.0.trial069.stdout: "legacy_tunables": 0, 2026-02-18T00:59:23.281 INFO:tasks.workunit.client.0.trial069.stdout: "minimum_required_version": "jewel", 2026-02-18T00:59:23.281 INFO:tasks.workunit.client.0.trial069.stdout: "require_feature_tunables": 1, 2026-02-18T00:59:23.281 INFO:tasks.workunit.client.0.trial069.stdout: "require_feature_tunables2": 1, 2026-02-18T00:59:23.281 INFO:tasks.workunit.client.0.trial069.stdout: "has_v2_rules": 0, 2026-02-18T00:59:23.281 INFO:tasks.workunit.client.0.trial069.stdout: "require_feature_tunables3": 1, 2026-02-18T00:59:23.281 INFO:tasks.workunit.client.0.trial069.stdout: "has_v3_rules": 0, 2026-02-18T00:59:23.281 INFO:tasks.workunit.client.0.trial069.stdout: "has_v4_buckets": 1, 2026-02-18T00:59:23.281 INFO:tasks.workunit.client.0.trial069.stdout: "require_feature_tunables5": 1, 2026-02-18T00:59:23.281 INFO:tasks.workunit.client.0.trial069.stdout: "has_v5_rules": 0, 2026-02-18T00:59:23.281 INFO:tasks.workunit.client.0.trial069.stdout: "has_msr_rules": 0 2026-02-18T00:59:23.281 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:59:23.281 INFO:tasks.workunit.client.0.trial069.stdout: "choose_args": {} 2026-02-18T00:59:23.281 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:59:23.281 INFO:tasks.workunit.client.0.trial069.stdout: "fsmap": { 2026-02-18T00:59:23.281 INFO:tasks.workunit.client.0.trial069.stdout: "epoch": 1, 2026-02-18T00:59:23.281 INFO:tasks.workunit.client.0.trial069.stdout: "btime": "2026-02-18T00:59:11:480964+0000", 2026-02-18T00:59:23.281 INFO:tasks.workunit.client.0.trial069.stdout: "default_fscid": -1, 2026-02-18T00:59:23.282 INFO:tasks.workunit.client.0.trial069.stdout: "compat": { 2026-02-18T00:59:23.282 INFO:tasks.workunit.client.0.trial069.stdout: "compat": {}, 2026-02-18T00:59:23.282 INFO:tasks.workunit.client.0.trial069.stdout: "ro_compat": {}, 2026-02-18T00:59:23.282 INFO:tasks.workunit.client.0.trial069.stdout: "incompat": { 2026-02-18T00:59:23.282 INFO:tasks.workunit.client.0.trial069.stdout: "feature_1": "base v0.20", 2026-02-18T00:59:23.282 INFO:tasks.workunit.client.0.trial069.stdout: "feature_2": "client writeable ranges", 2026-02-18T00:59:23.282 INFO:tasks.workunit.client.0.trial069.stdout: "feature_3": "default file layouts on dirs", 2026-02-18T00:59:23.282 INFO:tasks.workunit.client.0.trial069.stdout: "feature_4": "dir inode in separate object", 2026-02-18T00:59:23.282 INFO:tasks.workunit.client.0.trial069.stdout: "feature_5": "mds uses versioned encoding", 2026-02-18T00:59:23.282 INFO:tasks.workunit.client.0.trial069.stdout: "feature_6": "dirfrag is stored in omap", 2026-02-18T00:59:23.282 INFO:tasks.workunit.client.0.trial069.stdout: "feature_8": "no anchor table", 2026-02-18T00:59:23.282 INFO:tasks.workunit.client.0.trial069.stdout: "feature_9": "file layout v2", 2026-02-18T00:59:23.282 INFO:tasks.workunit.client.0.trial069.stdout: "feature_10": "snaprealm v2", 2026-02-18T00:59:23.282 INFO:tasks.workunit.client.0.trial069.stdout: "feature_11": "minor log segments", 2026-02-18T00:59:23.282 INFO:tasks.workunit.client.0.trial069.stdout: "feature_12": "quiesce subvolumes" 2026-02-18T00:59:23.282 INFO:tasks.workunit.client.0.trial069.stdout: } 2026-02-18T00:59:23.282 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:59:23.282 INFO:tasks.workunit.client.0.trial069.stdout: "feature_flags": { 2026-02-18T00:59:23.283 INFO:tasks.workunit.client.0.trial069.stdout: "enable_multiple": true, 2026-02-18T00:59:23.283 INFO:tasks.workunit.client.0.trial069.stdout: "ever_enabled_multiple": true 2026-02-18T00:59:23.283 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:59:23.283 INFO:tasks.workunit.client.0.trial069.stdout: "standbys": [], 2026-02-18T00:59:23.283 INFO:tasks.workunit.client.0.trial069.stdout: "filesystems": [] 2026-02-18T00:59:23.283 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:59:23.283 INFO:tasks.workunit.client.0.trial069.stdout: "mdsmap_first_committed": 1, 2026-02-18T00:59:23.283 INFO:tasks.workunit.client.0.trial069.stdout: "mdsmap_last_committed": 1, 2026-02-18T00:59:23.283 INFO:tasks.workunit.client.0.trial069.stdout: "auth": { 2026-02-18T00:59:23.283 INFO:tasks.workunit.client.0.trial069.stdout: "first_committed": 1, 2026-02-18T00:59:23.283 INFO:tasks.workunit.client.0.trial069.stdout: "last_committed": 3, 2026-02-18T00:59:23.283 INFO:tasks.workunit.client.0.trial069.stdout: "num_secrets": 1 2026-02-18T00:59:23.283 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:59:23.283 INFO:tasks.workunit.client.0.trial069.stdout: "num_pg": 4, 2026-02-18T00:59:23.283 INFO:tasks.workunit.client.0.trial069.stdout: "num_pg_active": 4, 2026-02-18T00:59:23.283 INFO:tasks.workunit.client.0.trial069.stdout: "num_pg_unknown": 0, 2026-02-18T00:59:23.283 INFO:tasks.workunit.client.0.trial069.stdout: "num_osd": 1, 2026-02-18T00:59:23.283 INFO:tasks.workunit.client.0.trial069.stdout: "pool_sum": { 2026-02-18T00:59:23.283 INFO:tasks.workunit.client.0.trial069.stdout: "stat_sum": { 2026-02-18T00:59:23.284 INFO:tasks.workunit.client.0.trial069.stdout: "num_bytes": 19, 2026-02-18T00:59:23.284 INFO:tasks.workunit.client.0.trial069.stdout: "num_objects": 2, 2026-02-18T00:59:23.284 INFO:tasks.workunit.client.0.trial069.stdout: "num_object_clones": 0, 2026-02-18T00:59:23.284 INFO:tasks.workunit.client.0.trial069.stdout: "num_object_copies": 4, 2026-02-18T00:59:23.284 INFO:tasks.workunit.client.0.trial069.stdout: "num_objects_missing_on_primary": 0, 2026-02-18T00:59:23.284 INFO:tasks.workunit.client.0.trial069.stdout: "num_objects_missing": 0, 2026-02-18T00:59:23.284 INFO:tasks.workunit.client.0.trial069.stdout: "num_objects_degraded": 2, 2026-02-18T00:59:23.284 INFO:tasks.workunit.client.0.trial069.stdout: "num_objects_misplaced": 0, 2026-02-18T00:59:23.284 INFO:tasks.workunit.client.0.trial069.stdout: "num_objects_unfound": 0, 2026-02-18T00:59:23.284 INFO:tasks.workunit.client.0.trial069.stdout: "num_objects_dirty": 2, 2026-02-18T00:59:23.284 INFO:tasks.workunit.client.0.trial069.stdout: "num_whiteouts": 0, 2026-02-18T00:59:23.284 INFO:tasks.workunit.client.0.trial069.stdout: "num_read": 0, 2026-02-18T00:59:23.284 INFO:tasks.workunit.client.0.trial069.stdout: "num_read_kb": 0, 2026-02-18T00:59:23.284 INFO:tasks.workunit.client.0.trial069.stdout: "num_write": 2, 2026-02-18T00:59:23.284 INFO:tasks.workunit.client.0.trial069.stdout: "num_write_kb": 2, 2026-02-18T00:59:23.284 INFO:tasks.workunit.client.0.trial069.stdout: "num_scrub_errors": 0, 2026-02-18T00:59:23.284 INFO:tasks.workunit.client.0.trial069.stdout: "num_shallow_scrub_errors": 0, 2026-02-18T00:59:23.284 INFO:tasks.workunit.client.0.trial069.stdout: "num_deep_scrub_errors": 0, 2026-02-18T00:59:23.284 INFO:tasks.workunit.client.0.trial069.stdout: "num_objects_recovered": 0, 2026-02-18T00:59:23.284 INFO:tasks.workunit.client.0.trial069.stdout: "num_bytes_recovered": 0, 2026-02-18T00:59:23.285 INFO:tasks.workunit.client.0.trial069.stdout: "num_keys_recovered": 0, 2026-02-18T00:59:23.285 INFO:tasks.workunit.client.0.trial069.stdout: "num_objects_omap": 0, 2026-02-18T00:59:23.285 INFO:tasks.workunit.client.0.trial069.stdout: "num_objects_hit_set_archive": 0, 2026-02-18T00:59:23.285 INFO:tasks.workunit.client.0.trial069.stdout: "num_bytes_hit_set_archive": 0, 2026-02-18T00:59:23.285 INFO:tasks.workunit.client.0.trial069.stdout: "num_flush": 0, 2026-02-18T00:59:23.285 INFO:tasks.workunit.client.0.trial069.stdout: "num_flush_kb": 0, 2026-02-18T00:59:23.285 INFO:tasks.workunit.client.0.trial069.stdout: "num_evict": 0, 2026-02-18T00:59:23.285 INFO:tasks.workunit.client.0.trial069.stdout: "num_evict_kb": 0, 2026-02-18T00:59:23.285 INFO:tasks.workunit.client.0.trial069.stdout: "num_promote": 0, 2026-02-18T00:59:23.285 INFO:tasks.workunit.client.0.trial069.stdout: "num_flush_mode_high": 0, 2026-02-18T00:59:23.285 INFO:tasks.workunit.client.0.trial069.stdout: "num_flush_mode_low": 0, 2026-02-18T00:59:23.285 INFO:tasks.workunit.client.0.trial069.stdout: "num_evict_mode_some": 0, 2026-02-18T00:59:23.285 INFO:tasks.workunit.client.0.trial069.stdout: "num_evict_mode_full": 0, 2026-02-18T00:59:23.285 INFO:tasks.workunit.client.0.trial069.stdout: "num_objects_pinned": 0, 2026-02-18T00:59:23.285 INFO:tasks.workunit.client.0.trial069.stdout: "num_legacy_snapsets": 0, 2026-02-18T00:59:23.285 INFO:tasks.workunit.client.0.trial069.stdout: "num_large_omap_objects": 0, 2026-02-18T00:59:23.285 INFO:tasks.workunit.client.0.trial069.stdout: "num_objects_manifest": 0, 2026-02-18T00:59:23.285 INFO:tasks.workunit.client.0.trial069.stdout: "num_omap_bytes": 0, 2026-02-18T00:59:23.285 INFO:tasks.workunit.client.0.trial069.stdout: "num_omap_keys": 0, 2026-02-18T00:59:23.285 INFO:tasks.workunit.client.0.trial069.stdout: "num_objects_repaired": 0 2026-02-18T00:59:23.286 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:59:23.286 INFO:tasks.workunit.client.0.trial069.stdout: "store_stats": { 2026-02-18T00:59:23.286 INFO:tasks.workunit.client.0.trial069.stdout: "total": 0, 2026-02-18T00:59:23.286 INFO:tasks.workunit.client.0.trial069.stdout: "available": 0, 2026-02-18T00:59:23.286 INFO:tasks.workunit.client.0.trial069.stdout: "internally_reserved": 0, 2026-02-18T00:59:23.286 INFO:tasks.workunit.client.0.trial069.stdout: "allocated": 0, 2026-02-18T00:59:23.286 INFO:tasks.workunit.client.0.trial069.stdout: "data_stored": 0, 2026-02-18T00:59:23.286 INFO:tasks.workunit.client.0.trial069.stdout: "data_compressed": 0, 2026-02-18T00:59:23.286 INFO:tasks.workunit.client.0.trial069.stdout: "data_compressed_allocated": 0, 2026-02-18T00:59:23.286 INFO:tasks.workunit.client.0.trial069.stdout: "data_compressed_original": 0, 2026-02-18T00:59:23.286 INFO:tasks.workunit.client.0.trial069.stdout: "omap_allocated": 0, 2026-02-18T00:59:23.286 INFO:tasks.workunit.client.0.trial069.stdout: "internal_metadata": 0 2026-02-18T00:59:23.286 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:59:23.286 INFO:tasks.workunit.client.0.trial069.stdout: "log_size": 3, 2026-02-18T00:59:23.286 INFO:tasks.workunit.client.0.trial069.stdout: "ondisk_log_size": 3, 2026-02-18T00:59:23.286 INFO:tasks.workunit.client.0.trial069.stdout: "up": 4, 2026-02-18T00:59:23.286 INFO:tasks.workunit.client.0.trial069.stdout: "acting": 4, 2026-02-18T00:59:23.286 INFO:tasks.workunit.client.0.trial069.stdout: "num_store_stats": 0 2026-02-18T00:59:23.286 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:59:23.286 INFO:tasks.workunit.client.0.trial069.stdout: "osd_sum": { 2026-02-18T00:59:23.286 INFO:tasks.workunit.client.0.trial069.stdout: "up_from": 0, 2026-02-18T00:59:23.287 INFO:tasks.workunit.client.0.trial069.stdout: "seq": 0, 2026-02-18T00:59:23.287 INFO:tasks.workunit.client.0.trial069.stdout: "num_pgs": 4, 2026-02-18T00:59:23.287 INFO:tasks.workunit.client.0.trial069.stdout: "num_osds": 1, 2026-02-18T00:59:23.287 INFO:tasks.workunit.client.0.trial069.stdout: "num_per_pool_osds": 1, 2026-02-18T00:59:23.287 INFO:tasks.workunit.client.0.trial069.stdout: "num_per_pool_omap_osds": 1, 2026-02-18T00:59:23.287 INFO:tasks.workunit.client.0.trial069.stdout: "kb": 104857600, 2026-02-18T00:59:23.287 INFO:tasks.workunit.client.0.trial069.stdout: "kb_used": 27048, 2026-02-18T00:59:23.287 INFO:tasks.workunit.client.0.trial069.stdout: "kb_used_data": 88, 2026-02-18T00:59:23.287 INFO:tasks.workunit.client.0.trial069.stdout: "kb_used_omap": 7, 2026-02-18T00:59:23.287 INFO:tasks.workunit.client.0.trial069.stdout: "kb_used_meta": 26936, 2026-02-18T00:59:23.287 INFO:tasks.workunit.client.0.trial069.stdout: "kb_avail": 104830552, 2026-02-18T00:59:23.287 INFO:tasks.workunit.client.0.trial069.stdout: "statfs": { 2026-02-18T00:59:23.287 INFO:tasks.workunit.client.0.trial069.stdout: "total": 107374182400, 2026-02-18T00:59:23.287 INFO:tasks.workunit.client.0.trial069.stdout: "available": 107346485248, 2026-02-18T00:59:23.287 INFO:tasks.workunit.client.0.trial069.stdout: "internally_reserved": 0, 2026-02-18T00:59:23.287 INFO:tasks.workunit.client.0.trial069.stdout: "allocated": 90112, 2026-02-18T00:59:23.288 INFO:tasks.workunit.client.0.trial069.stdout: "data_stored": 18391, 2026-02-18T00:59:23.288 INFO:tasks.workunit.client.0.trial069.stdout: "data_compressed": 0, 2026-02-18T00:59:23.288 INFO:tasks.workunit.client.0.trial069.stdout: "data_compressed_allocated": 0, 2026-02-18T00:59:23.288 INFO:tasks.workunit.client.0.trial069.stdout: "data_compressed_original": 0, 2026-02-18T00:59:23.288 INFO:tasks.workunit.client.0.trial069.stdout: "omap_allocated": 7484, 2026-02-18T00:59:23.288 INFO:tasks.workunit.client.0.trial069.stdout: "internal_metadata": 27583172 2026-02-18T00:59:23.288 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:59:23.288 INFO:tasks.workunit.client.0.trial069.stdout: "hb_peers": [], 2026-02-18T00:59:23.288 INFO:tasks.workunit.client.0.trial069.stdout: "snap_trim_queue_len": 0, 2026-02-18T00:59:23.288 INFO:tasks.workunit.client.0.trial069.stdout: "num_snap_trimming": 0, 2026-02-18T00:59:23.288 INFO:tasks.workunit.client.0.trial069.stdout: "num_shards_repaired": 0, 2026-02-18T00:59:23.288 INFO:tasks.workunit.client.0.trial069.stdout: "op_queue_age_hist": { 2026-02-18T00:59:23.288 INFO:tasks.workunit.client.0.trial069.stdout: "histogram": [], 2026-02-18T00:59:23.288 INFO:tasks.workunit.client.0.trial069.stdout: "upper_bound": 1 2026-02-18T00:59:23.288 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:59:23.288 INFO:tasks.workunit.client.0.trial069.stdout: "perf_stat": { 2026-02-18T00:59:23.288 INFO:tasks.workunit.client.0.trial069.stdout: "commit_latency_ms": 0, 2026-02-18T00:59:23.288 INFO:tasks.workunit.client.0.trial069.stdout: "apply_latency_ms": 0, 2026-02-18T00:59:23.288 INFO:tasks.workunit.client.0.trial069.stdout: "commit_latency_ns": 0, 2026-02-18T00:59:23.288 INFO:tasks.workunit.client.0.trial069.stdout: "apply_latency_ns": 0 2026-02-18T00:59:23.288 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:59:23.289 INFO:tasks.workunit.client.0.trial069.stdout: "alerts": [], 2026-02-18T00:59:23.289 INFO:tasks.workunit.client.0.trial069.stdout: "network_ping_times": [] 2026-02-18T00:59:23.289 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:59:23.289 INFO:tasks.workunit.client.0.trial069.stdout: "osd_sum_by_class": { 2026-02-18T00:59:23.289 INFO:tasks.workunit.client.0.trial069.stdout: "ssd": { 2026-02-18T00:59:23.289 INFO:tasks.workunit.client.0.trial069.stdout: "up_from": 0, 2026-02-18T00:59:23.289 INFO:tasks.workunit.client.0.trial069.stdout: "seq": 0, 2026-02-18T00:59:23.289 INFO:tasks.workunit.client.0.trial069.stdout: "num_pgs": 4, 2026-02-18T00:59:23.289 INFO:tasks.workunit.client.0.trial069.stdout: "num_osds": 1, 2026-02-18T00:59:23.289 INFO:tasks.workunit.client.0.trial069.stdout: "num_per_pool_osds": 1, 2026-02-18T00:59:23.289 INFO:tasks.workunit.client.0.trial069.stdout: "num_per_pool_omap_osds": 1, 2026-02-18T00:59:23.289 INFO:tasks.workunit.client.0.trial069.stdout: "kb": 104857600, 2026-02-18T00:59:23.289 INFO:tasks.workunit.client.0.trial069.stdout: "kb_used": 27048, 2026-02-18T00:59:23.289 INFO:tasks.workunit.client.0.trial069.stdout: "kb_used_data": 88, 2026-02-18T00:59:23.289 INFO:tasks.workunit.client.0.trial069.stdout: "kb_used_omap": 7, 2026-02-18T00:59:23.289 INFO:tasks.workunit.client.0.trial069.stdout: "kb_used_meta": 26936, 2026-02-18T00:59:23.289 INFO:tasks.workunit.client.0.trial069.stdout: "kb_avail": 104830552, 2026-02-18T00:59:23.289 INFO:tasks.workunit.client.0.trial069.stdout: "statfs": { 2026-02-18T00:59:23.289 INFO:tasks.workunit.client.0.trial069.stdout: "total": 107374182400, 2026-02-18T00:59:23.289 INFO:tasks.workunit.client.0.trial069.stdout: "available": 107346485248, 2026-02-18T00:59:23.290 INFO:tasks.workunit.client.0.trial069.stdout: "internally_reserved": 0, 2026-02-18T00:59:23.290 INFO:tasks.workunit.client.0.trial069.stdout: "allocated": 90112, 2026-02-18T00:59:23.290 INFO:tasks.workunit.client.0.trial069.stdout: "data_stored": 18391, 2026-02-18T00:59:23.290 INFO:tasks.workunit.client.0.trial069.stdout: "data_compressed": 0, 2026-02-18T00:59:23.290 INFO:tasks.workunit.client.0.trial069.stdout: "data_compressed_allocated": 0, 2026-02-18T00:59:23.290 INFO:tasks.workunit.client.0.trial069.stdout: "data_compressed_original": 0, 2026-02-18T00:59:23.290 INFO:tasks.workunit.client.0.trial069.stdout: "omap_allocated": 7484, 2026-02-18T00:59:23.290 INFO:tasks.workunit.client.0.trial069.stdout: "internal_metadata": 27583172 2026-02-18T00:59:23.290 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:59:23.290 INFO:tasks.workunit.client.0.trial069.stdout: "hb_peers": [], 2026-02-18T00:59:23.290 INFO:tasks.workunit.client.0.trial069.stdout: "snap_trim_queue_len": 0, 2026-02-18T00:59:23.290 INFO:tasks.workunit.client.0.trial069.stdout: "num_snap_trimming": 0, 2026-02-18T00:59:23.290 INFO:tasks.workunit.client.0.trial069.stdout: "num_shards_repaired": 0, 2026-02-18T00:59:23.290 INFO:tasks.workunit.client.0.trial069.stdout: "op_queue_age_hist": { 2026-02-18T00:59:23.290 INFO:tasks.workunit.client.0.trial069.stdout: "histogram": [], 2026-02-18T00:59:23.290 INFO:tasks.workunit.client.0.trial069.stdout: "upper_bound": 1 2026-02-18T00:59:23.290 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:59:23.290 INFO:tasks.workunit.client.0.trial069.stdout: "perf_stat": { 2026-02-18T00:59:23.290 INFO:tasks.workunit.client.0.trial069.stdout: "commit_latency_ms": 0, 2026-02-18T00:59:23.290 INFO:tasks.workunit.client.0.trial069.stdout: "apply_latency_ms": 0, 2026-02-18T00:59:23.290 INFO:tasks.workunit.client.0.trial069.stdout: "commit_latency_ns": 0, 2026-02-18T00:59:23.291 INFO:tasks.workunit.client.0.trial069.stdout: "apply_latency_ns": 0 2026-02-18T00:59:23.291 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:59:23.291 INFO:tasks.workunit.client.0.trial069.stdout: "alerts": [], 2026-02-18T00:59:23.291 INFO:tasks.workunit.client.0.trial069.stdout: "network_ping_times": [] 2026-02-18T00:59:23.291 INFO:tasks.workunit.client.0.trial069.stdout: } 2026-02-18T00:59:23.291 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:59:23.291 INFO:tasks.workunit.client.0.trial069.stdout: "pool_stats": [ 2026-02-18T00:59:23.291 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:59:23.291 INFO:tasks.workunit.client.0.trial069.stdout: "poolid": 1, 2026-02-18T00:59:23.291 INFO:tasks.workunit.client.0.trial069.stdout: "num_pg": 4, 2026-02-18T00:59:23.291 INFO:tasks.workunit.client.0.trial069.stdout: "stat_sum": { 2026-02-18T00:59:23.291 INFO:tasks.workunit.client.0.trial069.stdout: "num_bytes": 19, 2026-02-18T00:59:23.291 INFO:tasks.workunit.client.0.trial069.stdout: "num_objects": 2, 2026-02-18T00:59:23.291 INFO:tasks.workunit.client.0.trial069.stdout: "num_object_clones": 0, 2026-02-18T00:59:23.291 INFO:tasks.workunit.client.0.trial069.stdout: "num_object_copies": 4, 2026-02-18T00:59:23.291 INFO:tasks.workunit.client.0.trial069.stdout: "num_objects_missing_on_primary": 0, 2026-02-18T00:59:23.291 INFO:tasks.workunit.client.0.trial069.stdout: "num_objects_missing": 0, 2026-02-18T00:59:23.291 INFO:tasks.workunit.client.0.trial069.stdout: "num_objects_degraded": 2, 2026-02-18T00:59:23.291 INFO:tasks.workunit.client.0.trial069.stdout: "num_objects_misplaced": 0, 2026-02-18T00:59:23.291 INFO:tasks.workunit.client.0.trial069.stdout: "num_objects_unfound": 0, 2026-02-18T00:59:23.291 INFO:tasks.workunit.client.0.trial069.stdout: "num_objects_dirty": 2, 2026-02-18T00:59:23.291 INFO:tasks.workunit.client.0.trial069.stdout: "num_whiteouts": 0, 2026-02-18T00:59:23.292 INFO:tasks.workunit.client.0.trial069.stdout: "num_read": 0, 2026-02-18T00:59:23.292 INFO:tasks.workunit.client.0.trial069.stdout: "num_read_kb": 0, 2026-02-18T00:59:23.292 INFO:tasks.workunit.client.0.trial069.stdout: "num_write": 2, 2026-02-18T00:59:23.292 INFO:tasks.workunit.client.0.trial069.stdout: "num_write_kb": 2, 2026-02-18T00:59:23.292 INFO:tasks.workunit.client.0.trial069.stdout: "num_scrub_errors": 0, 2026-02-18T00:59:23.292 INFO:tasks.workunit.client.0.trial069.stdout: "num_shallow_scrub_errors": 0, 2026-02-18T00:59:23.292 INFO:tasks.workunit.client.0.trial069.stdout: "num_deep_scrub_errors": 0, 2026-02-18T00:59:23.292 INFO:tasks.workunit.client.0.trial069.stdout: "num_objects_recovered": 0, 2026-02-18T00:59:23.292 INFO:tasks.workunit.client.0.trial069.stdout: "num_bytes_recovered": 0, 2026-02-18T00:59:23.292 INFO:tasks.workunit.client.0.trial069.stdout: "num_keys_recovered": 0, 2026-02-18T00:59:23.292 INFO:tasks.workunit.client.0.trial069.stdout: "num_objects_omap": 0, 2026-02-18T00:59:23.292 INFO:tasks.workunit.client.0.trial069.stdout: "num_objects_hit_set_archive": 0, 2026-02-18T00:59:23.292 INFO:tasks.workunit.client.0.trial069.stdout: "num_bytes_hit_set_archive": 0, 2026-02-18T00:59:23.292 INFO:tasks.workunit.client.0.trial069.stdout: "num_flush": 0, 2026-02-18T00:59:23.292 INFO:tasks.workunit.client.0.trial069.stdout: "num_flush_kb": 0, 2026-02-18T00:59:23.292 INFO:tasks.workunit.client.0.trial069.stdout: "num_evict": 0, 2026-02-18T00:59:23.292 INFO:tasks.workunit.client.0.trial069.stdout: "num_evict_kb": 0, 2026-02-18T00:59:23.292 INFO:tasks.workunit.client.0.trial069.stdout: "num_promote": 0, 2026-02-18T00:59:23.292 INFO:tasks.workunit.client.0.trial069.stdout: "num_flush_mode_high": 0, 2026-02-18T00:59:23.292 INFO:tasks.workunit.client.0.trial069.stdout: "num_flush_mode_low": 0, 2026-02-18T00:59:23.292 INFO:tasks.workunit.client.0.trial069.stdout: "num_evict_mode_some": 0, 2026-02-18T00:59:23.292 INFO:tasks.workunit.client.0.trial069.stdout: "num_evict_mode_full": 0, 2026-02-18T00:59:23.292 INFO:tasks.workunit.client.0.trial069.stdout: "num_objects_pinned": 0, 2026-02-18T00:59:23.292 INFO:tasks.workunit.client.0.trial069.stdout: "num_legacy_snapsets": 0, 2026-02-18T00:59:23.293 INFO:tasks.workunit.client.0.trial069.stdout: "num_large_omap_objects": 0, 2026-02-18T00:59:23.293 INFO:tasks.workunit.client.0.trial069.stdout: "num_objects_manifest": 0, 2026-02-18T00:59:23.293 INFO:tasks.workunit.client.0.trial069.stdout: "num_omap_bytes": 0, 2026-02-18T00:59:23.293 INFO:tasks.workunit.client.0.trial069.stdout: "num_omap_keys": 0, 2026-02-18T00:59:23.293 INFO:tasks.workunit.client.0.trial069.stdout: "num_objects_repaired": 0 2026-02-18T00:59:23.293 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:59:23.293 INFO:tasks.workunit.client.0.trial069.stdout: "store_stats": { 2026-02-18T00:59:23.293 INFO:tasks.workunit.client.0.trial069.stdout: "total": 0, 2026-02-18T00:59:23.293 INFO:tasks.workunit.client.0.trial069.stdout: "available": 0, 2026-02-18T00:59:23.293 INFO:tasks.workunit.client.0.trial069.stdout: "internally_reserved": 0, 2026-02-18T00:59:23.293 INFO:tasks.workunit.client.0.trial069.stdout: "allocated": 4096, 2026-02-18T00:59:23.293 INFO:tasks.workunit.client.0.trial069.stdout: "data_stored": 19, 2026-02-18T00:59:23.293 INFO:tasks.workunit.client.0.trial069.stdout: "data_compressed": 0, 2026-02-18T00:59:23.293 INFO:tasks.workunit.client.0.trial069.stdout: "data_compressed_allocated": 0, 2026-02-18T00:59:23.293 INFO:tasks.workunit.client.0.trial069.stdout: "data_compressed_original": 0, 2026-02-18T00:59:23.293 INFO:tasks.workunit.client.0.trial069.stdout: "omap_allocated": 0, 2026-02-18T00:59:23.293 INFO:tasks.workunit.client.0.trial069.stdout: "internal_metadata": 0 2026-02-18T00:59:23.293 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:59:23.293 INFO:tasks.workunit.client.0.trial069.stdout: "log_size": 3, 2026-02-18T00:59:23.293 INFO:tasks.workunit.client.0.trial069.stdout: "ondisk_log_size": 3, 2026-02-18T00:59:23.293 INFO:tasks.workunit.client.0.trial069.stdout: "up": 4, 2026-02-18T00:59:23.293 INFO:tasks.workunit.client.0.trial069.stdout: "acting": 4, 2026-02-18T00:59:23.293 INFO:tasks.workunit.client.0.trial069.stdout: "num_store_stats": 1 2026-02-18T00:59:23.293 INFO:tasks.workunit.client.0.trial069.stdout: } 2026-02-18T00:59:23.293 INFO:tasks.workunit.client.0.trial069.stdout: ], 2026-02-18T00:59:23.294 INFO:tasks.workunit.client.0.trial069.stdout: "osd_stats": [ 2026-02-18T00:59:23.294 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:59:23.294 INFO:tasks.workunit.client.0.trial069.stdout: "osd": 0, 2026-02-18T00:59:23.294 INFO:tasks.workunit.client.0.trial069.stdout: "seq": 21474836481 2026-02-18T00:59:23.294 INFO:tasks.workunit.client.0.trial069.stdout: } 2026-02-18T00:59:23.294 INFO:tasks.workunit.client.0.trial069.stdout: ], 2026-02-18T00:59:23.294 INFO:tasks.workunit.client.0.trial069.stdout: "num_pg_by_state": [ 2026-02-18T00:59:23.294 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:59:23.294 INFO:tasks.workunit.client.0.trial069.stdout: "state": "active+undersized+degraded", 2026-02-18T00:59:23.294 INFO:tasks.workunit.client.0.trial069.stdout: "num": 2 2026-02-18T00:59:23.294 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:59:23.294 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:59:23.294 INFO:tasks.workunit.client.0.trial069.stdout: "state": "active+undersized", 2026-02-18T00:59:23.294 INFO:tasks.workunit.client.0.trial069.stdout: "num": 2 2026-02-18T00:59:23.294 INFO:tasks.workunit.client.0.trial069.stdout: } 2026-02-18T00:59:23.294 INFO:tasks.workunit.client.0.trial069.stdout: ], 2026-02-18T00:59:23.294 INFO:tasks.workunit.client.0.trial069.stdout: "pool_pg_unavailable_map": [ 2026-02-18T00:59:23.294 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:59:23.294 INFO:tasks.workunit.client.0.trial069.stdout: "poolid": "1", 2026-02-18T00:59:23.294 INFO:tasks.workunit.client.0.trial069.stdout: "pgs": [] 2026-02-18T00:59:23.294 INFO:tasks.workunit.client.0.trial069.stdout: } 2026-02-18T00:59:23.294 INFO:tasks.workunit.client.0.trial069.stdout: ], 2026-02-18T00:59:23.294 INFO:tasks.workunit.client.0.trial069.stdout: "num_pg_by_osd": [ 2026-02-18T00:59:23.294 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:59:23.294 INFO:tasks.workunit.client.0.trial069.stdout: "osd": 0, 2026-02-18T00:59:23.295 INFO:tasks.workunit.client.0.trial069.stdout: "num_primary_pg": 4, 2026-02-18T00:59:23.295 INFO:tasks.workunit.client.0.trial069.stdout: "num_acting_pg": 4, 2026-02-18T00:59:23.295 INFO:tasks.workunit.client.0.trial069.stdout: "num_up_not_acting_pg": 0 2026-02-18T00:59:23.295 INFO:tasks.workunit.client.0.trial069.stdout: } 2026-02-18T00:59:23.295 INFO:tasks.workunit.client.0.trial069.stdout: ], 2026-02-18T00:59:23.295 INFO:tasks.workunit.client.0.trial069.stdout: "purged_snaps": [ 2026-02-18T00:59:23.295 INFO:tasks.workunit.client.0.trial069.stdout: { 2026-02-18T00:59:23.295 INFO:tasks.workunit.client.0.trial069.stdout: "pool": 1, 2026-02-18T00:59:23.295 INFO:tasks.workunit.client.0.trial069.stdout: "purged_snaps": {} 2026-02-18T00:59:23.295 INFO:tasks.workunit.client.0.trial069.stdout: } 2026-02-18T00:59:23.295 INFO:tasks.workunit.client.0.trial069.stdout: ], 2026-02-18T00:59:23.295 INFO:tasks.workunit.client.0.trial069.stdout: "servicemap": { 2026-02-18T00:59:23.295 INFO:tasks.workunit.client.0.trial069.stdout: "epoch": 1, 2026-02-18T00:59:23.295 INFO:tasks.workunit.client.0.trial069.stdout: "modified": "2026-02-18T00:59:11.481365+0000", 2026-02-18T00:59:23.295 INFO:tasks.workunit.client.0.trial069.stdout: "services": {} 2026-02-18T00:59:23.295 INFO:tasks.workunit.client.0.trial069.stdout: }, 2026-02-18T00:59:23.295 INFO:tasks.workunit.client.0.trial069.stdout: "mgrstat_first_committed": 1, 2026-02-18T00:59:23.295 INFO:tasks.workunit.client.0.trial069.stdout: "mgrstat_last_committed": 4, 2026-02-18T00:59:23.295 INFO:tasks.workunit.client.0.trial069.stdout: "logm_first_committed": 1, 2026-02-18T00:59:23.295 INFO:tasks.workunit.client.0.trial069.stdout: "logm_last_committed": 59, 2026-02-18T00:59:23.295 INFO:tasks.workunit.client.0.trial069.stdout: "paxos": { 2026-02-18T00:59:23.295 INFO:tasks.workunit.client.0.trial069.stdout: "first_committed": 1, 2026-02-18T00:59:23.295 INFO:tasks.workunit.client.0.trial069.stdout: "last_committed": 84, 2026-02-18T00:59:23.295 INFO:tasks.workunit.client.0.trial069.stdout: "last_pn": 0, 2026-02-18T00:59:23.295 INFO:tasks.workunit.client.0.trial069.stdout: "accepted_pn": 0 2026-02-18T00:59:23.295 INFO:tasks.workunit.client.0.trial069.stdout: } 2026-02-18T00:59:23.296 INFO:tasks.workunit.client.0.trial069.stdout:} 2026-02-18T00:59:23.297 INFO:tasks.workunit.client.0.trial069.stderr:report 3293245269 2026-02-18T00:59:23.297 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: return 1 2026-02-18T00:59:23.297 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1774: test_wait_for_peered: run_osd td/ceph-helpers 1 2026-02-18T00:59:23.297 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/ceph-helpers 2026-02-18T00:59:23.297 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T00:59:23.297 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2026-02-18T00:59:23.298 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T00:59:23.298 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/ceph-helpers/1 2026-02-18T00:59:23.298 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--cluster ceph --fsid=863c4e35-ceb0-4172-b7b2-c3ff099e05a2 --auth-supported=none --mon-host=127.0.0.1:7109 ' 2026-02-18T00:59:23.298 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T00:59:23.298 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T00:59:23.298 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T00:59:23.298 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/ceph-helpers/1' 2026-02-18T00:59:23.298 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/ceph-helpers/1/journal' 2026-02-18T00:59:23.298 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T00:59:23.298 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-18T00:59:23.298 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/ceph-helpers' 2026-02-18T00:59:23.298 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T00:59:23.298 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:59:23.298 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:59:23.298 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:59:23.298 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:59:23.298 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:59:23.298 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.57427/$cluster-$name.asok' 2026-02-18T00:59:23.298 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' 2026-02-18T00:59:23.298 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T00:59:23.298 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T00:59:23.298 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T00:59:23.298 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/ceph-helpers/$name.log' 2026-02-18T00:59:23.298 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/ceph-helpers/$name.pid' 2026-02-18T00:59:23.298 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T00:59:23.299 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T00:59:23.299 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T00:59:23.299 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T00:59:23.299 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T00:59:23.299 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-18T00:59:23.299 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/ceph-helpers/1 2026-02-18T00:59:23.299 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T00:59:23.299 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=43a818bd-ba0b-4d30-a1ca-694be5d680e6 2026-02-18T00:59:23.299 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 43a818bd-ba0b-4d30-a1ca-694be5d680e6' 2026-02-18T00:59:23.299 INFO:tasks.workunit.client.0.trial069.stdout:add osd1 43a818bd-ba0b-4d30-a1ca-694be5d680e6 2026-02-18T00:59:23.299 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T00:59:23.299 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDrDpVpaMMNDxAAsSZ4KJ79hYyQ42Wm194kPA== 2026-02-18T00:59:23.299 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDrDpVpaMMNDxAAsSZ4KJ79hYyQ42Wm194kPA=="}' 2026-02-18T00:59:23.299 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 43a818bd-ba0b-4d30-a1ca-694be5d680e6 -i td/ceph-helpers/1/new.json 2026-02-18T00:59:23.478 INFO:tasks.workunit.client.0.trial069.stdout:1 2026-02-18T00:59:23.487 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/ceph-helpers/1/new.json 2026-02-18T00:59:23.488 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --cluster ceph --fsid=863c4e35-ceb0-4172-b7b2-c3ff099e05a2 --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/1 --osd-journal=td/ceph-helpers/1/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDrDpVpaMMNDxAAsSZ4KJ79hYyQ42Wm194kPA== --osd-uuid 43a818bd-ba0b-4d30-a1ca-694be5d680e6 2026-02-18T00:59:23.505 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:59:23.488+0000 7f3200698a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:59:23.506 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:59:23.492+0000 7f3200698a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:59:23.507 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:59:23.492+0000 7f3200698a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:59:23.507 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:59:23.492+0000 7f3200698a40 -1 bdev(0x5585e0e10c00 td/ceph-helpers/1/block) open stat got: (1) Operation not permitted 2026-02-18T00:59:23.508 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:59:23.492+0000 7f3200698a40 -1 bluestore(td/ceph-helpers/1) _read_fsid unparsable uuid 2026-02-18T00:59:24.176 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/ceph-helpers/1/keyring 2026-02-18T00:59:24.176 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T00:59:24.177 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2026-02-18T00:59:24.177 INFO:tasks.workunit.client.0.trial069.stdout:adding osd1 key to auth repository 2026-02-18T00:59:24.178 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/ceph-helpers/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T00:59:24.452 INFO:tasks.workunit.client.0.trial069.stdout:start osd.1 2026-02-18T00:59:24.453 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2026-02-18T00:59:24.453 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --cluster ceph --fsid=863c4e35-ceb0-4172-b7b2-c3ff099e05a2 --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/1 --osd-journal=td/ceph-helpers/1/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T00:59:24.453 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T00:59:24.453 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T00:59:24.453 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T00:59:24.475 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:59:24.460+0000 7fae69a67a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:59:24.477 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:59:24.460+0000 7fae69a67a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:59:24.478 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:59:24.464+0000 7fae69a67a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:59:24.669 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2026-02-18T00:59:24.669 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:59:24.670 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-18T00:59:24.670 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:59:24.670 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:59:24.670 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:59:24.670 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:59:24.670 INFO:tasks.workunit.client.0.trial069.stdout:0 2026-02-18T00:59:24.671 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:59:24.671 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-18T00:59:24.878 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:59:24.882 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:59:24.868+0000 7fae69a67a40 -1 Falling back to public interface 2026-02-18T00:59:25.486 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:59:25.472+0000 7fae69a67a40 -1 osd.1 0 log_to_monitors true 2026-02-18T00:59:25.879 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:59:25.879 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:59:25.879 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T00:59:25.879 INFO:tasks.workunit.client.0.trial069.stdout:1 2026-02-18T00:59:25.880 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:59:25.880 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-18T00:59:26.089 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:59:27.091 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:59:27.091 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:59:27.092 INFO:tasks.workunit.client.0.trial069.stdout:2 2026-02-18T00:59:27.092 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-18T00:59:27.093 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:59:27.093 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-18T00:59:27.296 INFO:tasks.workunit.client.0.trial069.stdout:osd.1 up in weight 1 up_from 16 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/2261094759,v1:127.0.0.1:6811/2261094759] [v2:127.0.0.1:6812/2261094759,v1:127.0.0.1:6813/2261094759] exists,up 43a818bd-ba0b-4d30-a1ca-694be5d680e6 2026-02-18T00:59:27.298 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:59:27.298 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:59:27.298 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:59:27.298 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1775: test_wait_for_peered: wait_for_peered 2026-02-18T00:59:27.298 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1731: wait_for_peered: local cmd= 2026-02-18T00:59:27.299 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1732: wait_for_peered: local num_peered=-1 2026-02-18T00:59:27.299 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1733: wait_for_peered: local cur_peered 2026-02-18T00:59:27.299 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1734: wait_for_peered: get_timeout_delays 90 .1 2026-02-18T00:59:27.299 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-18T00:59:27.299 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-18T00:59:27.299 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-18T00:59:27.299 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-18T00:59:27.299 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-18T00:59:27.399 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1734: wait_for_peered: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-18T00:59:27.400 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1734: wait_for_peered: local -a delays 2026-02-18T00:59:27.400 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1735: wait_for_peered: local -i loop=0 2026-02-18T00:59:27.400 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1737: wait_for_peered: flush_pg_stats 2026-02-18T00:59:27.400 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-18T00:59:27.400 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-18T00:59:27.618 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-18T00:59:27.619 INFO:tasks.workunit.client.0.trial069.stderr:1' 2026-02-18T00:59:27.619 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-18T00:59:27.619 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:59:27.619 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-18T00:59:27.695 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836485 2026-02-18T00:59:27.695 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836485 2026-02-18T00:59:27.696 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836485' 2026-02-18T00:59:27.696 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:59:27.696 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-18T00:59:27.774 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=68719476739 2026-02-18T00:59:27.774 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 68719476739 2026-02-18T00:59:27.774 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836485 1-68719476739' 2026-02-18T00:59:27.775 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:59:27.775 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836485 2026-02-18T00:59:27.775 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:59:27.775 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-18T00:59:27.776 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-21474836485 2026-02-18T00:59:27.776 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:59:27.778 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=21474836485 2026-02-18T00:59:27.778 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 21474836485' 2026-02-18T00:59:27.778 INFO:tasks.workunit.client.0.trial069.stdout:waiting osd.0 seq 21474836485 2026-02-18T00:59:27.778 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T00:59:27.983 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 21474836482 -lt 21474836485 2026-02-18T00:59:27.983 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-18T00:59:28.985 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-18T00:59:28.985 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T00:59:29.200 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 21474836482 -lt 21474836485 2026-02-18T00:59:29.201 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-18T00:59:30.201 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-18T00:59:30.202 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T00:59:30.408 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 21474836485 -lt 21474836485 2026-02-18T00:59:30.408 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:59:30.408 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-68719476739 2026-02-18T00:59:30.408 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:59:30.410 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=1 2026-02-18T00:59:30.410 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 1-68719476739 2026-02-18T00:59:30.410 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:59:30.412 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=68719476739 2026-02-18T00:59:30.412 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.1 seq 68719476739' 2026-02-18T00:59:30.412 INFO:tasks.workunit.client.0.trial069.stdout:waiting osd.1 seq 68719476739 2026-02-18T00:59:30.412 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-18T00:59:30.631 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 68719476739 -lt 68719476739 2026-02-18T00:59:30.633 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1738: wait_for_peered: get_num_pgs 2026-02-18T00:59:30.633 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T00:59:30.633 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T00:59:30.909 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1738: wait_for_peered: test 4 == 0 2026-02-18T00:59:30.910 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1742: wait_for_peered: true 2026-02-18T00:59:30.910 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_peered: get_num_active_or_peered 2026-02-18T00:59:30.910 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1385: get_num_active_or_peered: local expression 2026-02-18T00:59:30.910 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1386: get_num_active_or_peered: expression+='select(contains("active") or contains("peered")) | ' 2026-02-18T00:59:30.910 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1387: get_num_active_or_peered: expression+='select(contains("stale") | not)' 2026-02-18T00:59:30.911 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1388: get_num_active_or_peered: ceph --format json pg dump pgs 2026-02-18T00:59:30.911 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1389: get_num_active_or_peered: jq '.pg_stats | [.[] | .state | select(contains("active") or contains("peered")) | select(contains("stale") | not)] | length' 2026-02-18T00:59:31.114 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_peered: cur_peered=4 2026-02-18T00:59:31.114 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1747: wait_for_peered: get_num_pgs 2026-02-18T00:59:31.115 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T00:59:31.115 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T00:59:31.397 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1747: wait_for_peered: test 4 = 4 2026-02-18T00:59:31.397 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1747: wait_for_peered: break 2026-02-18T00:59:31.397 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1762: wait_for_peered: return 0 2026-02-18T00:59:31.397 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1776: test_wait_for_peered: teardown td/ceph-helpers 2026-02-18T00:59:31.398 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/ceph-helpers 2026-02-18T00:59:31.398 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T00:59:31.398 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/ceph-helpers KILL 2026-02-18T00:59:31.398 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:59:31.398 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:59:31.398 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:59:31.398 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:59:31.398 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:59:31.507 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:59:31.507 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T00:59:31.508 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T00:59:31.508 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T00:59:31.509 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T00:59:31.509 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T00:59:31.510 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T00:59:31.511 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:59:31.511 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T00:59:31.511 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T00:59:31.511 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:59:31.513 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T00:59:31.513 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T00:59:31.514 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/ceph-helpers 2026-02-18T00:59:31.520 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T00:59:31.520 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:59:31.520 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:59:31.520 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.57427 2026-02-18T00:59:31.521 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T00:59:31.521 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T00:59:31.521 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2426: run_tests: for func in $funcs 2026-02-18T00:59:31.521 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2427: run_tests: test_wait_for_scrub td/ceph-helpers 2026-02-18T00:59:31.521 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: test_wait_for_scrub: local dir=td/ceph-helpers 2026-02-18T00:59:31.522 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2079: test_wait_for_scrub: setup td/ceph-helpers 2026-02-18T00:59:31.522 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/ceph-helpers 2026-02-18T00:59:31.522 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/ceph-helpers 2026-02-18T00:59:31.522 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/ceph-helpers 2026-02-18T00:59:31.522 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T00:59:31.522 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/ceph-helpers KILL 2026-02-18T00:59:31.522 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:59:31.522 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:59:31.522 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:59:31.522 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:59:31.522 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:59:31.524 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:59:31.524 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T00:59:31.525 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T00:59:31.526 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T00:59:31.527 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T00:59:31.527 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T00:59:31.527 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T00:59:31.528 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:59:31.528 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T00:59:31.529 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T00:59:31.529 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:59:31.530 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T00:59:31.531 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T00:59:31.531 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/ceph-helpers 2026-02-18T00:59:31.532 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T00:59:31.532 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:59:31.532 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:59:31.532 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.57427 2026-02-18T00:59:31.533 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T00:59:31.533 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T00:59:31.533 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/ceph-helpers 2026-02-18T00:59:31.535 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-18T00:59:31.535 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:59:31.535 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:59:31.535 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.57427 2026-02-18T00:59:31.537 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-18T00:59:31.537 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-18T00:59:31.537 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-18T00:59:31.537 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/ceph-helpers 1' TERM HUP INT 2026-02-18T00:59:31.537 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: test_wait_for_scrub: run_mon td/ceph-helpers a --osd_pool_default_size=1 --mon_allow_pool_size_one=true 2026-02-18T00:59:31.537 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/ceph-helpers 2026-02-18T00:59:31.537 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-18T00:59:31.537 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-18T00:59:31.537 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-18T00:59:31.537 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/ceph-helpers/a 2026-02-18T00:59:31.537 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/ceph-helpers/a --run-dir=td/ceph-helpers --osd_pool_default_size=1 --mon_allow_pool_size_one=true 2026-02-18T00:59:31.559 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-18T00:59:31.559 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:59:31.559 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:59:31.559 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:59:31.559 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:59:31.559 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:59:31.560 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.57427/$cluster-$name.asok' 2026-02-18T00:59:31.560 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/ceph-helpers/a '--log-file=td/ceph-helpers/$name.log' '--admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' --mon-cluster-log-file=td/ceph-helpers/log --run-dir=td/ceph-helpers '--pid-file=td/ceph-helpers/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --osd_pool_default_size=1 --mon_allow_pool_size_one=true 2026-02-18T00:59:31.590 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-18T00:59:31.591 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-18T00:59:31.591 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T00:59:31.591 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-18T00:59:31.591 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-18T00:59:31.591 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-18T00:59:31.591 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-18T00:59:31.591 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:59:31.592 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:59:31.592 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:59:31.592 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:59:31.592 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:59:31.592 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.57427/ceph-mon.a.asok 2026-02-18T00:59:31.593 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T00:59:31.593 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.57427/ceph-mon.a.asok config get fsid 2026-02-18T00:59:31.658 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-18T00:59:31.658 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T00:59:31.658 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-18T00:59:31.658 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-18T00:59:31.658 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-18T00:59:31.658 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-18T00:59:31.658 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:59:31.658 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:59:31.659 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:59:31.659 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:59:31.659 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:59:31.659 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.57427/ceph-mon.a.asok 2026-02-18T00:59:31.659 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T00:59:31.659 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.57427/ceph-mon.a.asok config get mon_host 2026-02-18T00:59:31.715 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: test_wait_for_scrub: run_mgr td/ceph-helpers x 2026-02-18T00:59:31.716 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/ceph-helpers 2026-02-18T00:59:31.716 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-18T00:59:31.716 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-18T00:59:31.716 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-18T00:59:31.716 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/ceph-helpers/x 2026-02-18T00:59:31.716 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-18T00:59:31.828 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-18T00:59:31.828 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:59:31.829 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:59:31.829 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:59:31.829 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:59:31.829 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:59:31.829 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.57427/$cluster-$name.asok' 2026-02-18T00:59:31.830 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-18T00:59:31.830 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/ceph-helpers/x '--log-file=td/ceph-helpers/$name.log' '--admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' --run-dir=td/ceph-helpers '--pid-file=td/ceph-helpers/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-18T00:59:31.850 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: test_wait_for_scrub: run_osd td/ceph-helpers 0 2026-02-18T00:59:31.850 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/ceph-helpers 2026-02-18T00:59:31.850 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T00:59:31.850 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-18T00:59:31.850 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T00:59:31.851 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/ceph-helpers/0 2026-02-18T00:59:31.851 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--cluster ceph --fsid=863c4e35-ceb0-4172-b7b2-c3ff099e05a2 --auth-supported=none --mon-host=127.0.0.1:7109 ' 2026-02-18T00:59:31.851 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T00:59:31.851 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T00:59:31.851 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T00:59:31.851 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/ceph-helpers/0' 2026-02-18T00:59:31.851 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/ceph-helpers/0/journal' 2026-02-18T00:59:31.851 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T00:59:31.851 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-18T00:59:31.851 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/ceph-helpers' 2026-02-18T00:59:31.851 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T00:59:31.851 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:59:31.852 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:59:31.852 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:59:31.852 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:59:31.852 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:59:31.852 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.57427/$cluster-$name.asok' 2026-02-18T00:59:31.852 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' 2026-02-18T00:59:31.852 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T00:59:31.852 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T00:59:31.852 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T00:59:31.852 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/ceph-helpers/$name.log' 2026-02-18T00:59:31.852 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/ceph-helpers/$name.pid' 2026-02-18T00:59:31.852 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T00:59:31.852 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T00:59:31.853 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T00:59:31.853 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T00:59:31.853 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T00:59:31.853 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-18T00:59:31.853 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/ceph-helpers/0 2026-02-18T00:59:31.854 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T00:59:31.854 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=1db68acc-c679-4e77-a9b1-bd5e611b3e82 2026-02-18T00:59:31.854 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 1db68acc-c679-4e77-a9b1-bd5e611b3e82' 2026-02-18T00:59:31.854 INFO:tasks.workunit.client.0.trial069.stdout:add osd0 1db68acc-c679-4e77-a9b1-bd5e611b3e82 2026-02-18T00:59:31.854 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T00:59:31.863 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDzDpVpdFnXMhAA3II61QWXxxUqf+YFLz9wSQ== 2026-02-18T00:59:31.863 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDzDpVpdFnXMhAA3II61QWXxxUqf+YFLz9wSQ=="}' 2026-02-18T00:59:31.863 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 1db68acc-c679-4e77-a9b1-bd5e611b3e82 -i td/ceph-helpers/0/new.json 2026-02-18T00:59:31.978 INFO:tasks.workunit.client.0.trial069.stdout:0 2026-02-18T00:59:31.986 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/ceph-helpers/0/new.json 2026-02-18T00:59:31.987 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --cluster ceph --fsid=863c4e35-ceb0-4172-b7b2-c3ff099e05a2 --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/0 --osd-journal=td/ceph-helpers/0/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDzDpVpdFnXMhAA3II61QWXxxUqf+YFLz9wSQ== --osd-uuid 1db68acc-c679-4e77-a9b1-bd5e611b3e82 2026-02-18T00:59:32.003 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:59:31.987+0000 7f455a75da40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:59:32.005 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:59:31.991+0000 7f455a75da40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:59:32.006 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:59:31.991+0000 7f455a75da40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:59:32.007 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:59:31.991+0000 7f455a75da40 -1 bdev(0x5595ec514c00 td/ceph-helpers/0/block) open stat got: (1) Operation not permitted 2026-02-18T00:59:32.007 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:59:31.991+0000 7f455a75da40 -1 bluestore(td/ceph-helpers/0) _read_fsid unparsable uuid 2026-02-18T00:59:32.696 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/ceph-helpers/0/keyring 2026-02-18T00:59:32.696 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T00:59:32.697 INFO:tasks.workunit.client.0.trial069.stdout:adding osd0 key to auth repository 2026-02-18T00:59:32.697 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-18T00:59:32.697 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/ceph-helpers/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T00:59:32.814 INFO:tasks.workunit.client.0.trial069.stdout:start osd.0 2026-02-18T00:59:32.815 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-18T00:59:32.815 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --cluster ceph --fsid=863c4e35-ceb0-4172-b7b2-c3ff099e05a2 --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/0 --osd-journal=td/ceph-helpers/0/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T00:59:32.815 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T00:59:32.815 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T00:59:32.816 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T00:59:32.830 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:59:32.815+0000 7ff7fb10ea40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:59:32.832 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:59:32.815+0000 7ff7fb10ea40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:59:32.832 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:59:32.815+0000 7ff7fb10ea40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:59:32.925 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-18T00:59:32.926 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:59:32.926 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-18T00:59:32.926 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:59:32.926 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:59:32.926 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:59:32.927 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:59:32.928 INFO:tasks.workunit.client.0.trial069.stdout:0 2026-02-18T00:59:32.928 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:59:32.929 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T00:59:33.035 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:59:33.187 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:59:33.171+0000 7ff7fb10ea40 -1 Falling back to public interface 2026-02-18T00:59:33.810 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:59:33.795+0000 7ff7fb10ea40 -1 osd.0 0 log_to_monitors true 2026-02-18T00:59:34.037 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:59:34.037 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:59:34.038 INFO:tasks.workunit.client.0.trial069.stdout:1 2026-02-18T00:59:34.039 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T00:59:34.039 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:59:34.039 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T00:59:34.157 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:59:35.159 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:59:35.159 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:59:35.160 INFO:tasks.workunit.client.0.trial069.stdout:2 2026-02-18T00:59:35.160 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-18T00:59:35.160 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:59:35.160 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T00:59:35.365 INFO:tasks.workunit.client.0.trial069.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/622249572,v1:127.0.0.1:6801/622249572] [v2:127.0.0.1:6802/622249572,v1:127.0.0.1:6803/622249572] exists,up 1db68acc-c679-4e77-a9b1-bd5e611b3e82 2026-02-18T00:59:35.366 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:59:35.366 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:59:35.366 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:59:35.367 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: test_wait_for_scrub: create_rbd_pool 2026-02-18T00:59:35.367 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:526: create_rbd_pool: ceph osd pool delete rbd rbd --yes-i-really-really-mean-it 2026-02-18T00:59:35.563 INFO:tasks.workunit.client.0.trial069.stderr:pool 'rbd' does not exist 2026-02-18T00:59:35.572 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:527: create_rbd_pool: create_pool rbd 4 2026-02-18T00:59:35.572 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create rbd 4 2026-02-18T00:59:35.846 INFO:tasks.workunit.client.0.trial069.stderr:pool 'rbd' already exists 2026-02-18T00:59:35.855 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-18T00:59:36.856 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:528: create_rbd_pool: rbd pool init rbd 2026-02-18T00:59:37.172 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: test_wait_for_scrub: wait_for_clean 2026-02-18T00:59:37.172 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-18T00:59:37.172 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-18T00:59:37.172 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-18T00:59:37.172 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-18T00:59:37.173 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-18T00:59:37.173 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-18T00:59:37.173 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-18T00:59:37.173 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-18T00:59:37.173 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-18T00:59:37.276 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-18T00:59:37.277 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-18T00:59:37.277 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-18T00:59:37.277 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-18T00:59:37.277 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-18T00:59:37.277 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-18T00:59:37.500 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids=0 2026-02-18T00:59:37.500 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-18T00:59:37.500 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:59:37.500 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-18T00:59:37.578 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836483 2026-02-18T00:59:37.578 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836483 2026-02-18T00:59:37.578 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836483' 2026-02-18T00:59:37.578 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:59:37.578 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836483 2026-02-18T00:59:37.578 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:59:37.579 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-18T00:59:37.580 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-21474836483 2026-02-18T00:59:37.580 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:59:37.581 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=21474836483 2026-02-18T00:59:37.581 INFO:tasks.workunit.client.0.trial069.stdout:waiting osd.0 seq 21474836483 2026-02-18T00:59:37.582 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 21474836483' 2026-02-18T00:59:37.582 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T00:59:37.796 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 21474836481 -lt 21474836483 2026-02-18T00:59:37.797 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-18T00:59:38.797 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-18T00:59:38.798 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T00:59:39.004 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 21474836483 -lt 21474836483 2026-02-18T00:59:39.004 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-18T00:59:39.005 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T00:59:39.005 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T00:59:39.291 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 4 == 0 2026-02-18T00:59:39.292 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-18T00:59:39.292 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-18T00:59:39.292 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-18T00:59:39.292 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-18T00:59:39.292 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-18T00:59:39.293 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-18T00:59:39.293 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-18T00:59:39.501 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=4 2026-02-18T00:59:39.501 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-18T00:59:39.502 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T00:59:39.502 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T00:59:39.783 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 4 = 4 2026-02-18T00:59:39.783 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-18T00:59:39.783 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-18T00:59:39.783 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2085: test_wait_for_scrub: local pgid=1.0 2026-02-18T00:59:39.783 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2086: test_wait_for_scrub: ceph pg repair 1.0 2026-02-18T00:59:39.983 INFO:tasks.workunit.client.0.trial069.stderr:instructing pg 1.0 on osd.0 to repair 2026-02-18T00:59:39.992 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2087: test_wait_for_scrub: get_last_scrub_stamp 1.0 2026-02-18T00:59:39.993 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-18T00:59:39.993 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-18T00:59:39.993 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-18T00:59:39.993 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-18T00:59:40.208 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2087: test_wait_for_scrub: local last_scrub=2026-02-18T00:59:35.781967+0000 2026-02-18T00:59:40.208 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2088: test_wait_for_scrub: wait_for_scrub 1.0 2026-02-18T00:59:35.781967+0000 2026-02-18T00:59:40.208 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2063: wait_for_scrub: local pgid=1.0 2026-02-18T00:59:40.209 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2064: wait_for_scrub: local last_scrub=2026-02-18T00:59:35.781967+0000 2026-02-18T00:59:40.209 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2065: wait_for_scrub: local sname=last_scrub_stamp 2026-02-18T00:59:40.209 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i=0 )) 2026-02-18T00:59:40.209 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-18T00:59:40.209 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-18T00:59:40.209 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-18T00:59:40.209 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-18T00:59:40.209 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-18T00:59:40.209 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-18T00:59:40.415 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-18T00:59:35.781967+0000 '>' 2026-02-18T00:59:35.781967+0000 2026-02-18T00:59:40.415 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-18T00:59:41.416 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-18T00:59:41.416 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-18T00:59:41.417 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-18T00:59:41.417 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-18T00:59:41.417 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-18T00:59:41.417 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-18T00:59:41.417 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-18T00:59:41.636 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-18T00:59:35.781967+0000 '>' 2026-02-18T00:59:35.781967+0000 2026-02-18T00:59:41.636 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-18T00:59:42.637 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-18T00:59:42.638 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-18T00:59:42.638 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-18T00:59:42.638 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-18T00:59:42.638 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-18T00:59:42.638 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-18T00:59:42.638 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-18T00:59:42.854 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-18T00:59:35.781967+0000 '>' 2026-02-18T00:59:35.781967+0000 2026-02-18T00:59:42.855 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-18T00:59:43.855 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-18T00:59:43.855 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-18T00:59:43.856 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-18T00:59:43.856 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-18T00:59:43.856 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-18T00:59:43.857 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-18T00:59:43.857 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-18T00:59:44.065 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-18T00:59:35.781967+0000 '>' 2026-02-18T00:59:35.781967+0000 2026-02-18T00:59:44.065 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-18T00:59:45.066 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-18T00:59:45.066 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-18T00:59:45.066 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-18T00:59:45.066 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-18T00:59:45.066 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-18T00:59:45.067 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-18T00:59:45.067 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-18T00:59:45.287 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-18T00:59:35.781967+0000 '>' 2026-02-18T00:59:35.781967+0000 2026-02-18T00:59:45.287 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-18T00:59:46.288 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-18T00:59:46.288 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-18T00:59:46.289 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-18T00:59:46.289 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-18T00:59:46.289 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-18T00:59:46.289 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-18T00:59:46.289 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-18T00:59:46.505 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-18T00:59:40.800148+0000 '>' 2026-02-18T00:59:35.781967+0000 2026-02-18T00:59:46.505 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: wait_for_scrub: return 0 2026-02-18T00:59:46.505 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2089: test_wait_for_scrub: kill_daemons td/ceph-helpers KILL osd 2026-02-18T00:59:46.505 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:59:46.505 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:59:46.506 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:59:46.506 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:59:46.506 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:59:46.612 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:59:46.612 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2090: test_wait_for_scrub: get_last_scrub_stamp 1.0 2026-02-18T00:59:46.613 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-18T00:59:46.613 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-18T00:59:46.613 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-18T00:59:46.613 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-18T00:59:46.829 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2090: test_wait_for_scrub: last_scrub=2026-02-18T00:59:40.800148+0000 2026-02-18T00:59:46.829 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2091: test_wait_for_scrub: TIMEOUT=2 2026-02-18T00:59:46.829 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2091: test_wait_for_scrub: wait_for_scrub 1.0 2026-02-18T00:59:40.800148+0000 2026-02-18T00:59:46.829 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2063: wait_for_scrub: local pgid=1.0 2026-02-18T00:59:46.829 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2064: wait_for_scrub: local last_scrub=2026-02-18T00:59:40.800148+0000 2026-02-18T00:59:46.829 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2065: wait_for_scrub: local sname=last_scrub_stamp 2026-02-18T00:59:46.829 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i=0 )) 2026-02-18T00:59:46.829 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 2 )) 2026-02-18T00:59:46.830 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-18T00:59:46.830 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-18T00:59:46.830 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-18T00:59:46.830 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-18T00:59:46.830 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-18T00:59:47.041 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-18T00:59:40.800148+0000 '>' 2026-02-18T00:59:40.800148+0000 2026-02-18T00:59:47.041 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-18T00:59:48.042 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-18T00:59:48.042 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 2 )) 2026-02-18T00:59:48.042 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-18T00:59:48.043 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-18T00:59:48.043 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-18T00:59:48.043 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-18T00:59:48.043 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-18T00:59:48.255 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-18T00:59:40.800148+0000 '>' 2026-02-18T00:59:40.800148+0000 2026-02-18T00:59:48.256 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-18T00:59:49.256 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-18T00:59:49.256 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 2 )) 2026-02-18T00:59:49.256 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: wait_for_scrub: return 1 2026-02-18T00:59:49.256 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2092: test_wait_for_scrub: teardown td/ceph-helpers 2026-02-18T00:59:49.256 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/ceph-helpers 2026-02-18T00:59:49.256 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T00:59:49.256 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/ceph-helpers KILL 2026-02-18T00:59:49.257 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:59:49.257 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:59:49.257 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:59:49.257 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:59:49.257 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:59:49.367 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:59:49.367 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T00:59:49.368 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T00:59:49.369 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T00:59:49.370 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T00:59:49.370 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T00:59:49.370 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T00:59:49.371 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:59:49.371 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T00:59:49.372 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T00:59:49.372 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:59:49.373 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T00:59:49.374 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T00:59:49.374 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/ceph-helpers 2026-02-18T00:59:49.379 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T00:59:49.379 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:59:49.379 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:59:49.380 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.57427 2026-02-18T00:59:49.381 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T00:59:49.381 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T00:59:49.381 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2426: run_tests: for func in $funcs 2026-02-18T00:59:49.381 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2427: run_tests: test_wait_osd_id_used_by_pgs td/ceph-helpers 2026-02-18T00:59:49.381 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1492: test_wait_osd_id_used_by_pgs: local dir=td/ceph-helpers 2026-02-18T00:59:49.381 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1494: test_wait_osd_id_used_by_pgs: setup td/ceph-helpers 2026-02-18T00:59:49.381 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/ceph-helpers 2026-02-18T00:59:49.381 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/ceph-helpers 2026-02-18T00:59:49.381 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/ceph-helpers 2026-02-18T00:59:49.381 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T00:59:49.381 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/ceph-helpers KILL 2026-02-18T00:59:49.382 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:59:49.382 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:59:49.382 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:59:49.382 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:59:49.382 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:59:49.384 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:59:49.385 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T00:59:49.386 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T00:59:49.386 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T00:59:49.387 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T00:59:49.387 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T00:59:49.388 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T00:59:49.389 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:59:49.389 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T00:59:49.389 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T00:59:49.389 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:59:49.391 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T00:59:49.392 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T00:59:49.392 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/ceph-helpers 2026-02-18T00:59:49.393 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T00:59:49.394 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:59:49.394 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:59:49.394 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.57427 2026-02-18T00:59:49.395 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T00:59:49.395 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T00:59:49.395 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/ceph-helpers 2026-02-18T00:59:49.396 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-18T00:59:49.396 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:59:49.397 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:59:49.397 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.57427 2026-02-18T00:59:49.398 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-18T00:59:49.399 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-18T00:59:49.399 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-18T00:59:49.400 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/ceph-helpers 1' TERM HUP INT 2026-02-18T00:59:49.400 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1495: test_wait_osd_id_used_by_pgs: run_mon td/ceph-helpers a --osd_pool_default_size=1 --mon_allow_pool_size_one=true 2026-02-18T00:59:49.400 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/ceph-helpers 2026-02-18T00:59:49.400 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-18T00:59:49.400 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-18T00:59:49.400 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-18T00:59:49.400 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/ceph-helpers/a 2026-02-18T00:59:49.400 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/ceph-helpers/a --run-dir=td/ceph-helpers --osd_pool_default_size=1 --mon_allow_pool_size_one=true 2026-02-18T00:59:49.422 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-18T00:59:49.422 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:59:49.422 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:59:49.422 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:59:49.422 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:59:49.423 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:59:49.423 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.57427/$cluster-$name.asok' 2026-02-18T00:59:49.423 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/ceph-helpers/a '--log-file=td/ceph-helpers/$name.log' '--admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' --mon-cluster-log-file=td/ceph-helpers/log --run-dir=td/ceph-helpers '--pid-file=td/ceph-helpers/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --osd_pool_default_size=1 --mon_allow_pool_size_one=true 2026-02-18T00:59:49.452 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-18T00:59:49.453 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-18T00:59:49.453 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T00:59:49.453 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-18T00:59:49.453 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-18T00:59:49.453 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-18T00:59:49.455 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-18T00:59:49.455 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:59:49.455 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:59:49.455 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:59:49.455 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:59:49.455 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:59:49.455 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.57427/ceph-mon.a.asok 2026-02-18T00:59:49.455 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T00:59:49.455 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.57427/ceph-mon.a.asok config get fsid 2026-02-18T00:59:49.510 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-18T00:59:49.511 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T00:59:49.511 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-18T00:59:49.511 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-18T00:59:49.511 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-18T00:59:49.512 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-18T00:59:49.512 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:59:49.512 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:59:49.512 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:59:49.513 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:59:49.513 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:59:49.513 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.57427/ceph-mon.a.asok 2026-02-18T00:59:49.513 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T00:59:49.513 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.57427/ceph-mon.a.asok config get mon_host 2026-02-18T00:59:49.568 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1496: test_wait_osd_id_used_by_pgs: run_mgr td/ceph-helpers x 2026-02-18T00:59:49.568 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/ceph-helpers 2026-02-18T00:59:49.568 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-18T00:59:49.568 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-18T00:59:49.568 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-18T00:59:49.569 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/ceph-helpers/x 2026-02-18T00:59:49.569 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-18T00:59:49.681 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-18T00:59:49.681 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:59:49.681 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:59:49.681 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:59:49.681 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:59:49.681 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:59:49.681 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.57427/$cluster-$name.asok' 2026-02-18T00:59:49.682 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-18T00:59:49.683 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/ceph-helpers/x '--log-file=td/ceph-helpers/$name.log' '--admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' --run-dir=td/ceph-helpers '--pid-file=td/ceph-helpers/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-18T00:59:49.701 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1497: test_wait_osd_id_used_by_pgs: run_osd td/ceph-helpers 0 2026-02-18T00:59:49.701 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/ceph-helpers 2026-02-18T00:59:49.701 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T00:59:49.701 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-18T00:59:49.702 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T00:59:49.702 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/ceph-helpers/0 2026-02-18T00:59:49.702 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--cluster ceph --fsid=863c4e35-ceb0-4172-b7b2-c3ff099e05a2 --auth-supported=none --mon-host=127.0.0.1:7109 ' 2026-02-18T00:59:49.702 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T00:59:49.702 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T00:59:49.702 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T00:59:49.702 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/ceph-helpers/0' 2026-02-18T00:59:49.702 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/ceph-helpers/0/journal' 2026-02-18T00:59:49.702 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T00:59:49.702 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-18T00:59:49.703 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/ceph-helpers' 2026-02-18T00:59:49.705 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T00:59:49.705 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:59:49.705 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:59:49.705 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:59:49.705 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:59:49.705 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:59:49.706 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.57427/$cluster-$name.asok' 2026-02-18T00:59:49.706 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' 2026-02-18T00:59:49.706 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T00:59:49.706 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T00:59:49.706 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T00:59:49.706 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/ceph-helpers/$name.log' 2026-02-18T00:59:49.706 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/ceph-helpers/$name.pid' 2026-02-18T00:59:49.706 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T00:59:49.706 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T00:59:49.706 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T00:59:49.707 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T00:59:49.707 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T00:59:49.707 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-18T00:59:49.707 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/ceph-helpers/0 2026-02-18T00:59:49.707 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T00:59:49.708 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=65d8a69e-4c2e-424b-afaf-f794172d7561 2026-02-18T00:59:49.708 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 65d8a69e-4c2e-424b-afaf-f794172d7561' 2026-02-18T00:59:49.708 INFO:tasks.workunit.client.0.trial069.stdout:add osd0 65d8a69e-4c2e-424b-afaf-f794172d7561 2026-02-18T00:59:49.708 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T00:59:49.717 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQAFD5Vp0torKhAAGd7u+UsvlAshRIS04SGcKg== 2026-02-18T00:59:49.717 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQAFD5Vp0torKhAAGd7u+UsvlAshRIS04SGcKg=="}' 2026-02-18T00:59:49.718 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 65d8a69e-4c2e-424b-afaf-f794172d7561 -i td/ceph-helpers/0/new.json 2026-02-18T00:59:49.827 INFO:tasks.workunit.client.0.trial069.stdout:0 2026-02-18T00:59:49.835 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/ceph-helpers/0/new.json 2026-02-18T00:59:49.836 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --cluster ceph --fsid=863c4e35-ceb0-4172-b7b2-c3ff099e05a2 --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/0 --osd-journal=td/ceph-helpers/0/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAFD5Vp0torKhAAGd7u+UsvlAshRIS04SGcKg== --osd-uuid 65d8a69e-4c2e-424b-afaf-f794172d7561 2026-02-18T00:59:49.851 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:59:49.836+0000 7fa277193a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:59:49.852 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:59:49.836+0000 7fa277193a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:59:49.853 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:59:49.840+0000 7fa277193a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:59:49.854 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:59:49.840+0000 7fa277193a40 -1 bdev(0x562c8de88c00 td/ceph-helpers/0/block) open stat got: (1) Operation not permitted 2026-02-18T00:59:49.854 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:59:49.840+0000 7fa277193a40 -1 bluestore(td/ceph-helpers/0) _read_fsid unparsable uuid 2026-02-18T00:59:50.620 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/ceph-helpers/0/keyring 2026-02-18T00:59:50.621 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T00:59:50.621 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-18T00:59:50.622 INFO:tasks.workunit.client.0.trial069.stdout:adding osd0 key to auth repository 2026-02-18T00:59:50.622 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/ceph-helpers/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T00:59:50.745 INFO:tasks.workunit.client.0.trial069.stdout:start osd.0 2026-02-18T00:59:50.745 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-18T00:59:50.745 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --cluster ceph --fsid=863c4e35-ceb0-4172-b7b2-c3ff099e05a2 --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/0 --osd-journal=td/ceph-helpers/0/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.57427/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T00:59:50.745 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T00:59:50.745 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T00:59:50.745 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T00:59:50.761 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:59:50.748+0000 7f885490ba40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:59:50.762 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:59:50.748+0000 7f885490ba40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:59:50.763 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:59:50.748+0000 7f885490ba40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:59:50.873 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-18T00:59:50.873 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:59:50.873 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-18T00:59:50.873 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:59:50.873 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:59:50.873 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:59:50.874 INFO:tasks.workunit.client.0.trial069.stdout:0 2026-02-18T00:59:50.874 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:59:50.874 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:59:50.875 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T00:59:50.980 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:59:51.286 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:59:51.272+0000 7f885490ba40 -1 Falling back to public interface 2026-02-18T00:59:51.981 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:59:51.981 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:59:51.982 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T00:59:51.982 INFO:tasks.workunit.client.0.trial069.stdout:1 2026-02-18T00:59:51.982 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:59:51.983 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T00:59:52.196 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:59:52.253 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:59:52.240+0000 7f885490ba40 -1 osd.0 0 log_to_monitors true 2026-02-18T00:59:53.198 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:59:53.198 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:59:53.199 INFO:tasks.workunit.client.0.trial069.stdout:2 2026-02-18T00:59:53.199 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-18T00:59:53.199 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:59:53.200 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T00:59:53.416 INFO:tasks.workunit.client.0.trial069.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/1427839376,v1:127.0.0.1:6801/1427839376] [v2:127.0.0.1:6802/1427839376,v1:127.0.0.1:6803/1427839376] exists,up 65d8a69e-4c2e-424b-afaf-f794172d7561 2026-02-18T00:59:53.416 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:59:53.416 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:59:53.416 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:59:53.416 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1498: test_wait_osd_id_used_by_pgs: create_rbd_pool 2026-02-18T00:59:53.416 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:526: create_rbd_pool: ceph osd pool delete rbd rbd --yes-i-really-really-mean-it 2026-02-18T00:59:53.624 INFO:tasks.workunit.client.0.trial069.stderr:pool 'rbd' does not exist 2026-02-18T00:59:53.633 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:527: create_rbd_pool: create_pool rbd 4 2026-02-18T00:59:53.633 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create rbd 4 2026-02-18T00:59:53.859 INFO:tasks.workunit.client.0.trial069.stderr:pool 'rbd' already exists 2026-02-18T00:59:53.870 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-18T00:59:54.871 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:528: create_rbd_pool: rbd pool init rbd 2026-02-18T00:59:55.151 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1499: test_wait_osd_id_used_by_pgs: wait_for_clean 2026-02-18T00:59:55.151 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-18T00:59:55.151 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-18T00:59:55.151 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-18T00:59:55.152 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-18T00:59:55.152 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-18T00:59:55.153 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-18T00:59:55.153 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-18T00:59:55.153 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-18T00:59:55.153 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-18T00:59:55.256 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-18T00:59:55.257 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-18T00:59:55.257 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-18T00:59:55.257 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-18T00:59:55.257 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-18T00:59:55.257 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-18T00:59:55.468 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids=0 2026-02-18T00:59:55.469 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-18T00:59:55.469 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:59:55.469 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-18T00:59:55.549 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836483 2026-02-18T00:59:55.549 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836483 2026-02-18T00:59:55.549 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836483' 2026-02-18T00:59:55.549 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:59:55.549 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836483 2026-02-18T00:59:55.549 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:59:55.551 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-18T00:59:55.552 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-21474836483 2026-02-18T00:59:55.552 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:59:55.553 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=21474836483 2026-02-18T00:59:55.553 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 21474836483' 2026-02-18T00:59:55.554 INFO:tasks.workunit.client.0.trial069.stdout:waiting osd.0 seq 21474836483 2026-02-18T00:59:55.554 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T00:59:55.768 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 21474836481 -lt 21474836483 2026-02-18T00:59:55.768 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-18T00:59:56.769 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-18T00:59:56.769 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T00:59:56.988 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 21474836483 -lt 21474836483 2026-02-18T00:59:56.989 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-18T00:59:56.989 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T00:59:56.989 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T00:59:57.275 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 4 == 0 2026-02-18T00:59:57.276 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-18T00:59:57.276 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-18T00:59:57.276 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-18T00:59:57.276 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-18T00:59:57.276 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-18T00:59:57.276 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-18T00:59:57.276 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-18T00:59:57.483 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=4 2026-02-18T00:59:57.483 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-18T00:59:57.484 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T00:59:57.484 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T00:59:57.774 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 4 = 4 2026-02-18T00:59:57.775 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-18T00:59:57.775 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-18T00:59:57.775 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1500: test_wait_osd_id_used_by_pgs: wait_osd_id_used_by_pgs 0 8 2026-02-18T00:59:57.775 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1475: wait_osd_id_used_by_pgs: local id=0 2026-02-18T00:59:57.775 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1476: wait_osd_id_used_by_pgs: local count=8 2026-02-18T00:59:57.775 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1478: wait_osd_id_used_by_pgs: status=1 2026-02-18T00:59:57.775 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1479: wait_osd_id_used_by_pgs: (( i=0 )) 2026-02-18T00:59:57.775 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1479: wait_osd_id_used_by_pgs: (( i < 300 / 5 )) 2026-02-18T00:59:57.776 INFO:tasks.workunit.client.0.trial069.stdout:0 2026-02-18T00:59:57.777 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1480: wait_osd_id_used_by_pgs: echo 0 2026-02-18T00:59:57.777 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1481: wait_osd_id_used_by_pgs: get_osd_id_used_by_pgs 2026-02-18T00:59:57.777 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1481: wait_osd_id_used_by_pgs: grep -c 0 2026-02-18T00:59:57.777 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1446: get_osd_id_used_by_pgs: ceph --format json pg dump pgs 2026-02-18T00:59:57.777 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1446: get_osd_id_used_by_pgs: jq '.pg_stats | .[] | .up[], .acting[]' 2026-02-18T00:59:57.777 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1446: get_osd_id_used_by_pgs: sort 2026-02-18T00:59:57.983 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1481: wait_osd_id_used_by_pgs: test 8 = 8 2026-02-18T00:59:57.983 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1484: wait_osd_id_used_by_pgs: status=0 2026-02-18T00:59:57.983 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1485: wait_osd_id_used_by_pgs: break 2026-02-18T00:59:57.983 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1488: wait_osd_id_used_by_pgs: return 0 2026-02-18T00:59:57.983 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1501: test_wait_osd_id_used_by_pgs: TIMEOUT=1 2026-02-18T00:59:57.983 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1501: test_wait_osd_id_used_by_pgs: wait_osd_id_used_by_pgs 123 5 2026-02-18T00:59:57.983 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1475: wait_osd_id_used_by_pgs: local id=123 2026-02-18T00:59:57.983 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1476: wait_osd_id_used_by_pgs: local count=5 2026-02-18T00:59:57.984 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1478: wait_osd_id_used_by_pgs: status=1 2026-02-18T00:59:57.984 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1479: wait_osd_id_used_by_pgs: (( i=0 )) 2026-02-18T00:59:57.984 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1479: wait_osd_id_used_by_pgs: (( i < 1 / 5 )) 2026-02-18T00:59:57.984 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1488: wait_osd_id_used_by_pgs: return 1 2026-02-18T00:59:57.984 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1502: test_wait_osd_id_used_by_pgs: teardown td/ceph-helpers 2026-02-18T00:59:57.984 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/ceph-helpers 2026-02-18T00:59:57.984 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T00:59:57.984 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/ceph-helpers KILL 2026-02-18T00:59:57.984 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:59:57.984 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:59:57.984 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:59:57.984 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:59:57.985 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:59:58.091 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:59:58.091 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T00:59:58.092 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T00:59:58.092 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T00:59:58.093 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T00:59:58.094 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T00:59:58.094 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T00:59:58.095 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:59:58.095 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T00:59:58.096 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T00:59:58.096 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:59:58.097 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T00:59:58.098 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T00:59:58.098 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/ceph-helpers 2026-02-18T00:59:58.101 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T00:59:58.102 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:59:58.102 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.57427 2026-02-18T00:59:58.102 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.57427 2026-02-18T00:59:58.103 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T00:59:58.103 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T00:59:58.103 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2437: : exit 0 2026-02-18T00:59:58.104 INFO:teuthology.orchestra.run:Running command with timeout 3600 2026-02-18T00:59:58.105 DEBUG:teuthology.orchestra.run.trial069:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2026-02-18T00:59:58.114 INFO:tasks.workunit:Running workunit misc/test-snaptrim-stats.sh... 2026-02-18T00:59:58.114 DEBUG:teuthology.orchestra.run.trial069:workunit test misc/test-snaptrim-stats.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=adc1923395f2bcd6ae89b5d331d278364d1848ed TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh 2026-02-18T00:59:58.170 INFO:tasks.workunit.client.0.trial069.stderr:stty: 'standard input': Inappropriate ioctl for device 2026-02-18T00:59:58.173 INFO:tasks.workunit.client.0.trial069.stderr:+ PS4='${BASH_SOURCE[0]}:$LINENO: ${FUNCNAME[0]}: ' 2026-02-18T00:59:58.173 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2394: main: export PATH=.:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2026-02-18T00:59:58.173 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2394: main: PATH=.:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2026-02-18T00:59:58.173 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2395: main: export PYTHONWARNINGS=ignore 2026-02-18T00:59:58.173 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2395: main: PYTHONWARNINGS=ignore 2026-02-18T00:59:58.174 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2396: main: export CEPH_CONF=/dev/null 2026-02-18T00:59:58.174 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2396: main: CEPH_CONF=/dev/null 2026-02-18T00:59:58.174 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2397: main: unset CEPH_ARGS 2026-02-18T00:59:58.174 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2399: main: local code 2026-02-18T00:59:58.174 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2400: main: run td/test-snaptrim-stats 2026-02-18T00:59:58.174 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:21: run: local dir=td/test-snaptrim-stats 2026-02-18T00:59:58.174 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:22: run: shift 2026-02-18T00:59:58.174 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:24: run: export CEPH_MON=127.0.0.1:7124 2026-02-18T00:59:58.174 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:24: run: CEPH_MON=127.0.0.1:7124 2026-02-18T00:59:58.174 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:25: run: export CEPH_ARGS 2026-02-18T00:59:58.174 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:26: run: uuidgen 2026-02-18T00:59:58.175 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:26: run: CEPH_ARGS+='--fsid=0ac96446-9e30-4475-b12c-4674101a077e --auth-supported=none ' 2026-02-18T00:59:58.175 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:27: run: CEPH_ARGS+='--mon-host=127.0.0.1:7124 ' 2026-02-18T00:59:58.175 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:28: run: CEPH_ARGS+='--debug-bluestore 20 ' 2026-02-18T00:59:58.175 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:30: run: set 2026-02-18T00:59:58.175 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:30: run: sed -n -e 's/^\(TEST_[0-9a-z_]*\) .*/\1/p' 2026-02-18T00:59:58.177 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:30: run: local 'funcs=TEST_snaptrim_stats 2026-02-18T00:59:58.177 INFO:tasks.workunit.client.0.trial069.stderr:TEST_snaptrim_stats_multiple_snaps' 2026-02-18T00:59:58.178 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:31: run: for func in $funcs 2026-02-18T00:59:58.178 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:32: run: setup td/test-snaptrim-stats 2026-02-18T00:59:58.178 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/test-snaptrim-stats 2026-02-18T00:59:58.178 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/test-snaptrim-stats 2026-02-18T00:59:58.178 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/test-snaptrim-stats 2026-02-18T00:59:58.178 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T00:59:58.178 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/test-snaptrim-stats KILL 2026-02-18T00:59:58.178 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:59:58.178 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:59:58.178 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:59:58.178 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:59:58.178 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:59:58.179 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:59:58.179 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T00:59:58.180 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T00:59:58.181 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T00:59:58.181 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T00:59:58.182 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T00:59:58.182 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T00:59:58.182 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:59:58.183 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T00:59:58.183 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T00:59:58.183 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:59:58.184 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T00:59:58.185 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T00:59:58.186 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/test-snaptrim-stats 2026-02-18T00:59:58.187 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T00:59:58.187 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:59:58.187 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.149617 2026-02-18T00:59:58.187 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.149617 2026-02-18T00:59:58.188 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T00:59:58.189 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T00:59:58.189 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/test-snaptrim-stats 2026-02-18T00:59:58.190 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-18T00:59:58.190 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:59:58.190 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.149617 2026-02-18T00:59:58.191 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.149617 2026-02-18T00:59:58.192 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-18T00:59:58.194 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 1024 -le 1024 ']' 2026-02-18T00:59:58.194 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:127: setup: ulimit -n 4096 2026-02-18T00:59:58.194 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-18T00:59:58.194 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/test-snaptrim-stats 1' TERM HUP INT 2026-02-18T00:59:58.194 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:33: run: TEST_snaptrim_stats td/test-snaptrim-stats 2026-02-18T00:59:58.194 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:39: TEST_snaptrim_stats: local dir=td/test-snaptrim-stats 2026-02-18T00:59:58.195 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:40: TEST_snaptrim_stats: local poolname=test 2026-02-18T00:59:58.195 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:41: TEST_snaptrim_stats: local OSDS=3 2026-02-18T00:59:58.195 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:42: TEST_snaptrim_stats: local PGNUM=8 2026-02-18T00:59:58.195 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:43: TEST_snaptrim_stats: local PGPNUM=8 2026-02-18T00:59:58.195 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:44: TEST_snaptrim_stats: local objects=10 2026-02-18T00:59:58.195 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:45: TEST_snaptrim_stats: local WAIT_FOR_UPDATE=10 2026-02-18T00:59:58.195 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:47: TEST_snaptrim_stats: setup td/test-snaptrim-stats 2026-02-18T00:59:58.195 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/test-snaptrim-stats 2026-02-18T00:59:58.195 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/test-snaptrim-stats 2026-02-18T00:59:58.195 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/test-snaptrim-stats 2026-02-18T00:59:58.195 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T00:59:58.195 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/test-snaptrim-stats KILL 2026-02-18T00:59:58.195 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:59:58.196 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:59:58.196 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:59:58.196 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:59:58.196 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:59:58.196 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:59:58.196 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T00:59:58.197 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T00:59:58.197 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T00:59:58.198 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T00:59:58.198 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T00:59:58.199 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T00:59:58.200 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:59:58.200 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T00:59:58.200 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T00:59:58.200 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:59:58.201 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T00:59:58.203 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T00:59:58.203 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/test-snaptrim-stats 2026-02-18T00:59:58.204 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T00:59:58.204 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:59:58.204 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.149617 2026-02-18T00:59:58.205 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.149617 2026-02-18T00:59:58.206 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T00:59:58.206 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T00:59:58.206 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/test-snaptrim-stats 2026-02-18T00:59:58.207 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-18T00:59:58.207 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:59:58.208 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.149617 2026-02-18T00:59:58.208 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.149617 2026-02-18T00:59:58.209 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-18T00:59:58.210 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-18T00:59:58.210 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-18T00:59:58.210 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/test-snaptrim-stats 1' TERM HUP INT 2026-02-18T00:59:58.211 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:48: TEST_snaptrim_stats: run_mon td/test-snaptrim-stats a --osd_pool_default_size=3 2026-02-18T00:59:58.211 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/test-snaptrim-stats 2026-02-18T00:59:58.211 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-18T00:59:58.211 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-18T00:59:58.211 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-18T00:59:58.211 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/test-snaptrim-stats/a 2026-02-18T00:59:58.211 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/test-snaptrim-stats/a --run-dir=td/test-snaptrim-stats --osd_pool_default_size=3 2026-02-18T00:59:58.233 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-18T00:59:58.233 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:59:58.233 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:59:58.233 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:59:58.233 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:59:58.233 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.149617 2026-02-18T00:59:58.233 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.149617/$cluster-$name.asok' 2026-02-18T00:59:58.234 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/test-snaptrim-stats/a '--log-file=td/test-snaptrim-stats/$name.log' '--admin-socket=/tmp/ceph-asok.149617/$cluster-$name.asok' --mon-cluster-log-file=td/test-snaptrim-stats/log --run-dir=td/test-snaptrim-stats '--pid-file=td/test-snaptrim-stats/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --osd_pool_default_size=3 2026-02-18T00:59:58.261 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-18T00:59:58.263 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-18T00:59:58.263 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T00:59:58.263 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-18T00:59:58.263 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-18T00:59:58.264 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-18T00:59:58.264 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-18T00:59:58.264 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:59:58.264 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:59:58.264 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:59:58.265 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:59:58.265 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.149617 2026-02-18T00:59:58.265 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.149617/ceph-mon.a.asok 2026-02-18T00:59:58.265 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T00:59:58.265 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.149617/ceph-mon.a.asok config get fsid 2026-02-18T00:59:58.319 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-18T00:59:58.319 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T00:59:58.319 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-18T00:59:58.319 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-18T00:59:58.321 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-18T00:59:58.321 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-18T00:59:58.321 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:59:58.321 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:59:58.321 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:59:58.321 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:59:58.321 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.149617 2026-02-18T00:59:58.321 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.149617/ceph-mon.a.asok 2026-02-18T00:59:58.321 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T00:59:58.321 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.149617/ceph-mon.a.asok config get mon_host 2026-02-18T00:59:58.374 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:49: TEST_snaptrim_stats: run_mgr td/test-snaptrim-stats x 2026-02-18T00:59:58.374 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/test-snaptrim-stats 2026-02-18T00:59:58.375 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-18T00:59:58.375 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-18T00:59:58.375 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-18T00:59:58.375 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/test-snaptrim-stats/x 2026-02-18T00:59:58.375 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-18T00:59:58.483 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-18T00:59:58.483 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:59:58.483 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:59:58.483 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:59:58.483 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:59:58.484 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.149617 2026-02-18T00:59:58.484 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.149617/$cluster-$name.asok' 2026-02-18T00:59:58.484 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-18T00:59:58.484 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/test-snaptrim-stats/x '--log-file=td/test-snaptrim-stats/$name.log' '--admin-socket=/tmp/ceph-asok.149617/$cluster-$name.asok' --run-dir=td/test-snaptrim-stats '--pid-file=td/test-snaptrim-stats/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-18T00:59:58.504 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:50: TEST_snaptrim_stats: expr 3 - 1 2026-02-18T00:59:58.505 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:50: TEST_snaptrim_stats: seq 0 2 2026-02-18T00:59:58.508 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:50: TEST_snaptrim_stats: for osd in $(seq 0 $(expr $OSDS - 1)) 2026-02-18T00:59:58.508 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:52: TEST_snaptrim_stats: run_osd td/test-snaptrim-stats 0 --osd_pool_default_pg_autoscale_mode=off 2026-02-18T00:59:58.508 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-snaptrim-stats 2026-02-18T00:59:58.508 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T00:59:58.509 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-18T00:59:58.509 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T00:59:58.509 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-snaptrim-stats/0 2026-02-18T00:59:58.509 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=0ac96446-9e30-4475-b12c-4674101a077e --auth-supported=none --mon-host=127.0.0.1:7124 --debug-bluestore 20 ' 2026-02-18T00:59:58.509 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T00:59:58.509 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T00:59:58.509 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T00:59:58.509 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-snaptrim-stats/0' 2026-02-18T00:59:58.509 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-snaptrim-stats/0/journal' 2026-02-18T00:59:58.509 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T00:59:58.509 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-18T00:59:58.510 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-snaptrim-stats' 2026-02-18T00:59:58.510 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T00:59:58.510 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:59:58.510 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:59:58.510 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:59:58.510 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:59:58.510 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.149617 2026-02-18T00:59:58.510 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.149617/$cluster-$name.asok' 2026-02-18T00:59:58.510 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.149617/$cluster-$name.asok' 2026-02-18T00:59:58.510 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T00:59:58.510 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T00:59:58.510 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T00:59:58.510 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-snaptrim-stats/$name.log' 2026-02-18T00:59:58.511 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-snaptrim-stats/$name.pid' 2026-02-18T00:59:58.511 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T00:59:58.511 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T00:59:58.511 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T00:59:58.511 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T00:59:58.511 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T00:59:58.511 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=--osd_pool_default_pg_autoscale_mode=off 2026-02-18T00:59:58.511 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-snaptrim-stats/0 2026-02-18T00:59:58.512 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T00:59:58.512 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=a56fb75c-2eeb-4fc2-88dc-84883e82c0ef 2026-02-18T00:59:58.512 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 a56fb75c-2eeb-4fc2-88dc-84883e82c0ef' 2026-02-18T00:59:58.512 INFO:tasks.workunit.client.0.trial069.stdout:add osd0 a56fb75c-2eeb-4fc2-88dc-84883e82c0ef 2026-02-18T00:59:58.513 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T00:59:58.521 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQAOD5VppNp4HhAAgqf2ilM3Pp274GIfG3L63w== 2026-02-18T00:59:58.521 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQAOD5VppNp4HhAAgqf2ilM3Pp274GIfG3L63w=="}' 2026-02-18T00:59:58.521 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new a56fb75c-2eeb-4fc2-88dc-84883e82c0ef -i td/test-snaptrim-stats/0/new.json 2026-02-18T00:59:58.633 INFO:tasks.workunit.client.0.trial069.stdout:0 2026-02-18T00:59:58.641 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-snaptrim-stats/0/new.json 2026-02-18T00:59:58.642 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=0ac96446-9e30-4475-b12c-4674101a077e --auth-supported=none --mon-host=127.0.0.1:7124 --debug-bluestore 20 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-snaptrim-stats/0 --osd-journal=td/test-snaptrim-stats/0/journal --chdir= --run-dir=td/test-snaptrim-stats '--admin-socket=/tmp/ceph-asok.149617/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-snaptrim-stats/$name.log' '--pid-file=td/test-snaptrim-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_pool_default_pg_autoscale_mode=off --mkfs --key AQAOD5VppNp4HhAAgqf2ilM3Pp274GIfG3L63w== --osd-uuid a56fb75c-2eeb-4fc2-88dc-84883e82c0ef 2026-02-18T00:59:58.658 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:59:58.644+0000 7f189e6bba40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:59:58.660 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:59:58.644+0000 7f189e6bba40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:59:58.661 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:59:58.648+0000 7f189e6bba40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:59:58.661 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:59:58.648+0000 7f189e6bba40 -1 bdev(0x55c26cc98c00 td/test-snaptrim-stats/0/block) open stat got: (1) Operation not permitted 2026-02-18T00:59:58.661 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:59:58.648+0000 7f189e6bba40 -1 bluestore(td/test-snaptrim-stats/0) _read_fsid unparsable uuid 2026-02-18T00:59:59.452 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-snaptrim-stats/0/keyring 2026-02-18T00:59:59.452 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T00:59:59.453 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-18T00:59:59.453 INFO:tasks.workunit.client.0.trial069.stdout:adding osd0 key to auth repository 2026-02-18T00:59:59.453 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-snaptrim-stats/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T00:59:59.573 INFO:tasks.workunit.client.0.trial069.stdout:start osd.0 2026-02-18T00:59:59.574 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-18T00:59:59.574 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=0ac96446-9e30-4475-b12c-4674101a077e --auth-supported=none --mon-host=127.0.0.1:7124 --debug-bluestore 20 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-snaptrim-stats/0 --osd-journal=td/test-snaptrim-stats/0/journal --chdir= --run-dir=td/test-snaptrim-stats '--admin-socket=/tmp/ceph-asok.149617/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-snaptrim-stats/$name.log' '--pid-file=td/test-snaptrim-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_pool_default_pg_autoscale_mode=off 2026-02-18T00:59:59.575 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T00:59:59.575 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T00:59:59.575 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T00:59:59.596 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:59:59.580+0000 7fdfdaf9fa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:59:59.599 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:59:59.584+0000 7fdfdaf9fa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:59:59.600 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:59:59.584+0000 7fdfdaf9fa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:59:59.681 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-18T00:59:59.681 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:59:59.682 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-18T00:59:59.682 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:59:59.682 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:59:59.682 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:59:59.682 INFO:tasks.workunit.client.0.trial069.stdout:0 2026-02-18T00:59:59.683 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:59:59.683 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:59:59.683 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T00:59:59.786 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:59:59.974 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T00:59:59.960+0000 7fdfdaf9fa40 -1 Falling back to public interface 2026-02-18T01:00:00.788 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T01:00:00.788 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:00:00.789 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T01:00:00.789 INFO:tasks.workunit.client.0.trial069.stdout:1 2026-02-18T01:00:00.790 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:00:00.790 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T01:00:00.893 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T01:00:00.935 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T01:00:00.920+0000 7fdfdaf9fa40 -1 osd.0 0 log_to_monitors true 2026-02-18T01:00:01.895 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T01:00:01.895 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:00:01.895 INFO:tasks.workunit.client.0.trial069.stdout:2 2026-02-18T01:00:01.895 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-18T01:00:01.895 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:00:01.895 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T01:00:02.101 INFO:tasks.workunit.client.0.trial069.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/1111862,v1:127.0.0.1:6801/1111862] [v2:127.0.0.1:6802/1111862,v1:127.0.0.1:6803/1111862] exists,up a56fb75c-2eeb-4fc2-88dc-84883e82c0ef 2026-02-18T01:00:02.101 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T01:00:02.101 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T01:00:02.101 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T01:00:02.101 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:50: TEST_snaptrim_stats: for osd in $(seq 0 $(expr $OSDS - 1)) 2026-02-18T01:00:02.101 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:52: TEST_snaptrim_stats: run_osd td/test-snaptrim-stats 1 --osd_pool_default_pg_autoscale_mode=off 2026-02-18T01:00:02.101 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-snaptrim-stats 2026-02-18T01:00:02.102 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T01:00:02.102 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2026-02-18T01:00:02.102 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T01:00:02.102 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-snaptrim-stats/1 2026-02-18T01:00:02.102 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=0ac96446-9e30-4475-b12c-4674101a077e --auth-supported=none --mon-host=127.0.0.1:7124 --debug-bluestore 20 ' 2026-02-18T01:00:02.102 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T01:00:02.102 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T01:00:02.102 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T01:00:02.102 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-snaptrim-stats/1' 2026-02-18T01:00:02.102 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-snaptrim-stats/1/journal' 2026-02-18T01:00:02.102 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T01:00:02.102 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-18T01:00:02.102 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-snaptrim-stats' 2026-02-18T01:00:02.102 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T01:00:02.102 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T01:00:02.102 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T01:00:02.102 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T01:00:02.102 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:00:02.102 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.149617 2026-02-18T01:00:02.102 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.149617/$cluster-$name.asok' 2026-02-18T01:00:02.103 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.149617/$cluster-$name.asok' 2026-02-18T01:00:02.103 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T01:00:02.103 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T01:00:02.103 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T01:00:02.103 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-snaptrim-stats/$name.log' 2026-02-18T01:00:02.103 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-snaptrim-stats/$name.pid' 2026-02-18T01:00:02.103 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T01:00:02.103 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T01:00:02.103 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T01:00:02.103 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T01:00:02.103 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T01:00:02.103 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=--osd_pool_default_pg_autoscale_mode=off 2026-02-18T01:00:02.103 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-snaptrim-stats/1 2026-02-18T01:00:02.104 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T01:00:02.105 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=d1a84363-3163-4667-a78f-f45e77edf11d 2026-02-18T01:00:02.105 INFO:tasks.workunit.client.0.trial069.stdout:add osd1 d1a84363-3163-4667-a78f-f45e77edf11d 2026-02-18T01:00:02.105 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 d1a84363-3163-4667-a78f-f45e77edf11d' 2026-02-18T01:00:02.105 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T01:00:02.117 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQASD5VpUnhqBhAAfeDfZEHCZLq4JbH5ELOaNQ== 2026-02-18T01:00:02.117 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQASD5VpUnhqBhAAfeDfZEHCZLq4JbH5ELOaNQ=="}' 2026-02-18T01:00:02.117 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new d1a84363-3163-4667-a78f-f45e77edf11d -i td/test-snaptrim-stats/1/new.json 2026-02-18T01:00:02.323 INFO:tasks.workunit.client.0.trial069.stdout:1 2026-02-18T01:00:02.332 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-snaptrim-stats/1/new.json 2026-02-18T01:00:02.333 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=0ac96446-9e30-4475-b12c-4674101a077e --auth-supported=none --mon-host=127.0.0.1:7124 --debug-bluestore 20 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-snaptrim-stats/1 --osd-journal=td/test-snaptrim-stats/1/journal --chdir= --run-dir=td/test-snaptrim-stats '--admin-socket=/tmp/ceph-asok.149617/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-snaptrim-stats/$name.log' '--pid-file=td/test-snaptrim-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_pool_default_pg_autoscale_mode=off --mkfs --key AQASD5VpUnhqBhAAfeDfZEHCZLq4JbH5ELOaNQ== --osd-uuid d1a84363-3163-4667-a78f-f45e77edf11d 2026-02-18T01:00:02.349 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T01:00:02.336+0000 7fdd03679a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:00:02.351 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T01:00:02.336+0000 7fdd03679a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:00:02.352 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T01:00:02.336+0000 7fdd03679a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:00:02.352 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T01:00:02.336+0000 7fdd03679a40 -1 bdev(0x5650eb4e2c00 td/test-snaptrim-stats/1/block) open stat got: (1) Operation not permitted 2026-02-18T01:00:02.352 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T01:00:02.336+0000 7fdd03679a40 -1 bluestore(td/test-snaptrim-stats/1) _read_fsid unparsable uuid 2026-02-18T01:00:03.020 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-snaptrim-stats/1/keyring 2026-02-18T01:00:03.020 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T01:00:03.021 INFO:tasks.workunit.client.0.trial069.stdout:adding osd1 key to auth repository 2026-02-18T01:00:03.021 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2026-02-18T01:00:03.022 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-snaptrim-stats/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T01:00:03.304 INFO:tasks.workunit.client.0.trial069.stdout:start osd.1 2026-02-18T01:00:03.305 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2026-02-18T01:00:03.305 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=0ac96446-9e30-4475-b12c-4674101a077e --auth-supported=none --mon-host=127.0.0.1:7124 --debug-bluestore 20 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-snaptrim-stats/1 --osd-journal=td/test-snaptrim-stats/1/journal --chdir= --run-dir=td/test-snaptrim-stats '--admin-socket=/tmp/ceph-asok.149617/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-snaptrim-stats/$name.log' '--pid-file=td/test-snaptrim-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_pool_default_pg_autoscale_mode=off 2026-02-18T01:00:03.305 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T01:00:03.305 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T01:00:03.305 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T01:00:03.328 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T01:00:03.312+0000 7f55ebd01a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:00:03.329 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T01:00:03.316+0000 7f55ebd01a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:00:03.331 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T01:00:03.316+0000 7f55ebd01a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:00:03.516 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2026-02-18T01:00:03.516 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T01:00:03.516 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-18T01:00:03.516 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T01:00:03.516 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T01:00:03.517 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:00:03.517 INFO:tasks.workunit.client.0.trial069.stdout:0 2026-02-18T01:00:03.517 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T01:00:03.518 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:00:03.518 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-18T01:00:03.714 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T01:00:03.700+0000 7f55ebd01a40 -1 Falling back to public interface 2026-02-18T01:00:03.721 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T01:00:04.376 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T01:00:04.360+0000 7f55ebd01a40 -1 osd.1 0 log_to_monitors true 2026-02-18T01:00:04.723 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T01:00:04.723 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:00:04.723 INFO:tasks.workunit.client.0.trial069.stdout:1 2026-02-18T01:00:04.724 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T01:00:04.724 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:00:04.725 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-18T01:00:04.937 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T01:00:05.938 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T01:00:05.938 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:00:05.938 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-18T01:00:05.939 INFO:tasks.workunit.client.0.trial069.stdout:2 2026-02-18T01:00:05.939 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:00:05.939 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-18T01:00:06.143 INFO:tasks.workunit.client.0.trial069.stdout:osd.1 up in weight 1 up_from 10 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/1817658819,v1:127.0.0.1:6811/1817658819] [v2:127.0.0.1:6812/1817658819,v1:127.0.0.1:6813/1817658819] exists,up d1a84363-3163-4667-a78f-f45e77edf11d 2026-02-18T01:00:06.147 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T01:00:06.147 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T01:00:06.147 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T01:00:06.147 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:50: TEST_snaptrim_stats: for osd in $(seq 0 $(expr $OSDS - 1)) 2026-02-18T01:00:06.147 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:52: TEST_snaptrim_stats: run_osd td/test-snaptrim-stats 2 --osd_pool_default_pg_autoscale_mode=off 2026-02-18T01:00:06.147 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-snaptrim-stats 2026-02-18T01:00:06.147 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T01:00:06.147 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2026-02-18T01:00:06.148 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T01:00:06.148 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-snaptrim-stats/2 2026-02-18T01:00:06.148 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=0ac96446-9e30-4475-b12c-4674101a077e --auth-supported=none --mon-host=127.0.0.1:7124 --debug-bluestore 20 ' 2026-02-18T01:00:06.148 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T01:00:06.148 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T01:00:06.148 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T01:00:06.148 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-snaptrim-stats/2' 2026-02-18T01:00:06.148 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-snaptrim-stats/2/journal' 2026-02-18T01:00:06.148 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T01:00:06.148 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-18T01:00:06.148 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-snaptrim-stats' 2026-02-18T01:00:06.148 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T01:00:06.149 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T01:00:06.149 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T01:00:06.149 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T01:00:06.149 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:00:06.149 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.149617 2026-02-18T01:00:06.149 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.149617/$cluster-$name.asok' 2026-02-18T01:00:06.149 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.149617/$cluster-$name.asok' 2026-02-18T01:00:06.149 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T01:00:06.149 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T01:00:06.149 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T01:00:06.149 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-snaptrim-stats/$name.log' 2026-02-18T01:00:06.149 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-snaptrim-stats/$name.pid' 2026-02-18T01:00:06.149 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T01:00:06.150 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T01:00:06.150 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T01:00:06.150 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T01:00:06.150 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T01:00:06.150 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=--osd_pool_default_pg_autoscale_mode=off 2026-02-18T01:00:06.150 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-snaptrim-stats/2 2026-02-18T01:00:06.150 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T01:00:06.151 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=7f003de7-7866-4e4f-bd05-848387d84e15 2026-02-18T01:00:06.151 INFO:tasks.workunit.client.0.trial069.stdout:add osd2 7f003de7-7866-4e4f-bd05-848387d84e15 2026-02-18T01:00:06.152 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 7f003de7-7866-4e4f-bd05-848387d84e15' 2026-02-18T01:00:06.152 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T01:00:06.160 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQAWD5VpnaLzCBAAIFFuBsMZMeHo8MHrzvzjqA== 2026-02-18T01:00:06.160 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQAWD5VpnaLzCBAAIFFuBsMZMeHo8MHrzvzjqA=="}' 2026-02-18T01:00:06.160 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 7f003de7-7866-4e4f-bd05-848387d84e15 -i td/test-snaptrim-stats/2/new.json 2026-02-18T01:00:06.372 INFO:tasks.workunit.client.0.trial069.stdout:2 2026-02-18T01:00:06.381 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-snaptrim-stats/2/new.json 2026-02-18T01:00:06.382 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --fsid=0ac96446-9e30-4475-b12c-4674101a077e --auth-supported=none --mon-host=127.0.0.1:7124 --debug-bluestore 20 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-snaptrim-stats/2 --osd-journal=td/test-snaptrim-stats/2/journal --chdir= --run-dir=td/test-snaptrim-stats '--admin-socket=/tmp/ceph-asok.149617/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-snaptrim-stats/$name.log' '--pid-file=td/test-snaptrim-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_pool_default_pg_autoscale_mode=off --mkfs --key AQAWD5VpnaLzCBAAIFFuBsMZMeHo8MHrzvzjqA== --osd-uuid 7f003de7-7866-4e4f-bd05-848387d84e15 2026-02-18T01:00:06.397 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T01:00:06.384+0000 7f0081edaa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:00:06.399 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T01:00:06.384+0000 7f0081edaa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:00:06.400 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T01:00:06.384+0000 7f0081edaa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:00:06.401 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T01:00:06.388+0000 7f0081edaa40 -1 bdev(0x55eaccab2c00 td/test-snaptrim-stats/2/block) open stat got: (1) Operation not permitted 2026-02-18T01:00:06.401 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T01:00:06.388+0000 7f0081edaa40 -1 bluestore(td/test-snaptrim-stats/2) _read_fsid unparsable uuid 2026-02-18T01:00:07.025 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-snaptrim-stats/2/keyring 2026-02-18T01:00:07.026 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T01:00:07.026 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2026-02-18T01:00:07.027 INFO:tasks.workunit.client.0.trial069.stdout:adding osd2 key to auth repository 2026-02-18T01:00:07.027 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-snaptrim-stats/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T01:00:07.325 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2026-02-18T01:00:07.326 INFO:tasks.workunit.client.0.trial069.stdout:start osd.2 2026-02-18T01:00:07.327 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --fsid=0ac96446-9e30-4475-b12c-4674101a077e --auth-supported=none --mon-host=127.0.0.1:7124 --debug-bluestore 20 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-snaptrim-stats/2 --osd-journal=td/test-snaptrim-stats/2/journal --chdir= --run-dir=td/test-snaptrim-stats '--admin-socket=/tmp/ceph-asok.149617/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-snaptrim-stats/$name.log' '--pid-file=td/test-snaptrim-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_pool_default_pg_autoscale_mode=off 2026-02-18T01:00:07.327 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T01:00:07.327 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T01:00:07.327 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T01:00:07.341 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T01:00:07.328+0000 7fd936540a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:00:07.342 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T01:00:07.328+0000 7fd936540a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:00:07.343 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T01:00:07.328+0000 7fd936540a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:00:07.538 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2026-02-18T01:00:07.538 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T01:00:07.538 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-18T01:00:07.538 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T01:00:07.538 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T01:00:07.539 INFO:tasks.workunit.client.0.trial069.stdout:0 2026-02-18T01:00:07.539 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:00:07.540 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T01:00:07.540 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:00:07.540 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-18T01:00:07.734 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T01:00:07.720+0000 7fd936540a40 -1 Falling back to public interface 2026-02-18T01:00:07.752 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T01:00:08.382 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T01:00:08.368+0000 7fd936540a40 -1 osd.2 0 log_to_monitors true 2026-02-18T01:00:08.753 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T01:00:08.753 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:00:08.753 INFO:tasks.workunit.client.0.trial069.stdout:1 2026-02-18T01:00:08.753 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T01:00:08.753 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:00:08.754 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-18T01:00:08.965 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T01:00:09.966 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T01:00:09.967 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:00:09.967 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-18T01:00:09.967 INFO:tasks.workunit.client.0.trial069.stdout:2 2026-02-18T01:00:09.968 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:00:09.968 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-18T01:00:10.173 INFO:tasks.workunit.client.0.trial069.stdout:osd.2 up in weight 1 up_from 15 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/2351416688,v1:127.0.0.1:6819/2351416688] [v2:127.0.0.1:6820/2351416688,v1:127.0.0.1:6821/2351416688] exists,up 7f003de7-7866-4e4f-bd05-848387d84e15 2026-02-18T01:00:10.174 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T01:00:10.174 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T01:00:10.174 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T01:00:10.174 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:56: TEST_snaptrim_stats: ceph osd set noscrub 2026-02-18T01:00:10.474 INFO:tasks.workunit.client.0.trial069.stderr:noscrub is set 2026-02-18T01:00:10.485 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:57: TEST_snaptrim_stats: ceph osd set nodeep-scrub 2026-02-18T01:00:10.779 INFO:tasks.workunit.client.0.trial069.stderr:nodeep-scrub is set 2026-02-18T01:00:10.792 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:60: TEST_snaptrim_stats: create_pool test 8 8 2026-02-18T01:00:10.792 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create test 8 8 2026-02-18T01:00:11.035 INFO:tasks.workunit.client.0.trial069.stderr:pool 'test' already exists 2026-02-18T01:00:11.046 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-18T01:00:12.048 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:61: TEST_snaptrim_stats: wait_for_clean 2026-02-18T01:00:12.049 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-18T01:00:12.049 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-18T01:00:12.049 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-18T01:00:12.049 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-18T01:00:12.051 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-18T01:00:12.051 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-18T01:00:12.051 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-18T01:00:12.051 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-18T01:00:12.052 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-18T01:00:12.145 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-18T01:00:12.145 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-18T01:00:12.145 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-18T01:00:12.145 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-18T01:00:12.145 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-18T01:00:12.146 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-18T01:00:12.358 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-18T01:00:12.358 INFO:tasks.workunit.client.0.trial069.stderr:1 2026-02-18T01:00:12.358 INFO:tasks.workunit.client.0.trial069.stderr:2' 2026-02-18T01:00:12.359 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-18T01:00:12.359 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T01:00:12.359 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-18T01:00:12.436 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836485 2026-02-18T01:00:12.436 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836485 2026-02-18T01:00:12.436 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836485' 2026-02-18T01:00:12.436 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T01:00:12.437 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-18T01:00:12.511 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=42949672964 2026-02-18T01:00:12.512 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 42949672964 2026-02-18T01:00:12.512 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836485 1-42949672964' 2026-02-18T01:00:12.512 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T01:00:12.512 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-18T01:00:12.589 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=64424509443 2026-02-18T01:00:12.589 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 64424509443 2026-02-18T01:00:12.589 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836485 1-42949672964 2-64424509443' 2026-02-18T01:00:12.589 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T01:00:12.590 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836485 2026-02-18T01:00:12.590 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T01:00:12.590 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-18T01:00:12.591 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-21474836485 2026-02-18T01:00:12.591 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T01:00:12.593 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=21474836485 2026-02-18T01:00:12.593 INFO:tasks.workunit.client.0.trial069.stdout:waiting osd.0 seq 21474836485 2026-02-18T01:00:12.593 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 21474836485' 2026-02-18T01:00:12.594 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T01:00:12.800 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 21474836482 -lt 21474836485 2026-02-18T01:00:12.800 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-18T01:00:13.801 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-18T01:00:13.802 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T01:00:14.013 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 21474836485 -lt 21474836485 2026-02-18T01:00:14.013 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T01:00:14.013 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-42949672964 2026-02-18T01:00:14.014 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T01:00:14.014 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=1 2026-02-18T01:00:14.015 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 1-42949672964 2026-02-18T01:00:14.015 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T01:00:14.017 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=42949672964 2026-02-18T01:00:14.017 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.1 seq 42949672964' 2026-02-18T01:00:14.017 INFO:tasks.workunit.client.0.trial069.stdout:waiting osd.1 seq 42949672964 2026-02-18T01:00:14.018 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-18T01:00:14.230 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 42949672964 -lt 42949672964 2026-02-18T01:00:14.230 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T01:00:14.231 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-64424509443 2026-02-18T01:00:14.231 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T01:00:14.232 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=2 2026-02-18T01:00:14.233 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 2-64424509443 2026-02-18T01:00:14.233 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T01:00:14.234 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=64424509443 2026-02-18T01:00:14.234 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.2 seq 64424509443' 2026-02-18T01:00:14.234 INFO:tasks.workunit.client.0.trial069.stdout:waiting osd.2 seq 64424509443 2026-02-18T01:00:14.235 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-18T01:00:14.455 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 64424509443 -lt 64424509443 2026-02-18T01:00:14.455 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-18T01:00:14.456 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T01:00:14.456 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T01:00:14.736 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 8 == 0 2026-02-18T01:00:14.736 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-18T01:00:14.737 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-18T01:00:14.737 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-18T01:00:14.737 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-18T01:00:14.737 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-18T01:00:14.737 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-18T01:00:14.737 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-18T01:00:14.944 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=8 2026-02-18T01:00:14.944 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-18T01:00:14.945 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T01:00:14.945 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T01:00:15.217 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 8 = 8 2026-02-18T01:00:15.217 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-18T01:00:15.217 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-18T01:00:15.218 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:62: TEST_snaptrim_stats: ceph osd dump 2026-02-18T01:00:15.218 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:62: TEST_snaptrim_stats: grep '^pool.*['\'']test['\'']' 2026-02-18T01:00:15.218 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:62: TEST_snaptrim_stats: awk '{ print $2 }' 2026-02-18T01:00:15.425 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:62: TEST_snaptrim_stats: poolid=1 2026-02-18T01:00:15.425 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:65: TEST_snaptrim_stats: TESTDATA=testdata.1 2026-02-18T01:00:15.426 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:66: TEST_snaptrim_stats: dd if=/dev/urandom of=testdata.1 bs=4096 count=1 2026-02-18T01:00:15.426 INFO:tasks.workunit.client.0.trial069.stderr:1+0 records in 2026-02-18T01:00:15.426 INFO:tasks.workunit.client.0.trial069.stderr:1+0 records out 2026-02-18T01:00:15.426 INFO:tasks.workunit.client.0.trial069.stderr:4096 bytes (4.1 kB, 4.0 KiB) copied, 6.7227e-05 s, 60.9 MB/s 2026-02-18T01:00:15.427 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:67: TEST_snaptrim_stats: seq 1 10 2026-02-18T01:00:15.428 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:67: TEST_snaptrim_stats: for i in `seq 1 $objects` 2026-02-18T01:00:15.428 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:69: TEST_snaptrim_stats: rados -p test put obj1 testdata.1 2026-02-18T01:00:15.446 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:67: TEST_snaptrim_stats: for i in `seq 1 $objects` 2026-02-18T01:00:15.447 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:69: TEST_snaptrim_stats: rados -p test put obj2 testdata.1 2026-02-18T01:00:15.470 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:67: TEST_snaptrim_stats: for i in `seq 1 $objects` 2026-02-18T01:00:15.471 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:69: TEST_snaptrim_stats: rados -p test put obj3 testdata.1 2026-02-18T01:00:15.495 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:67: TEST_snaptrim_stats: for i in `seq 1 $objects` 2026-02-18T01:00:15.495 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:69: TEST_snaptrim_stats: rados -p test put obj4 testdata.1 2026-02-18T01:00:15.520 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:67: TEST_snaptrim_stats: for i in `seq 1 $objects` 2026-02-18T01:00:15.520 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:69: TEST_snaptrim_stats: rados -p test put obj5 testdata.1 2026-02-18T01:00:15.544 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:67: TEST_snaptrim_stats: for i in `seq 1 $objects` 2026-02-18T01:00:15.544 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:69: TEST_snaptrim_stats: rados -p test put obj6 testdata.1 2026-02-18T01:00:15.570 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:67: TEST_snaptrim_stats: for i in `seq 1 $objects` 2026-02-18T01:00:15.570 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:69: TEST_snaptrim_stats: rados -p test put obj7 testdata.1 2026-02-18T01:00:15.594 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:67: TEST_snaptrim_stats: for i in `seq 1 $objects` 2026-02-18T01:00:15.594 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:69: TEST_snaptrim_stats: rados -p test put obj8 testdata.1 2026-02-18T01:00:15.619 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:67: TEST_snaptrim_stats: for i in `seq 1 $objects` 2026-02-18T01:00:15.619 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:69: TEST_snaptrim_stats: rados -p test put obj9 testdata.1 2026-02-18T01:00:15.644 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:67: TEST_snaptrim_stats: for i in `seq 1 $objects` 2026-02-18T01:00:15.644 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:69: TEST_snaptrim_stats: rados -p test put obj10 testdata.1 2026-02-18T01:00:15.668 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:71: TEST_snaptrim_stats: rm -f testdata.1 2026-02-18T01:00:15.669 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:74: TEST_snaptrim_stats: SNAP=1 2026-02-18T01:00:15.670 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:75: TEST_snaptrim_stats: rados -p test mksnap snap1 2026-02-18T01:00:15.742 INFO:tasks.workunit.client.0.trial069.stdout:created pool test snap snap1 2026-02-18T01:00:15.744 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:76: TEST_snaptrim_stats: TESTDATA=testdata.2 2026-02-18T01:00:15.744 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:77: TEST_snaptrim_stats: dd if=/dev/urandom of=testdata.2 bs=4096 count=1 2026-02-18T01:00:15.745 INFO:tasks.workunit.client.0.trial069.stderr:1+0 records in 2026-02-18T01:00:15.745 INFO:tasks.workunit.client.0.trial069.stderr:1+0 records out 2026-02-18T01:00:15.745 INFO:tasks.workunit.client.0.trial069.stderr:4096 bytes (4.1 kB, 4.0 KiB) copied, 6.3169e-05 s, 64.8 MB/s 2026-02-18T01:00:15.746 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:78: TEST_snaptrim_stats: seq 1 10 2026-02-18T01:00:15.746 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:78: TEST_snaptrim_stats: for i in `seq 1 $objects` 2026-02-18T01:00:15.747 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:80: TEST_snaptrim_stats: rados -p test put obj1 testdata.2 2026-02-18T01:00:15.767 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:78: TEST_snaptrim_stats: for i in `seq 1 $objects` 2026-02-18T01:00:15.767 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:80: TEST_snaptrim_stats: rados -p test put obj2 testdata.2 2026-02-18T01:00:15.791 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:78: TEST_snaptrim_stats: for i in `seq 1 $objects` 2026-02-18T01:00:15.791 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:80: TEST_snaptrim_stats: rados -p test put obj3 testdata.2 2026-02-18T01:00:15.816 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:78: TEST_snaptrim_stats: for i in `seq 1 $objects` 2026-02-18T01:00:15.816 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:80: TEST_snaptrim_stats: rados -p test put obj4 testdata.2 2026-02-18T01:00:15.840 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:78: TEST_snaptrim_stats: for i in `seq 1 $objects` 2026-02-18T01:00:15.840 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:80: TEST_snaptrim_stats: rados -p test put obj5 testdata.2 2026-02-18T01:00:15.865 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:78: TEST_snaptrim_stats: for i in `seq 1 $objects` 2026-02-18T01:00:15.865 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:80: TEST_snaptrim_stats: rados -p test put obj6 testdata.2 2026-02-18T01:00:15.884 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:78: TEST_snaptrim_stats: for i in `seq 1 $objects` 2026-02-18T01:00:15.885 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:80: TEST_snaptrim_stats: rados -p test put obj7 testdata.2 2026-02-18T01:00:15.907 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:78: TEST_snaptrim_stats: for i in `seq 1 $objects` 2026-02-18T01:00:15.907 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:80: TEST_snaptrim_stats: rados -p test put obj8 testdata.2 2026-02-18T01:00:15.930 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:78: TEST_snaptrim_stats: for i in `seq 1 $objects` 2026-02-18T01:00:15.930 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:80: TEST_snaptrim_stats: rados -p test put obj9 testdata.2 2026-02-18T01:00:15.955 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:78: TEST_snaptrim_stats: for i in `seq 1 $objects` 2026-02-18T01:00:15.955 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:80: TEST_snaptrim_stats: rados -p test put obj10 testdata.2 2026-02-18T01:00:15.980 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:82: TEST_snaptrim_stats: rm -f testdata.2 2026-02-18T01:00:15.981 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:85: TEST_snaptrim_stats: rados -p test rmsnap snap1 2026-02-18T01:00:16.053 INFO:tasks.workunit.client.0.trial069.stdout:removed pool test snap snap1 2026-02-18T01:00:16.056 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:88: TEST_snaptrim_stats: wait_for_clean 2026-02-18T01:00:16.056 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-18T01:00:16.056 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-18T01:00:16.056 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-18T01:00:16.057 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-18T01:00:16.058 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-18T01:00:16.058 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-18T01:00:16.058 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-18T01:00:16.058 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-18T01:00:16.058 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-18T01:00:16.158 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-18T01:00:16.158 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-18T01:00:16.158 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-18T01:00:16.158 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-18T01:00:16.158 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-18T01:00:16.159 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-18T01:00:16.375 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-18T01:00:16.375 INFO:tasks.workunit.client.0.trial069.stderr:1 2026-02-18T01:00:16.375 INFO:tasks.workunit.client.0.trial069.stderr:2' 2026-02-18T01:00:16.375 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-18T01:00:16.376 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T01:00:16.376 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-18T01:00:16.452 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836487 2026-02-18T01:00:16.452 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836487 2026-02-18T01:00:16.452 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836487' 2026-02-18T01:00:16.452 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T01:00:16.453 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-18T01:00:16.529 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=42949672967 2026-02-18T01:00:16.529 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 42949672967 2026-02-18T01:00:16.529 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836487 1-42949672967' 2026-02-18T01:00:16.529 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T01:00:16.529 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-18T01:00:16.603 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=64424509446 2026-02-18T01:00:16.604 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 64424509446 2026-02-18T01:00:16.604 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836487 1-42949672967 2-64424509446' 2026-02-18T01:00:16.604 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T01:00:16.604 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836487 2026-02-18T01:00:16.605 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T01:00:16.605 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-18T01:00:16.606 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-21474836487 2026-02-18T01:00:16.606 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T01:00:16.608 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=21474836487 2026-02-18T01:00:16.608 INFO:tasks.workunit.client.0.trial069.stdout:waiting osd.0 seq 21474836487 2026-02-18T01:00:16.608 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 21474836487' 2026-02-18T01:00:16.608 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T01:00:16.830 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 21474836487 -lt 21474836487 2026-02-18T01:00:16.831 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T01:00:16.831 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-42949672967 2026-02-18T01:00:16.831 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T01:00:16.832 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=1 2026-02-18T01:00:16.833 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 1-42949672967 2026-02-18T01:00:16.833 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T01:00:16.834 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=42949672967 2026-02-18T01:00:16.835 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.1 seq 42949672967' 2026-02-18T01:00:16.835 INFO:tasks.workunit.client.0.trial069.stdout:waiting osd.1 seq 42949672967 2026-02-18T01:00:16.835 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-18T01:00:17.051 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 42949672967 -lt 42949672967 2026-02-18T01:00:17.051 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T01:00:17.052 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-64424509446 2026-02-18T01:00:17.052 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T01:00:17.053 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=2 2026-02-18T01:00:17.054 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 2-64424509446 2026-02-18T01:00:17.054 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T01:00:17.055 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=64424509446 2026-02-18T01:00:17.055 INFO:tasks.workunit.client.0.trial069.stdout:waiting osd.2 seq 64424509446 2026-02-18T01:00:17.056 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.2 seq 64424509446' 2026-02-18T01:00:17.056 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-18T01:00:17.275 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 64424509446 -lt 64424509446 2026-02-18T01:00:17.275 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-18T01:00:17.276 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T01:00:17.276 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T01:00:17.560 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 8 == 0 2026-02-18T01:00:17.560 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-18T01:00:17.560 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-18T01:00:17.560 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-18T01:00:17.560 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-18T01:00:17.561 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-18T01:00:17.561 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-18T01:00:17.561 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-18T01:00:17.770 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=8 2026-02-18T01:00:17.770 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-18T01:00:17.771 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T01:00:17.771 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T01:00:18.057 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 8 = 8 2026-02-18T01:00:18.057 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-18T01:00:18.058 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-18T01:00:18.058 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:89: TEST_snaptrim_stats: sleep 10 2026-02-18T01:00:28.057 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:90: TEST_snaptrim_stats: local objects_trimmed=0 2026-02-18T01:00:28.057 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:91: TEST_snaptrim_stats: local snaptrim_duration_total=0.0 2026-02-18T01:00:28.058 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:92: TEST_snaptrim_stats: expr 8 - 1 2026-02-18T01:00:28.060 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:92: TEST_snaptrim_stats: seq 0 7 2026-02-18T01:00:28.061 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:92: TEST_snaptrim_stats: for i in $(seq 0 $(expr $PGNUM - 1)) 2026-02-18T01:00:28.061 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:94: TEST_snaptrim_stats: local pgid=1.0 2026-02-18T01:00:28.063 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:96: TEST_snaptrim_stats: ceph pg 1.0 query 2026-02-18T01:00:28.063 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:96: TEST_snaptrim_stats: jq .info.stats.objects_trimmed 2026-02-18T01:00:28.143 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:96: TEST_snaptrim_stats: expr 0 + 2 2026-02-18T01:00:28.144 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:96: TEST_snaptrim_stats: objects_trimmed=2 2026-02-18T01:00:28.145 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:98: TEST_snaptrim_stats: bc 2026-02-18T01:00:28.145 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:98: TEST_snaptrim_stats: ceph pg 1.0 query 2026-02-18T01:00:28.146 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:98: TEST_snaptrim_stats: jq .info.stats.snaptrim_duration 2026-02-18T01:00:28.222 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:98: TEST_snaptrim_stats: echo 0.0 + 0.002134104 2026-02-18T01:00:28.223 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:98: TEST_snaptrim_stats: snaptrim_duration_total=.002134104 2026-02-18T01:00:28.223 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:92: TEST_snaptrim_stats: for i in $(seq 0 $(expr $PGNUM - 1)) 2026-02-18T01:00:28.223 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:94: TEST_snaptrim_stats: local pgid=1.1 2026-02-18T01:00:28.224 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:96: TEST_snaptrim_stats: ceph pg 1.1 query 2026-02-18T01:00:28.224 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:96: TEST_snaptrim_stats: jq .info.stats.objects_trimmed 2026-02-18T01:00:28.305 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:96: TEST_snaptrim_stats: expr 2 + 2 2026-02-18T01:00:28.306 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:96: TEST_snaptrim_stats: objects_trimmed=4 2026-02-18T01:00:28.307 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:98: TEST_snaptrim_stats: bc 2026-02-18T01:00:28.307 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:98: TEST_snaptrim_stats: ceph pg 1.1 query 2026-02-18T01:00:28.307 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:98: TEST_snaptrim_stats: jq .info.stats.snaptrim_duration 2026-02-18T01:00:28.385 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:98: TEST_snaptrim_stats: echo .002134104 + 0.001900172 2026-02-18T01:00:28.386 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:98: TEST_snaptrim_stats: snaptrim_duration_total=.004034276 2026-02-18T01:00:28.386 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:92: TEST_snaptrim_stats: for i in $(seq 0 $(expr $PGNUM - 1)) 2026-02-18T01:00:28.386 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:94: TEST_snaptrim_stats: local pgid=1.2 2026-02-18T01:00:28.387 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:96: TEST_snaptrim_stats: ceph pg 1.2 query 2026-02-18T01:00:28.387 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:96: TEST_snaptrim_stats: jq .info.stats.objects_trimmed 2026-02-18T01:00:28.468 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:96: TEST_snaptrim_stats: expr 4 + 0 2026-02-18T01:00:28.468 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:96: TEST_snaptrim_stats: objects_trimmed=4 2026-02-18T01:00:28.470 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:98: TEST_snaptrim_stats: bc 2026-02-18T01:00:28.470 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:98: TEST_snaptrim_stats: ceph pg 1.2 query 2026-02-18T01:00:28.470 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:98: TEST_snaptrim_stats: jq .info.stats.snaptrim_duration 2026-02-18T01:00:28.547 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:98: TEST_snaptrim_stats: echo .004034276 + 0.000416868 2026-02-18T01:00:28.548 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:98: TEST_snaptrim_stats: snaptrim_duration_total=.004451144 2026-02-18T01:00:28.548 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:92: TEST_snaptrim_stats: for i in $(seq 0 $(expr $PGNUM - 1)) 2026-02-18T01:00:28.548 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:94: TEST_snaptrim_stats: local pgid=1.3 2026-02-18T01:00:28.549 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:96: TEST_snaptrim_stats: ceph pg 1.3 query 2026-02-18T01:00:28.549 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:96: TEST_snaptrim_stats: jq .info.stats.objects_trimmed 2026-02-18T01:00:28.629 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:96: TEST_snaptrim_stats: expr 4 + 2 2026-02-18T01:00:28.630 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:96: TEST_snaptrim_stats: objects_trimmed=6 2026-02-18T01:00:28.631 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:98: TEST_snaptrim_stats: bc 2026-02-18T01:00:28.632 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:98: TEST_snaptrim_stats: ceph pg 1.3 query 2026-02-18T01:00:28.632 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:98: TEST_snaptrim_stats: jq .info.stats.snaptrim_duration 2026-02-18T01:00:28.710 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:98: TEST_snaptrim_stats: echo .004451144 + 0.002104498 2026-02-18T01:00:28.711 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:98: TEST_snaptrim_stats: snaptrim_duration_total=.006555642 2026-02-18T01:00:28.711 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:92: TEST_snaptrim_stats: for i in $(seq 0 $(expr $PGNUM - 1)) 2026-02-18T01:00:28.711 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:94: TEST_snaptrim_stats: local pgid=1.4 2026-02-18T01:00:28.711 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:96: TEST_snaptrim_stats: ceph pg 1.4 query 2026-02-18T01:00:28.712 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:96: TEST_snaptrim_stats: jq .info.stats.objects_trimmed 2026-02-18T01:00:28.793 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:96: TEST_snaptrim_stats: expr 6 + 1 2026-02-18T01:00:28.793 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:96: TEST_snaptrim_stats: objects_trimmed=7 2026-02-18T01:00:28.795 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:98: TEST_snaptrim_stats: bc 2026-02-18T01:00:28.795 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:98: TEST_snaptrim_stats: ceph pg 1.4 query 2026-02-18T01:00:28.795 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:98: TEST_snaptrim_stats: jq .info.stats.snaptrim_duration 2026-02-18T01:00:28.877 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:98: TEST_snaptrim_stats: echo .006555642 + 0.003413983 2026-02-18T01:00:28.878 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:98: TEST_snaptrim_stats: snaptrim_duration_total=.009969625 2026-02-18T01:00:28.878 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:92: TEST_snaptrim_stats: for i in $(seq 0 $(expr $PGNUM - 1)) 2026-02-18T01:00:28.878 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:94: TEST_snaptrim_stats: local pgid=1.5 2026-02-18T01:00:28.879 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:96: TEST_snaptrim_stats: ceph pg 1.5 query 2026-02-18T01:00:28.879 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:96: TEST_snaptrim_stats: jq .info.stats.objects_trimmed 2026-02-18T01:00:28.957 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:96: TEST_snaptrim_stats: expr 7 + 1 2026-02-18T01:00:28.958 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:96: TEST_snaptrim_stats: objects_trimmed=8 2026-02-18T01:00:28.959 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:98: TEST_snaptrim_stats: bc 2026-02-18T01:00:28.960 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:98: TEST_snaptrim_stats: ceph pg 1.5 query 2026-02-18T01:00:28.960 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:98: TEST_snaptrim_stats: jq .info.stats.snaptrim_duration 2026-02-18T01:00:29.042 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:98: TEST_snaptrim_stats: echo .009969625 + 0.001374138 2026-02-18T01:00:29.043 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:98: TEST_snaptrim_stats: snaptrim_duration_total=.011343763 2026-02-18T01:00:29.043 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:92: TEST_snaptrim_stats: for i in $(seq 0 $(expr $PGNUM - 1)) 2026-02-18T01:00:29.043 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:94: TEST_snaptrim_stats: local pgid=1.6 2026-02-18T01:00:29.044 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:96: TEST_snaptrim_stats: ceph pg 1.6 query 2026-02-18T01:00:29.045 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:96: TEST_snaptrim_stats: jq .info.stats.objects_trimmed 2026-02-18T01:00:29.123 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:96: TEST_snaptrim_stats: expr 8 + 0 2026-02-18T01:00:29.124 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:96: TEST_snaptrim_stats: objects_trimmed=8 2026-02-18T01:00:29.125 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:98: TEST_snaptrim_stats: bc 2026-02-18T01:00:29.126 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:98: TEST_snaptrim_stats: ceph pg 1.6 query 2026-02-18T01:00:29.126 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:98: TEST_snaptrim_stats: jq .info.stats.snaptrim_duration 2026-02-18T01:00:29.205 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:98: TEST_snaptrim_stats: echo .011343763 + 0.003605285 2026-02-18T01:00:29.206 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:98: TEST_snaptrim_stats: snaptrim_duration_total=.014949048 2026-02-18T01:00:29.206 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:92: TEST_snaptrim_stats: for i in $(seq 0 $(expr $PGNUM - 1)) 2026-02-18T01:00:29.206 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:94: TEST_snaptrim_stats: local pgid=1.7 2026-02-18T01:00:29.207 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:96: TEST_snaptrim_stats: ceph pg 1.7 query 2026-02-18T01:00:29.207 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:96: TEST_snaptrim_stats: jq .info.stats.objects_trimmed 2026-02-18T01:00:29.283 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:96: TEST_snaptrim_stats: expr 8 + 2 2026-02-18T01:00:29.284 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:96: TEST_snaptrim_stats: objects_trimmed=10 2026-02-18T01:00:29.285 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:98: TEST_snaptrim_stats: bc 2026-02-18T01:00:29.285 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:98: TEST_snaptrim_stats: ceph pg 1.7 query 2026-02-18T01:00:29.285 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:98: TEST_snaptrim_stats: jq .info.stats.snaptrim_duration 2026-02-18T01:00:29.365 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:98: TEST_snaptrim_stats: echo .014949048 + 0.00381449 2026-02-18T01:00:29.366 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:98: TEST_snaptrim_stats: snaptrim_duration_total=.018763538 2026-02-18T01:00:29.366 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:100: TEST_snaptrim_stats: test 10 -eq 10 2026-02-18T01:00:29.366 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:101: TEST_snaptrim_stats: echo '.018763538 > 0.0' 2026-02-18T01:00:29.367 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:101: TEST_snaptrim_stats: bc 2026-02-18T01:00:29.367 INFO:tasks.workunit.client.0.trial069.stdout:1 2026-02-18T01:00:29.368 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:103: TEST_snaptrim_stats: teardown td/test-snaptrim-stats 2026-02-18T01:00:29.368 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/test-snaptrim-stats 2026-02-18T01:00:29.368 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T01:00:29.368 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/test-snaptrim-stats KILL 2026-02-18T01:00:29.369 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T01:00:29.369 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T01:00:29.369 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T01:00:29.369 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T01:00:29.370 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T01:00:29.478 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T01:00:29.479 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T01:00:29.479 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T01:00:29.480 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T01:00:29.481 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T01:00:29.481 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T01:00:29.481 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T01:00:29.482 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T01:00:29.482 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T01:00:29.483 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T01:00:29.483 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T01:00:29.484 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T01:00:29.485 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T01:00:29.485 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/test-snaptrim-stats 2026-02-18T01:00:29.521 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T01:00:29.522 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:00:29.522 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.149617 2026-02-18T01:00:29.522 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.149617 2026-02-18T01:00:29.524 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T01:00:29.524 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T01:00:29.524 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:34: run: teardown td/test-snaptrim-stats 2026-02-18T01:00:29.524 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/test-snaptrim-stats 2026-02-18T01:00:29.524 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T01:00:29.524 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/test-snaptrim-stats KILL 2026-02-18T01:00:29.524 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T01:00:29.524 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T01:00:29.524 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T01:00:29.525 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T01:00:29.525 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T01:00:29.526 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T01:00:29.526 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T01:00:29.527 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T01:00:29.527 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T01:00:29.529 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T01:00:29.529 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T01:00:29.530 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T01:00:29.530 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T01:00:29.530 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T01:00:29.531 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T01:00:29.531 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T01:00:29.532 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T01:00:29.533 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T01:00:29.533 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/test-snaptrim-stats 2026-02-18T01:00:29.534 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T01:00:29.535 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:00:29.535 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.149617 2026-02-18T01:00:29.535 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.149617 2026-02-18T01:00:29.537 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T01:00:29.537 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T01:00:29.537 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:31: run: for func in $funcs 2026-02-18T01:00:29.537 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:32: run: setup td/test-snaptrim-stats 2026-02-18T01:00:29.538 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/test-snaptrim-stats 2026-02-18T01:00:29.538 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/test-snaptrim-stats 2026-02-18T01:00:29.538 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/test-snaptrim-stats 2026-02-18T01:00:29.538 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T01:00:29.538 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/test-snaptrim-stats KILL 2026-02-18T01:00:29.538 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T01:00:29.538 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T01:00:29.538 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T01:00:29.538 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T01:00:29.538 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T01:00:29.539 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T01:00:29.539 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T01:00:29.540 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T01:00:29.540 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T01:00:29.542 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T01:00:29.542 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T01:00:29.542 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T01:00:29.543 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T01:00:29.543 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T01:00:29.544 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T01:00:29.544 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T01:00:29.545 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T01:00:29.546 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T01:00:29.546 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/test-snaptrim-stats 2026-02-18T01:00:29.547 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T01:00:29.547 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:00:29.547 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.149617 2026-02-18T01:00:29.548 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.149617 2026-02-18T01:00:29.548 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T01:00:29.549 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T01:00:29.549 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/test-snaptrim-stats 2026-02-18T01:00:29.550 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-18T01:00:29.550 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:00:29.550 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.149617 2026-02-18T01:00:29.550 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.149617 2026-02-18T01:00:29.551 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-18T01:00:29.554 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-18T01:00:29.554 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-18T01:00:29.554 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/test-snaptrim-stats 1' TERM HUP INT 2026-02-18T01:00:29.555 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:33: run: TEST_snaptrim_stats_multiple_snaps td/test-snaptrim-stats 2026-02-18T01:00:29.555 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:107: TEST_snaptrim_stats_multiple_snaps: local dir=td/test-snaptrim-stats 2026-02-18T01:00:29.555 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:108: TEST_snaptrim_stats_multiple_snaps: local poolname=test 2026-02-18T01:00:29.555 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:109: TEST_snaptrim_stats_multiple_snaps: local OSDS=3 2026-02-18T01:00:29.555 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:110: TEST_snaptrim_stats_multiple_snaps: local PGNUM=8 2026-02-18T01:00:29.555 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:111: TEST_snaptrim_stats_multiple_snaps: local PGPNUM=8 2026-02-18T01:00:29.555 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:112: TEST_snaptrim_stats_multiple_snaps: local objects=10 2026-02-18T01:00:29.555 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:113: TEST_snaptrim_stats_multiple_snaps: local WAIT_FOR_UPDATE=10 2026-02-18T01:00:29.555 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:115: TEST_snaptrim_stats_multiple_snaps: setup td/test-snaptrim-stats 2026-02-18T01:00:29.555 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/test-snaptrim-stats 2026-02-18T01:00:29.555 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/test-snaptrim-stats 2026-02-18T01:00:29.556 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/test-snaptrim-stats 2026-02-18T01:00:29.556 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T01:00:29.556 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/test-snaptrim-stats KILL 2026-02-18T01:00:29.556 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T01:00:29.556 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T01:00:29.556 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T01:00:29.556 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T01:00:29.556 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T01:00:29.557 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T01:00:29.557 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T01:00:29.557 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T01:00:29.557 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T01:00:29.558 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T01:00:29.559 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T01:00:29.559 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T01:00:29.560 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T01:00:29.560 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T01:00:29.560 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T01:00:29.561 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T01:00:29.561 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T01:00:29.563 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T01:00:29.563 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/test-snaptrim-stats 2026-02-18T01:00:29.564 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T01:00:29.564 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:00:29.564 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.149617 2026-02-18T01:00:29.565 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.149617 2026-02-18T01:00:29.566 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T01:00:29.566 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T01:00:29.566 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/test-snaptrim-stats 2026-02-18T01:00:29.567 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-18T01:00:29.567 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:00:29.567 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.149617 2026-02-18T01:00:29.567 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.149617 2026-02-18T01:00:29.569 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-18T01:00:29.570 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-18T01:00:29.570 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-18T01:00:29.570 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/test-snaptrim-stats 1' TERM HUP INT 2026-02-18T01:00:29.570 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:116: TEST_snaptrim_stats_multiple_snaps: run_mon td/test-snaptrim-stats a --osd_pool_default_size=3 2026-02-18T01:00:29.570 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/test-snaptrim-stats 2026-02-18T01:00:29.570 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-18T01:00:29.570 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-18T01:00:29.571 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-18T01:00:29.571 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/test-snaptrim-stats/a 2026-02-18T01:00:29.571 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/test-snaptrim-stats/a --run-dir=td/test-snaptrim-stats --osd_pool_default_size=3 2026-02-18T01:00:29.591 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-18T01:00:29.592 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T01:00:29.592 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T01:00:29.592 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T01:00:29.592 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:00:29.592 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.149617 2026-02-18T01:00:29.592 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.149617/$cluster-$name.asok' 2026-02-18T01:00:29.593 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/test-snaptrim-stats/a '--log-file=td/test-snaptrim-stats/$name.log' '--admin-socket=/tmp/ceph-asok.149617/$cluster-$name.asok' --mon-cluster-log-file=td/test-snaptrim-stats/log --run-dir=td/test-snaptrim-stats '--pid-file=td/test-snaptrim-stats/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --osd_pool_default_size=3 2026-02-18T01:00:29.620 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-18T01:00:29.621 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-18T01:00:29.621 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T01:00:29.621 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-18T01:00:29.621 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-18T01:00:29.622 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-18T01:00:29.622 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-18T01:00:29.622 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T01:00:29.622 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T01:00:29.623 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T01:00:29.623 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:00:29.623 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.149617 2026-02-18T01:00:29.623 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.149617/ceph-mon.a.asok 2026-02-18T01:00:29.623 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T01:00:29.623 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.149617/ceph-mon.a.asok config get fsid 2026-02-18T01:00:29.679 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-18T01:00:29.679 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T01:00:29.679 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-18T01:00:29.679 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-18T01:00:29.680 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-18T01:00:29.680 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-18T01:00:29.680 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T01:00:29.680 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T01:00:29.680 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T01:00:29.680 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:00:29.680 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.149617 2026-02-18T01:00:29.680 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.149617/ceph-mon.a.asok 2026-02-18T01:00:29.681 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T01:00:29.681 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.149617/ceph-mon.a.asok config get mon_host 2026-02-18T01:00:29.736 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:117: TEST_snaptrim_stats_multiple_snaps: run_mgr td/test-snaptrim-stats x 2026-02-18T01:00:29.736 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/test-snaptrim-stats 2026-02-18T01:00:29.736 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-18T01:00:29.736 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-18T01:00:29.736 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-18T01:00:29.736 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/test-snaptrim-stats/x 2026-02-18T01:00:29.736 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-18T01:00:29.851 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-18T01:00:29.851 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T01:00:29.851 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T01:00:29.851 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T01:00:29.851 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:00:29.852 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.149617 2026-02-18T01:00:29.852 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.149617/$cluster-$name.asok' 2026-02-18T01:00:29.852 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-18T01:00:29.853 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/test-snaptrim-stats/x '--log-file=td/test-snaptrim-stats/$name.log' '--admin-socket=/tmp/ceph-asok.149617/$cluster-$name.asok' --run-dir=td/test-snaptrim-stats '--pid-file=td/test-snaptrim-stats/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-18T01:00:29.871 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:118: TEST_snaptrim_stats_multiple_snaps: expr 3 - 1 2026-02-18T01:00:29.872 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:118: TEST_snaptrim_stats_multiple_snaps: seq 0 2 2026-02-18T01:00:29.877 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:118: TEST_snaptrim_stats_multiple_snaps: for osd in $(seq 0 $(expr $OSDS - 1)) 2026-02-18T01:00:29.877 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:120: TEST_snaptrim_stats_multiple_snaps: run_osd td/test-snaptrim-stats 0 --osd_pool_default_pg_autoscale_mode=off 2026-02-18T01:00:29.877 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-snaptrim-stats 2026-02-18T01:00:29.877 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T01:00:29.877 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-18T01:00:29.877 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T01:00:29.878 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-snaptrim-stats/0 2026-02-18T01:00:29.878 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=0ac96446-9e30-4475-b12c-4674101a077e --auth-supported=none --mon-host=127.0.0.1:7124 --debug-bluestore 20 ' 2026-02-18T01:00:29.878 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T01:00:29.878 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T01:00:29.878 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T01:00:29.878 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-snaptrim-stats/0' 2026-02-18T01:00:29.878 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-snaptrim-stats/0/journal' 2026-02-18T01:00:29.878 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T01:00:29.878 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-18T01:00:29.878 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-snaptrim-stats' 2026-02-18T01:00:29.878 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T01:00:29.879 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T01:00:29.879 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T01:00:29.879 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T01:00:29.879 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:00:29.879 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.149617 2026-02-18T01:00:29.879 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.149617/$cluster-$name.asok' 2026-02-18T01:00:29.879 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.149617/$cluster-$name.asok' 2026-02-18T01:00:29.879 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T01:00:29.879 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T01:00:29.879 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T01:00:29.879 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-snaptrim-stats/$name.log' 2026-02-18T01:00:29.880 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-snaptrim-stats/$name.pid' 2026-02-18T01:00:29.880 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T01:00:29.880 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T01:00:29.880 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T01:00:29.880 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T01:00:29.880 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T01:00:29.880 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=--osd_pool_default_pg_autoscale_mode=off 2026-02-18T01:00:29.880 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-snaptrim-stats/0 2026-02-18T01:00:29.880 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T01:00:29.881 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=f94e7caa-71ed-4a15-8747-77b5084c9a7e 2026-02-18T01:00:29.881 INFO:tasks.workunit.client.0.trial069.stdout:add osd0 f94e7caa-71ed-4a15-8747-77b5084c9a7e 2026-02-18T01:00:29.882 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 f94e7caa-71ed-4a15-8747-77b5084c9a7e' 2026-02-18T01:00:29.882 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T01:00:29.888 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQAtD5VpKFlqNBAAtKMV0J4QPOozQk4fnZl7Lw== 2026-02-18T01:00:29.889 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQAtD5VpKFlqNBAAtKMV0J4QPOozQk4fnZl7Lw=="}' 2026-02-18T01:00:29.889 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new f94e7caa-71ed-4a15-8747-77b5084c9a7e -i td/test-snaptrim-stats/0/new.json 2026-02-18T01:00:29.998 INFO:tasks.workunit.client.0.trial069.stdout:0 2026-02-18T01:00:30.006 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-snaptrim-stats/0/new.json 2026-02-18T01:00:30.007 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=0ac96446-9e30-4475-b12c-4674101a077e --auth-supported=none --mon-host=127.0.0.1:7124 --debug-bluestore 20 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-snaptrim-stats/0 --osd-journal=td/test-snaptrim-stats/0/journal --chdir= --run-dir=td/test-snaptrim-stats '--admin-socket=/tmp/ceph-asok.149617/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-snaptrim-stats/$name.log' '--pid-file=td/test-snaptrim-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_pool_default_pg_autoscale_mode=off --mkfs --key AQAtD5VpKFlqNBAAtKMV0J4QPOozQk4fnZl7Lw== --osd-uuid f94e7caa-71ed-4a15-8747-77b5084c9a7e 2026-02-18T01:00:30.022 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T01:00:30.008+0000 7f24a4073a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:00:30.024 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T01:00:30.012+0000 7f24a4073a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:00:30.025 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T01:00:30.012+0000 7f24a4073a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:00:30.026 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T01:00:30.012+0000 7f24a4073a40 -1 bdev(0x561c80e02c00 td/test-snaptrim-stats/0/block) open stat got: (1) Operation not permitted 2026-02-18T01:00:30.026 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T01:00:30.012+0000 7f24a4073a40 -1 bluestore(td/test-snaptrim-stats/0) _read_fsid unparsable uuid 2026-02-18T01:00:30.732 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-snaptrim-stats/0/keyring 2026-02-18T01:00:30.732 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T01:00:30.733 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-18T01:00:30.733 INFO:tasks.workunit.client.0.trial069.stdout:adding osd0 key to auth repository 2026-02-18T01:00:30.733 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-snaptrim-stats/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T01:00:30.858 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-18T01:00:30.859 INFO:tasks.workunit.client.0.trial069.stdout:start osd.0 2026-02-18T01:00:30.860 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=0ac96446-9e30-4475-b12c-4674101a077e --auth-supported=none --mon-host=127.0.0.1:7124 --debug-bluestore 20 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-snaptrim-stats/0 --osd-journal=td/test-snaptrim-stats/0/journal --chdir= --run-dir=td/test-snaptrim-stats '--admin-socket=/tmp/ceph-asok.149617/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-snaptrim-stats/$name.log' '--pid-file=td/test-snaptrim-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_pool_default_pg_autoscale_mode=off 2026-02-18T01:00:30.860 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T01:00:30.860 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T01:00:30.860 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T01:00:30.883 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T01:00:30.868+0000 7f7d43136a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:00:30.885 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T01:00:30.872+0000 7f7d43136a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:00:30.886 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T01:00:30.872+0000 7f7d43136a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:00:30.968 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-18T01:00:30.968 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T01:00:30.968 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-18T01:00:30.968 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T01:00:30.968 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T01:00:30.968 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:00:30.969 INFO:tasks.workunit.client.0.trial069.stdout:0 2026-02-18T01:00:30.969 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T01:00:30.969 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:00:30.969 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T01:00:31.077 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T01:00:31.378 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T01:00:31.365+0000 7f7d43136a40 -1 Falling back to public interface 2026-02-18T01:00:32.078 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T01:00:32.079 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:00:32.079 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T01:00:32.079 INFO:tasks.workunit.client.0.trial069.stdout:1 2026-02-18T01:00:32.080 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:00:32.080 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T01:00:32.188 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T01:00:32.388 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T01:00:32.377+0000 7f7d43136a40 -1 osd.0 0 log_to_monitors true 2026-02-18T01:00:33.190 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T01:00:33.190 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:00:33.191 INFO:tasks.workunit.client.0.trial069.stdout:2 2026-02-18T01:00:33.191 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-18T01:00:33.191 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:00:33.192 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T01:00:33.402 INFO:tasks.workunit.client.0.trial069.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/4267303875,v1:127.0.0.1:6801/4267303875] [v2:127.0.0.1:6802/4267303875,v1:127.0.0.1:6803/4267303875] exists,up f94e7caa-71ed-4a15-8747-77b5084c9a7e 2026-02-18T01:00:33.406 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T01:00:33.406 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T01:00:33.406 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T01:00:33.406 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:118: TEST_snaptrim_stats_multiple_snaps: for osd in $(seq 0 $(expr $OSDS - 1)) 2026-02-18T01:00:33.406 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:120: TEST_snaptrim_stats_multiple_snaps: run_osd td/test-snaptrim-stats 1 --osd_pool_default_pg_autoscale_mode=off 2026-02-18T01:00:33.406 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-snaptrim-stats 2026-02-18T01:00:33.406 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T01:00:33.406 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2026-02-18T01:00:33.406 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T01:00:33.406 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-snaptrim-stats/1 2026-02-18T01:00:33.407 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=0ac96446-9e30-4475-b12c-4674101a077e --auth-supported=none --mon-host=127.0.0.1:7124 --debug-bluestore 20 ' 2026-02-18T01:00:33.407 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T01:00:33.407 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T01:00:33.407 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T01:00:33.407 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-snaptrim-stats/1' 2026-02-18T01:00:33.407 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-snaptrim-stats/1/journal' 2026-02-18T01:00:33.407 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T01:00:33.407 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-18T01:00:33.407 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-snaptrim-stats' 2026-02-18T01:00:33.407 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T01:00:33.407 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T01:00:33.407 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T01:00:33.408 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T01:00:33.408 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:00:33.408 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.149617 2026-02-18T01:00:33.408 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.149617/$cluster-$name.asok' 2026-02-18T01:00:33.408 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.149617/$cluster-$name.asok' 2026-02-18T01:00:33.408 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T01:00:33.408 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T01:00:33.408 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T01:00:33.408 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-snaptrim-stats/$name.log' 2026-02-18T01:00:33.408 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-snaptrim-stats/$name.pid' 2026-02-18T01:00:33.408 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T01:00:33.408 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T01:00:33.409 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T01:00:33.409 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T01:00:33.409 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T01:00:33.409 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=--osd_pool_default_pg_autoscale_mode=off 2026-02-18T01:00:33.409 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-snaptrim-stats/1 2026-02-18T01:00:33.410 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T01:00:33.410 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=52263ee8-05ac-4407-a078-47bab360ed94 2026-02-18T01:00:33.410 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 52263ee8-05ac-4407-a078-47bab360ed94' 2026-02-18T01:00:33.410 INFO:tasks.workunit.client.0.trial069.stdout:add osd1 52263ee8-05ac-4407-a078-47bab360ed94 2026-02-18T01:00:33.410 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T01:00:33.419 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQAxD5VpoyVxGBAAMFOL+3ldhDY8RfhrkCv3dQ== 2026-02-18T01:00:33.419 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQAxD5VpoyVxGBAAMFOL+3ldhDY8RfhrkCv3dQ=="}' 2026-02-18T01:00:33.419 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 52263ee8-05ac-4407-a078-47bab360ed94 -i td/test-snaptrim-stats/1/new.json 2026-02-18T01:00:33.638 INFO:tasks.workunit.client.0.trial069.stdout:1 2026-02-18T01:00:33.648 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-snaptrim-stats/1/new.json 2026-02-18T01:00:33.649 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=0ac96446-9e30-4475-b12c-4674101a077e --auth-supported=none --mon-host=127.0.0.1:7124 --debug-bluestore 20 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-snaptrim-stats/1 --osd-journal=td/test-snaptrim-stats/1/journal --chdir= --run-dir=td/test-snaptrim-stats '--admin-socket=/tmp/ceph-asok.149617/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-snaptrim-stats/$name.log' '--pid-file=td/test-snaptrim-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_pool_default_pg_autoscale_mode=off --mkfs --key AQAxD5VpoyVxGBAAMFOL+3ldhDY8RfhrkCv3dQ== --osd-uuid 52263ee8-05ac-4407-a078-47bab360ed94 2026-02-18T01:00:33.673 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T01:00:33.661+0000 7f17f66e5a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:00:33.675 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T01:00:33.661+0000 7f17f66e5a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:00:33.676 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T01:00:33.665+0000 7f17f66e5a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:00:33.677 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T01:00:33.665+0000 7f17f66e5a40 -1 bdev(0x55571887ec00 td/test-snaptrim-stats/1/block) open stat got: (1) Operation not permitted 2026-02-18T01:00:33.677 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T01:00:33.665+0000 7f17f66e5a40 -1 bluestore(td/test-snaptrim-stats/1) _read_fsid unparsable uuid 2026-02-18T01:00:34.367 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-snaptrim-stats/1/keyring 2026-02-18T01:00:34.368 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T01:00:34.368 INFO:tasks.workunit.client.0.trial069.stdout:adding osd1 key to auth repository 2026-02-18T01:00:34.369 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2026-02-18T01:00:34.369 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-snaptrim-stats/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T01:00:34.663 INFO:tasks.workunit.client.0.trial069.stdout:start osd.1 2026-02-18T01:00:34.663 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2026-02-18T01:00:34.663 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=0ac96446-9e30-4475-b12c-4674101a077e --auth-supported=none --mon-host=127.0.0.1:7124 --debug-bluestore 20 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-snaptrim-stats/1 --osd-journal=td/test-snaptrim-stats/1/journal --chdir= --run-dir=td/test-snaptrim-stats '--admin-socket=/tmp/ceph-asok.149617/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-snaptrim-stats/$name.log' '--pid-file=td/test-snaptrim-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_pool_default_pg_autoscale_mode=off 2026-02-18T01:00:34.664 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T01:00:34.664 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T01:00:34.664 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T01:00:34.677 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T01:00:34.665+0000 7effed830a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:00:34.679 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T01:00:34.665+0000 7effed830a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:00:34.680 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T01:00:34.669+0000 7effed830a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:00:34.871 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2026-02-18T01:00:34.871 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T01:00:34.871 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-18T01:00:34.871 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T01:00:34.871 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T01:00:34.871 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:00:34.871 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T01:00:34.872 INFO:tasks.workunit.client.0.trial069.stdout:0 2026-02-18T01:00:34.872 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:00:34.872 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-18T01:00:35.087 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T01:00:35.093 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T01:00:35.081+0000 7effed830a40 -1 Falling back to public interface 2026-02-18T01:00:35.666 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T01:00:35.653+0000 7effed830a40 -1 osd.1 0 log_to_monitors true 2026-02-18T01:00:36.088 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T01:00:36.088 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:00:36.088 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T01:00:36.089 INFO:tasks.workunit.client.0.trial069.stdout:1 2026-02-18T01:00:36.089 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:00:36.089 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-18T01:00:36.294 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T01:00:37.295 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T01:00:37.296 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:00:37.296 INFO:tasks.workunit.client.0.trial069.stdout:2 2026-02-18T01:00:37.297 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-18T01:00:37.297 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:00:37.297 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-18T01:00:37.508 INFO:tasks.workunit.client.0.trial069.stdout:osd.1 up in weight 1 up_from 10 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/342737235,v1:127.0.0.1:6811/342737235] [v2:127.0.0.1:6812/342737235,v1:127.0.0.1:6813/342737235] exists,up 52263ee8-05ac-4407-a078-47bab360ed94 2026-02-18T01:00:37.511 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T01:00:37.511 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T01:00:37.512 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T01:00:37.512 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:118: TEST_snaptrim_stats_multiple_snaps: for osd in $(seq 0 $(expr $OSDS - 1)) 2026-02-18T01:00:37.512 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:120: TEST_snaptrim_stats_multiple_snaps: run_osd td/test-snaptrim-stats 2 --osd_pool_default_pg_autoscale_mode=off 2026-02-18T01:00:37.512 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-snaptrim-stats 2026-02-18T01:00:37.512 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T01:00:37.512 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2026-02-18T01:00:37.512 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T01:00:37.512 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-snaptrim-stats/2 2026-02-18T01:00:37.512 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=0ac96446-9e30-4475-b12c-4674101a077e --auth-supported=none --mon-host=127.0.0.1:7124 --debug-bluestore 20 ' 2026-02-18T01:00:37.512 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T01:00:37.512 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T01:00:37.513 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T01:00:37.513 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-snaptrim-stats/2' 2026-02-18T01:00:37.513 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-snaptrim-stats/2/journal' 2026-02-18T01:00:37.513 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T01:00:37.513 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-18T01:00:37.513 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-snaptrim-stats' 2026-02-18T01:00:37.513 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T01:00:37.513 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T01:00:37.513 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T01:00:37.513 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T01:00:37.513 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:00:37.513 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.149617 2026-02-18T01:00:37.513 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.149617/$cluster-$name.asok' 2026-02-18T01:00:37.514 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.149617/$cluster-$name.asok' 2026-02-18T01:00:37.514 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T01:00:37.514 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T01:00:37.514 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T01:00:37.514 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-snaptrim-stats/$name.log' 2026-02-18T01:00:37.514 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-snaptrim-stats/$name.pid' 2026-02-18T01:00:37.514 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T01:00:37.514 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T01:00:37.514 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T01:00:37.514 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T01:00:37.514 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T01:00:37.514 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=--osd_pool_default_pg_autoscale_mode=off 2026-02-18T01:00:37.514 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-snaptrim-stats/2 2026-02-18T01:00:37.515 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T01:00:37.515 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=bfffdc26-8760-488e-9d85-d79c86fd526b 2026-02-18T01:00:37.516 INFO:tasks.workunit.client.0.trial069.stdout:add osd2 bfffdc26-8760-488e-9d85-d79c86fd526b 2026-02-18T01:00:37.516 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 bfffdc26-8760-488e-9d85-d79c86fd526b' 2026-02-18T01:00:37.516 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T01:00:37.525 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQA1D5VpMIjBHhAAPHJblsnEtqFKIk0p1O7e0Q== 2026-02-18T01:00:37.525 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQA1D5VpMIjBHhAAPHJblsnEtqFKIk0p1O7e0Q=="}' 2026-02-18T01:00:37.525 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new bfffdc26-8760-488e-9d85-d79c86fd526b -i td/test-snaptrim-stats/2/new.json 2026-02-18T01:00:37.743 INFO:tasks.workunit.client.0.trial069.stdout:2 2026-02-18T01:00:37.753 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-snaptrim-stats/2/new.json 2026-02-18T01:00:37.754 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --fsid=0ac96446-9e30-4475-b12c-4674101a077e --auth-supported=none --mon-host=127.0.0.1:7124 --debug-bluestore 20 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-snaptrim-stats/2 --osd-journal=td/test-snaptrim-stats/2/journal --chdir= --run-dir=td/test-snaptrim-stats '--admin-socket=/tmp/ceph-asok.149617/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-snaptrim-stats/$name.log' '--pid-file=td/test-snaptrim-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_pool_default_pg_autoscale_mode=off --mkfs --key AQA1D5VpMIjBHhAAPHJblsnEtqFKIk0p1O7e0Q== --osd-uuid bfffdc26-8760-488e-9d85-d79c86fd526b 2026-02-18T01:00:37.770 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T01:00:37.757+0000 7fc0e5bc0a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:00:37.771 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T01:00:37.757+0000 7fc0e5bc0a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:00:37.772 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T01:00:37.761+0000 7fc0e5bc0a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:00:37.773 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T01:00:37.761+0000 7fc0e5bc0a40 -1 bdev(0x55e6ae1dac00 td/test-snaptrim-stats/2/block) open stat got: (1) Operation not permitted 2026-02-18T01:00:37.773 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T01:00:37.761+0000 7fc0e5bc0a40 -1 bluestore(td/test-snaptrim-stats/2) _read_fsid unparsable uuid 2026-02-18T01:00:38.443 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-snaptrim-stats/2/keyring 2026-02-18T01:00:38.443 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T01:00:38.444 INFO:tasks.workunit.client.0.trial069.stdout:adding osd2 key to auth repository 2026-02-18T01:00:38.445 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2026-02-18T01:00:38.445 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-snaptrim-stats/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T01:00:38.731 INFO:tasks.workunit.client.0.trial069.stdout:start osd.2 2026-02-18T01:00:38.732 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2026-02-18T01:00:38.732 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --fsid=0ac96446-9e30-4475-b12c-4674101a077e --auth-supported=none --mon-host=127.0.0.1:7124 --debug-bluestore 20 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-snaptrim-stats/2 --osd-journal=td/test-snaptrim-stats/2/journal --chdir= --run-dir=td/test-snaptrim-stats '--admin-socket=/tmp/ceph-asok.149617/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-snaptrim-stats/$name.log' '--pid-file=td/test-snaptrim-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_pool_default_pg_autoscale_mode=off 2026-02-18T01:00:38.733 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T01:00:38.733 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T01:00:38.733 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T01:00:38.746 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T01:00:38.733+0000 7f44b0a22a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:00:38.748 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T01:00:38.737+0000 7f44b0a22a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:00:38.749 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T01:00:38.737+0000 7f44b0a22a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:00:38.942 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2026-02-18T01:00:38.943 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T01:00:38.943 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-18T01:00:38.943 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T01:00:38.943 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T01:00:38.943 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:00:38.943 INFO:tasks.workunit.client.0.trial069.stdout:0 2026-02-18T01:00:38.943 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T01:00:38.943 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:00:38.943 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-18T01:00:39.145 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T01:00:39.133+0000 7f44b0a22a40 -1 Falling back to public interface 2026-02-18T01:00:39.151 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T01:00:39.719 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T01:00:39.705+0000 7f44b0a22a40 -1 osd.2 0 log_to_monitors true 2026-02-18T01:00:40.152 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T01:00:40.152 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:00:40.153 INFO:tasks.workunit.client.0.trial069.stdout:1 2026-02-18T01:00:40.153 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T01:00:40.153 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:00:40.153 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-18T01:00:40.367 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T01:00:41.369 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T01:00:41.369 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:00:41.370 INFO:tasks.workunit.client.0.trial069.stdout:2 2026-02-18T01:00:41.370 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-18T01:00:41.370 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:00:41.370 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-18T01:00:41.585 INFO:tasks.workunit.client.0.trial069.stdout:osd.2 up in weight 1 up_from 15 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/1751121391,v1:127.0.0.1:6819/1751121391] [v2:127.0.0.1:6820/1751121391,v1:127.0.0.1:6821/1751121391] exists,up bfffdc26-8760-488e-9d85-d79c86fd526b 2026-02-18T01:00:41.585 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T01:00:41.585 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T01:00:41.585 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T01:00:41.585 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:124: TEST_snaptrim_stats_multiple_snaps: ceph osd set noscrub 2026-02-18T01:00:41.877 INFO:tasks.workunit.client.0.trial069.stderr:noscrub is set 2026-02-18T01:00:41.889 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:125: TEST_snaptrim_stats_multiple_snaps: ceph osd set nodeep-scrub 2026-02-18T01:00:42.182 INFO:tasks.workunit.client.0.trial069.stderr:nodeep-scrub is set 2026-02-18T01:00:42.192 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:128: TEST_snaptrim_stats_multiple_snaps: create_pool test 8 8 2026-02-18T01:00:42.193 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create test 8 8 2026-02-18T01:00:42.438 INFO:tasks.workunit.client.0.trial069.stderr:pool 'test' already exists 2026-02-18T01:00:42.448 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-18T01:00:43.450 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:129: TEST_snaptrim_stats_multiple_snaps: wait_for_clean 2026-02-18T01:00:43.450 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-18T01:00:43.450 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-18T01:00:43.450 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-18T01:00:43.451 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-18T01:00:43.451 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-18T01:00:43.451 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-18T01:00:43.452 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-18T01:00:43.452 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-18T01:00:43.452 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-18T01:00:43.543 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-18T01:00:43.544 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-18T01:00:43.544 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-18T01:00:43.544 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-18T01:00:43.544 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-18T01:00:43.544 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-18T01:00:43.756 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-18T01:00:43.757 INFO:tasks.workunit.client.0.trial069.stderr:1 2026-02-18T01:00:43.757 INFO:tasks.workunit.client.0.trial069.stderr:2' 2026-02-18T01:00:43.757 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-18T01:00:43.757 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T01:00:43.757 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-18T01:00:43.838 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836485 2026-02-18T01:00:43.839 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836485 2026-02-18T01:00:43.839 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836485' 2026-02-18T01:00:43.839 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T01:00:43.839 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-18T01:00:43.915 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=42949672964 2026-02-18T01:00:43.916 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 42949672964 2026-02-18T01:00:43.916 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836485 1-42949672964' 2026-02-18T01:00:43.916 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T01:00:43.916 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-18T01:00:43.991 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=64424509443 2026-02-18T01:00:43.991 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 64424509443 2026-02-18T01:00:43.991 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836485 1-42949672964 2-64424509443' 2026-02-18T01:00:43.991 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T01:00:43.992 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836485 2026-02-18T01:00:43.992 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T01:00:43.993 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-18T01:00:43.994 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-21474836485 2026-02-18T01:00:43.994 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T01:00:43.995 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=21474836485 2026-02-18T01:00:43.995 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 21474836485' 2026-02-18T01:00:43.995 INFO:tasks.workunit.client.0.trial069.stdout:waiting osd.0 seq 21474836485 2026-02-18T01:00:43.996 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T01:00:44.215 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 21474836485 -lt 21474836485 2026-02-18T01:00:44.215 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T01:00:44.216 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-42949672964 2026-02-18T01:00:44.216 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T01:00:44.216 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=1 2026-02-18T01:00:44.217 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 1-42949672964 2026-02-18T01:00:44.217 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T01:00:44.218 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=42949672964 2026-02-18T01:00:44.219 INFO:tasks.workunit.client.0.trial069.stdout:waiting osd.1 seq 42949672964 2026-02-18T01:00:44.219 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.1 seq 42949672964' 2026-02-18T01:00:44.219 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-18T01:00:44.443 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 42949672964 -lt 42949672964 2026-02-18T01:00:44.444 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T01:00:44.444 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-64424509443 2026-02-18T01:00:44.444 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T01:00:44.445 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=2 2026-02-18T01:00:44.446 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 2-64424509443 2026-02-18T01:00:44.446 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T01:00:44.447 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=64424509443 2026-02-18T01:00:44.448 INFO:tasks.workunit.client.0.trial069.stdout:waiting osd.2 seq 64424509443 2026-02-18T01:00:44.448 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.2 seq 64424509443' 2026-02-18T01:00:44.448 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-18T01:00:44.655 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 64424509443 -lt 64424509443 2026-02-18T01:00:44.656 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-18T01:00:44.656 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T01:00:44.656 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T01:00:44.940 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 8 == 0 2026-02-18T01:00:44.940 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-18T01:00:44.940 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-18T01:00:44.940 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-18T01:00:44.940 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-18T01:00:44.941 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-18T01:00:44.941 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-18T01:00:44.941 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-18T01:00:45.148 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=8 2026-02-18T01:00:45.148 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-18T01:00:45.148 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T01:00:45.148 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T01:00:45.432 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 8 = 8 2026-02-18T01:00:45.432 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-18T01:00:45.432 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-18T01:00:45.433 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:130: TEST_snaptrim_stats_multiple_snaps: ceph osd dump 2026-02-18T01:00:45.433 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:130: TEST_snaptrim_stats_multiple_snaps: grep '^pool.*['\'']test['\'']' 2026-02-18T01:00:45.433 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:130: TEST_snaptrim_stats_multiple_snaps: awk '{ print $2 }' 2026-02-18T01:00:45.647 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:130: TEST_snaptrim_stats_multiple_snaps: poolid=1 2026-02-18T01:00:45.647 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:133: TEST_snaptrim_stats_multiple_snaps: local TESTDATA=testdata.0 2026-02-18T01:00:45.647 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:134: TEST_snaptrim_stats_multiple_snaps: dd if=/dev/urandom of=testdata.0 bs=4096 count=1 2026-02-18T01:00:45.648 INFO:tasks.workunit.client.0.trial069.stderr:1+0 records in 2026-02-18T01:00:45.648 INFO:tasks.workunit.client.0.trial069.stderr:1+0 records out 2026-02-18T01:00:45.648 INFO:tasks.workunit.client.0.trial069.stderr:4096 bytes (4.1 kB, 4.0 KiB) copied, 4.3643e-05 s, 93.9 MB/s 2026-02-18T01:00:45.649 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:135: TEST_snaptrim_stats_multiple_snaps: seq 1 10 2026-02-18T01:00:45.649 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:135: TEST_snaptrim_stats_multiple_snaps: for i in `seq 1 $objects` 2026-02-18T01:00:45.649 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:137: TEST_snaptrim_stats_multiple_snaps: rados -p test put obj1 testdata.0 2026-02-18T01:00:45.668 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:135: TEST_snaptrim_stats_multiple_snaps: for i in `seq 1 $objects` 2026-02-18T01:00:45.668 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:137: TEST_snaptrim_stats_multiple_snaps: rados -p test put obj2 testdata.0 2026-02-18T01:00:45.692 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:135: TEST_snaptrim_stats_multiple_snaps: for i in `seq 1 $objects` 2026-02-18T01:00:45.692 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:137: TEST_snaptrim_stats_multiple_snaps: rados -p test put obj3 testdata.0 2026-02-18T01:00:45.717 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:135: TEST_snaptrim_stats_multiple_snaps: for i in `seq 1 $objects` 2026-02-18T01:00:45.717 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:137: TEST_snaptrim_stats_multiple_snaps: rados -p test put obj4 testdata.0 2026-02-18T01:00:45.742 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:135: TEST_snaptrim_stats_multiple_snaps: for i in `seq 1 $objects` 2026-02-18T01:00:45.743 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:137: TEST_snaptrim_stats_multiple_snaps: rados -p test put obj5 testdata.0 2026-02-18T01:00:45.768 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:135: TEST_snaptrim_stats_multiple_snaps: for i in `seq 1 $objects` 2026-02-18T01:00:45.768 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:137: TEST_snaptrim_stats_multiple_snaps: rados -p test put obj6 testdata.0 2026-02-18T01:00:45.786 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:135: TEST_snaptrim_stats_multiple_snaps: for i in `seq 1 $objects` 2026-02-18T01:00:45.786 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:137: TEST_snaptrim_stats_multiple_snaps: rados -p test put obj7 testdata.0 2026-02-18T01:00:45.810 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:135: TEST_snaptrim_stats_multiple_snaps: for i in `seq 1 $objects` 2026-02-18T01:00:45.810 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:137: TEST_snaptrim_stats_multiple_snaps: rados -p test put obj8 testdata.0 2026-02-18T01:00:45.835 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:135: TEST_snaptrim_stats_multiple_snaps: for i in `seq 1 $objects` 2026-02-18T01:00:45.835 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:137: TEST_snaptrim_stats_multiple_snaps: rados -p test put obj9 testdata.0 2026-02-18T01:00:45.860 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:135: TEST_snaptrim_stats_multiple_snaps: for i in `seq 1 $objects` 2026-02-18T01:00:45.860 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:137: TEST_snaptrim_stats_multiple_snaps: rados -p test put obj10 testdata.0 2026-02-18T01:00:45.884 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:139: TEST_snaptrim_stats_multiple_snaps: rm -f testdata.0 2026-02-18T01:00:45.886 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:142: TEST_snaptrim_stats_multiple_snaps: NUMSNAPS=2 2026-02-18T01:00:45.886 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:143: TEST_snaptrim_stats_multiple_snaps: seq 1 2 2026-02-18T01:00:45.887 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:143: TEST_snaptrim_stats_multiple_snaps: for i in `seq 1 $NUMSNAPS` 2026-02-18T01:00:45.887 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:145: TEST_snaptrim_stats_multiple_snaps: rados -p test mksnap snap1 2026-02-18T01:00:45.954 INFO:tasks.workunit.client.0.trial069.stdout:created pool test snap snap1 2026-02-18T01:00:45.956 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:146: TEST_snaptrim_stats_multiple_snaps: TESTDATA=testdata.1 2026-02-18T01:00:45.956 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:147: TEST_snaptrim_stats_multiple_snaps: dd if=/dev/urandom of=testdata.1 bs=4096 count=1 2026-02-18T01:00:45.956 INFO:tasks.workunit.client.0.trial069.stderr:1+0 records in 2026-02-18T01:00:45.957 INFO:tasks.workunit.client.0.trial069.stderr:1+0 records out 2026-02-18T01:00:45.957 INFO:tasks.workunit.client.0.trial069.stderr:4096 bytes (4.1 kB, 4.0 KiB) copied, 3.7691e-05 s, 109 MB/s 2026-02-18T01:00:45.957 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:148: TEST_snaptrim_stats_multiple_snaps: seq 1 10 2026-02-18T01:00:45.958 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:148: TEST_snaptrim_stats_multiple_snaps: for i in `seq 1 $objects` 2026-02-18T01:00:45.958 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:150: TEST_snaptrim_stats_multiple_snaps: rados -p test put obj1 testdata.1 2026-02-18T01:00:45.977 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:148: TEST_snaptrim_stats_multiple_snaps: for i in `seq 1 $objects` 2026-02-18T01:00:45.977 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:150: TEST_snaptrim_stats_multiple_snaps: rados -p test put obj2 testdata.1 2026-02-18T01:00:46.001 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:148: TEST_snaptrim_stats_multiple_snaps: for i in `seq 1 $objects` 2026-02-18T01:00:46.001 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:150: TEST_snaptrim_stats_multiple_snaps: rados -p test put obj3 testdata.1 2026-02-18T01:00:46.025 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:148: TEST_snaptrim_stats_multiple_snaps: for i in `seq 1 $objects` 2026-02-18T01:00:46.025 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:150: TEST_snaptrim_stats_multiple_snaps: rados -p test put obj4 testdata.1 2026-02-18T01:00:46.050 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:148: TEST_snaptrim_stats_multiple_snaps: for i in `seq 1 $objects` 2026-02-18T01:00:46.051 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:150: TEST_snaptrim_stats_multiple_snaps: rados -p test put obj5 testdata.1 2026-02-18T01:00:46.076 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:148: TEST_snaptrim_stats_multiple_snaps: for i in `seq 1 $objects` 2026-02-18T01:00:46.076 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:150: TEST_snaptrim_stats_multiple_snaps: rados -p test put obj6 testdata.1 2026-02-18T01:00:46.100 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:148: TEST_snaptrim_stats_multiple_snaps: for i in `seq 1 $objects` 2026-02-18T01:00:46.100 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:150: TEST_snaptrim_stats_multiple_snaps: rados -p test put obj7 testdata.1 2026-02-18T01:00:46.125 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:148: TEST_snaptrim_stats_multiple_snaps: for i in `seq 1 $objects` 2026-02-18T01:00:46.125 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:150: TEST_snaptrim_stats_multiple_snaps: rados -p test put obj8 testdata.1 2026-02-18T01:00:46.150 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:148: TEST_snaptrim_stats_multiple_snaps: for i in `seq 1 $objects` 2026-02-18T01:00:46.150 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:150: TEST_snaptrim_stats_multiple_snaps: rados -p test put obj9 testdata.1 2026-02-18T01:00:46.175 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:148: TEST_snaptrim_stats_multiple_snaps: for i in `seq 1 $objects` 2026-02-18T01:00:46.176 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:150: TEST_snaptrim_stats_multiple_snaps: rados -p test put obj10 testdata.1 2026-02-18T01:00:46.200 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:152: TEST_snaptrim_stats_multiple_snaps: rm -f testdata.1 2026-02-18T01:00:46.201 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:143: TEST_snaptrim_stats_multiple_snaps: for i in `seq 1 $NUMSNAPS` 2026-02-18T01:00:46.201 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:145: TEST_snaptrim_stats_multiple_snaps: rados -p test mksnap snap2 2026-02-18T01:00:46.256 INFO:tasks.workunit.client.0.trial069.stdout:created pool test snap snap2 2026-02-18T01:00:46.259 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:146: TEST_snaptrim_stats_multiple_snaps: TESTDATA=testdata.2 2026-02-18T01:00:46.259 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:147: TEST_snaptrim_stats_multiple_snaps: dd if=/dev/urandom of=testdata.2 bs=4096 count=1 2026-02-18T01:00:46.260 INFO:tasks.workunit.client.0.trial069.stderr:1+0 records in 2026-02-18T01:00:46.260 INFO:tasks.workunit.client.0.trial069.stderr:1+0 records out 2026-02-18T01:00:46.260 INFO:tasks.workunit.client.0.trial069.stderr:4096 bytes (4.1 kB, 4.0 KiB) copied, 7.0513e-05 s, 58.1 MB/s 2026-02-18T01:00:46.261 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:148: TEST_snaptrim_stats_multiple_snaps: seq 1 10 2026-02-18T01:00:46.262 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:148: TEST_snaptrim_stats_multiple_snaps: for i in `seq 1 $objects` 2026-02-18T01:00:46.262 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:150: TEST_snaptrim_stats_multiple_snaps: rados -p test put obj1 testdata.2 2026-02-18T01:00:46.282 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:148: TEST_snaptrim_stats_multiple_snaps: for i in `seq 1 $objects` 2026-02-18T01:00:46.282 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:150: TEST_snaptrim_stats_multiple_snaps: rados -p test put obj2 testdata.2 2026-02-18T01:00:46.307 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:148: TEST_snaptrim_stats_multiple_snaps: for i in `seq 1 $objects` 2026-02-18T01:00:46.307 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:150: TEST_snaptrim_stats_multiple_snaps: rados -p test put obj3 testdata.2 2026-02-18T01:00:46.333 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:148: TEST_snaptrim_stats_multiple_snaps: for i in `seq 1 $objects` 2026-02-18T01:00:46.333 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:150: TEST_snaptrim_stats_multiple_snaps: rados -p test put obj4 testdata.2 2026-02-18T01:00:46.357 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:148: TEST_snaptrim_stats_multiple_snaps: for i in `seq 1 $objects` 2026-02-18T01:00:46.358 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:150: TEST_snaptrim_stats_multiple_snaps: rados -p test put obj5 testdata.2 2026-02-18T01:00:46.383 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:148: TEST_snaptrim_stats_multiple_snaps: for i in `seq 1 $objects` 2026-02-18T01:00:46.383 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:150: TEST_snaptrim_stats_multiple_snaps: rados -p test put obj6 testdata.2 2026-02-18T01:00:46.407 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:148: TEST_snaptrim_stats_multiple_snaps: for i in `seq 1 $objects` 2026-02-18T01:00:46.408 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:150: TEST_snaptrim_stats_multiple_snaps: rados -p test put obj7 testdata.2 2026-02-18T01:00:46.426 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:148: TEST_snaptrim_stats_multiple_snaps: for i in `seq 1 $objects` 2026-02-18T01:00:46.426 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:150: TEST_snaptrim_stats_multiple_snaps: rados -p test put obj8 testdata.2 2026-02-18T01:00:46.450 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:148: TEST_snaptrim_stats_multiple_snaps: for i in `seq 1 $objects` 2026-02-18T01:00:46.450 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:150: TEST_snaptrim_stats_multiple_snaps: rados -p test put obj9 testdata.2 2026-02-18T01:00:46.475 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:148: TEST_snaptrim_stats_multiple_snaps: for i in `seq 1 $objects` 2026-02-18T01:00:46.475 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:150: TEST_snaptrim_stats_multiple_snaps: rados -p test put obj10 testdata.2 2026-02-18T01:00:46.500 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:152: TEST_snaptrim_stats_multiple_snaps: rm -f testdata.2 2026-02-18T01:00:46.501 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:156: TEST_snaptrim_stats_multiple_snaps: local total_objects_trimmed=0 2026-02-18T01:00:46.501 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:157: TEST_snaptrim_stats_multiple_snaps: seq 1 2 2026-02-18T01:00:46.502 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:157: TEST_snaptrim_stats_multiple_snaps: for i in `seq 1 $NUMSNAPS` 2026-02-18T01:00:46.503 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:159: TEST_snaptrim_stats_multiple_snaps: rados -p test rmsnap snap1 2026-02-18T01:00:46.570 INFO:tasks.workunit.client.0.trial069.stdout:removed pool test snap snap1 2026-02-18T01:00:46.573 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:162: TEST_snaptrim_stats_multiple_snaps: wait_for_clean 2026-02-18T01:00:46.573 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-18T01:00:46.574 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-18T01:00:46.574 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-18T01:00:46.574 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-18T01:00:46.575 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-18T01:00:46.575 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-18T01:00:46.575 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-18T01:00:46.575 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-18T01:00:46.575 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-18T01:00:46.677 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-18T01:00:46.677 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-18T01:00:46.678 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-18T01:00:46.678 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-18T01:00:46.678 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-18T01:00:46.678 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-18T01:00:46.893 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-18T01:00:46.894 INFO:tasks.workunit.client.0.trial069.stderr:1 2026-02-18T01:00:46.894 INFO:tasks.workunit.client.0.trial069.stderr:2' 2026-02-18T01:00:46.894 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-18T01:00:46.894 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T01:00:46.894 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-18T01:00:46.972 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836487 2026-02-18T01:00:46.972 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836487 2026-02-18T01:00:46.972 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836487' 2026-02-18T01:00:46.972 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T01:00:46.972 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-18T01:00:47.050 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=42949672967 2026-02-18T01:00:47.050 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 42949672967 2026-02-18T01:00:47.050 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836487 1-42949672967' 2026-02-18T01:00:47.050 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T01:00:47.051 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-18T01:00:47.128 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=64424509446 2026-02-18T01:00:47.128 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 64424509446 2026-02-18T01:00:47.128 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836487 1-42949672967 2-64424509446' 2026-02-18T01:00:47.128 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T01:00:47.129 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836487 2026-02-18T01:00:47.129 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T01:00:47.130 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-18T01:00:47.130 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-21474836487 2026-02-18T01:00:47.131 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T01:00:47.132 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=21474836487 2026-02-18T01:00:47.132 INFO:tasks.workunit.client.0.trial069.stdout:waiting osd.0 seq 21474836487 2026-02-18T01:00:47.133 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 21474836487' 2026-02-18T01:00:47.133 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T01:00:47.344 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 21474836485 -lt 21474836487 2026-02-18T01:00:47.344 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-18T01:00:48.345 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-18T01:00:48.346 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T01:00:48.556 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 21474836487 -lt 21474836487 2026-02-18T01:00:48.556 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T01:00:48.557 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-42949672967 2026-02-18T01:00:48.557 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T01:00:48.558 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=1 2026-02-18T01:00:48.558 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 1-42949672967 2026-02-18T01:00:48.559 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T01:00:48.560 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=42949672967 2026-02-18T01:00:48.560 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.1 seq 42949672967' 2026-02-18T01:00:48.560 INFO:tasks.workunit.client.0.trial069.stdout:waiting osd.1 seq 42949672967 2026-02-18T01:00:48.560 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-18T01:00:48.776 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 42949672967 -lt 42949672967 2026-02-18T01:00:48.777 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T01:00:48.777 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-64424509446 2026-02-18T01:00:48.777 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T01:00:48.778 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=2 2026-02-18T01:00:48.779 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 2-64424509446 2026-02-18T01:00:48.779 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T01:00:48.780 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=64424509446 2026-02-18T01:00:48.780 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.2 seq 64424509446' 2026-02-18T01:00:48.781 INFO:tasks.workunit.client.0.trial069.stdout:waiting osd.2 seq 64424509446 2026-02-18T01:00:48.781 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-18T01:00:48.988 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 64424509446 -lt 64424509446 2026-02-18T01:00:48.988 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-18T01:00:48.989 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T01:00:48.989 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T01:00:49.260 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 8 == 0 2026-02-18T01:00:49.261 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-18T01:00:49.261 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-18T01:00:49.261 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-18T01:00:49.261 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-18T01:00:49.261 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-18T01:00:49.261 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-18T01:00:49.261 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-18T01:00:49.465 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=8 2026-02-18T01:00:49.465 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-18T01:00:49.465 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T01:00:49.465 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T01:00:49.739 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 8 = 8 2026-02-18T01:00:49.739 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-18T01:00:49.739 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-18T01:00:49.739 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:163: TEST_snaptrim_stats_multiple_snaps: sleep 10 2026-02-18T01:00:59.740 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:164: TEST_snaptrim_stats_multiple_snaps: local objects_trimmed=0 2026-02-18T01:00:59.740 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:165: TEST_snaptrim_stats_multiple_snaps: local snaptrim_duration_total=0.0 2026-02-18T01:00:59.741 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:166: TEST_snaptrim_stats_multiple_snaps: expr 8 - 1 2026-02-18T01:00:59.741 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:166: TEST_snaptrim_stats_multiple_snaps: seq 0 7 2026-02-18T01:00:59.741 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:166: TEST_snaptrim_stats_multiple_snaps: for i in $(seq 0 $(expr $PGNUM - 1)) 2026-02-18T01:00:59.742 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:168: TEST_snaptrim_stats_multiple_snaps: local pgid=1.0 2026-02-18T01:00:59.743 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:170: TEST_snaptrim_stats_multiple_snaps: ceph pg 1.0 query 2026-02-18T01:00:59.743 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:170: TEST_snaptrim_stats_multiple_snaps: jq .info.stats.objects_trimmed 2026-02-18T01:00:59.821 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:170: TEST_snaptrim_stats_multiple_snaps: expr 0 + 2 2026-02-18T01:00:59.822 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:170: TEST_snaptrim_stats_multiple_snaps: objects_trimmed=2 2026-02-18T01:00:59.823 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:172: TEST_snaptrim_stats_multiple_snaps: bc 2026-02-18T01:00:59.823 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:172: TEST_snaptrim_stats_multiple_snaps: ceph pg 1.0 query 2026-02-18T01:00:59.823 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:172: TEST_snaptrim_stats_multiple_snaps: jq .info.stats.snaptrim_duration 2026-02-18T01:00:59.902 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:172: TEST_snaptrim_stats_multiple_snaps: echo 0.0 + 0.001461356 2026-02-18T01:00:59.903 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:172: TEST_snaptrim_stats_multiple_snaps: snaptrim_duration_total=.001461356 2026-02-18T01:00:59.903 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:166: TEST_snaptrim_stats_multiple_snaps: for i in $(seq 0 $(expr $PGNUM - 1)) 2026-02-18T01:00:59.903 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:168: TEST_snaptrim_stats_multiple_snaps: local pgid=1.1 2026-02-18T01:00:59.904 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:170: TEST_snaptrim_stats_multiple_snaps: ceph pg 1.1 query 2026-02-18T01:00:59.904 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:170: TEST_snaptrim_stats_multiple_snaps: jq .info.stats.objects_trimmed 2026-02-18T01:00:59.981 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:170: TEST_snaptrim_stats_multiple_snaps: expr 2 + 2 2026-02-18T01:00:59.982 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:170: TEST_snaptrim_stats_multiple_snaps: objects_trimmed=4 2026-02-18T01:00:59.982 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:172: TEST_snaptrim_stats_multiple_snaps: bc 2026-02-18T01:00:59.983 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:172: TEST_snaptrim_stats_multiple_snaps: ceph pg 1.1 query 2026-02-18T01:00:59.983 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:172: TEST_snaptrim_stats_multiple_snaps: jq .info.stats.snaptrim_duration 2026-02-18T01:01:00.069 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:172: TEST_snaptrim_stats_multiple_snaps: echo .001461356 + 0.002152662 2026-02-18T01:01:00.069 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:172: TEST_snaptrim_stats_multiple_snaps: snaptrim_duration_total=.003614018 2026-02-18T01:01:00.070 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:166: TEST_snaptrim_stats_multiple_snaps: for i in $(seq 0 $(expr $PGNUM - 1)) 2026-02-18T01:01:00.070 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:168: TEST_snaptrim_stats_multiple_snaps: local pgid=1.2 2026-02-18T01:01:00.070 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:170: TEST_snaptrim_stats_multiple_snaps: ceph pg 1.2 query 2026-02-18T01:01:00.070 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:170: TEST_snaptrim_stats_multiple_snaps: jq .info.stats.objects_trimmed 2026-02-18T01:01:00.152 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:170: TEST_snaptrim_stats_multiple_snaps: expr 4 + 0 2026-02-18T01:01:00.154 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:170: TEST_snaptrim_stats_multiple_snaps: objects_trimmed=4 2026-02-18T01:01:00.154 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:172: TEST_snaptrim_stats_multiple_snaps: bc 2026-02-18T01:01:00.155 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:172: TEST_snaptrim_stats_multiple_snaps: ceph pg 1.2 query 2026-02-18T01:01:00.155 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:172: TEST_snaptrim_stats_multiple_snaps: jq .info.stats.snaptrim_duration 2026-02-18T01:01:00.235 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:172: TEST_snaptrim_stats_multiple_snaps: echo .003614018 + 0.000340272 2026-02-18T01:01:00.236 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:172: TEST_snaptrim_stats_multiple_snaps: snaptrim_duration_total=.003954290 2026-02-18T01:01:00.236 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:166: TEST_snaptrim_stats_multiple_snaps: for i in $(seq 0 $(expr $PGNUM - 1)) 2026-02-18T01:01:00.236 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:168: TEST_snaptrim_stats_multiple_snaps: local pgid=1.3 2026-02-18T01:01:00.236 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:170: TEST_snaptrim_stats_multiple_snaps: ceph pg 1.3 query 2026-02-18T01:01:00.236 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:170: TEST_snaptrim_stats_multiple_snaps: jq .info.stats.objects_trimmed 2026-02-18T01:01:00.315 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:170: TEST_snaptrim_stats_multiple_snaps: expr 4 + 2 2026-02-18T01:01:00.316 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:170: TEST_snaptrim_stats_multiple_snaps: objects_trimmed=6 2026-02-18T01:01:00.316 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:172: TEST_snaptrim_stats_multiple_snaps: bc 2026-02-18T01:01:00.317 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:172: TEST_snaptrim_stats_multiple_snaps: ceph pg 1.3 query 2026-02-18T01:01:00.317 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:172: TEST_snaptrim_stats_multiple_snaps: jq .info.stats.snaptrim_duration 2026-02-18T01:01:00.396 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:172: TEST_snaptrim_stats_multiple_snaps: echo .003954290 + 0.001609907 2026-02-18T01:01:00.396 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:172: TEST_snaptrim_stats_multiple_snaps: snaptrim_duration_total=.005564197 2026-02-18T01:01:00.397 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:166: TEST_snaptrim_stats_multiple_snaps: for i in $(seq 0 $(expr $PGNUM - 1)) 2026-02-18T01:01:00.397 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:168: TEST_snaptrim_stats_multiple_snaps: local pgid=1.4 2026-02-18T01:01:00.397 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:170: TEST_snaptrim_stats_multiple_snaps: ceph pg 1.4 query 2026-02-18T01:01:00.397 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:170: TEST_snaptrim_stats_multiple_snaps: jq .info.stats.objects_trimmed 2026-02-18T01:01:00.476 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:170: TEST_snaptrim_stats_multiple_snaps: expr 6 + 1 2026-02-18T01:01:00.477 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:170: TEST_snaptrim_stats_multiple_snaps: objects_trimmed=7 2026-02-18T01:01:00.477 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:172: TEST_snaptrim_stats_multiple_snaps: bc 2026-02-18T01:01:00.478 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:172: TEST_snaptrim_stats_multiple_snaps: ceph pg 1.4 query 2026-02-18T01:01:00.478 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:172: TEST_snaptrim_stats_multiple_snaps: jq .info.stats.snaptrim_duration 2026-02-18T01:01:00.558 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:172: TEST_snaptrim_stats_multiple_snaps: echo .005564197 + 0.002840328 2026-02-18T01:01:00.558 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:172: TEST_snaptrim_stats_multiple_snaps: snaptrim_duration_total=.008404525 2026-02-18T01:01:00.559 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:166: TEST_snaptrim_stats_multiple_snaps: for i in $(seq 0 $(expr $PGNUM - 1)) 2026-02-18T01:01:00.559 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:168: TEST_snaptrim_stats_multiple_snaps: local pgid=1.5 2026-02-18T01:01:00.559 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:170: TEST_snaptrim_stats_multiple_snaps: ceph pg 1.5 query 2026-02-18T01:01:00.560 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:170: TEST_snaptrim_stats_multiple_snaps: jq .info.stats.objects_trimmed 2026-02-18T01:01:00.638 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:170: TEST_snaptrim_stats_multiple_snaps: expr 7 + 1 2026-02-18T01:01:00.639 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:170: TEST_snaptrim_stats_multiple_snaps: objects_trimmed=8 2026-02-18T01:01:00.639 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:172: TEST_snaptrim_stats_multiple_snaps: bc 2026-02-18T01:01:00.640 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:172: TEST_snaptrim_stats_multiple_snaps: ceph pg 1.5 query 2026-02-18T01:01:00.640 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:172: TEST_snaptrim_stats_multiple_snaps: jq .info.stats.snaptrim_duration 2026-02-18T01:01:00.718 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:172: TEST_snaptrim_stats_multiple_snaps: echo .008404525 + 0.001636718 2026-02-18T01:01:00.719 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:172: TEST_snaptrim_stats_multiple_snaps: snaptrim_duration_total=.010041243 2026-02-18T01:01:00.719 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:166: TEST_snaptrim_stats_multiple_snaps: for i in $(seq 0 $(expr $PGNUM - 1)) 2026-02-18T01:01:00.719 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:168: TEST_snaptrim_stats_multiple_snaps: local pgid=1.6 2026-02-18T01:01:00.720 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:170: TEST_snaptrim_stats_multiple_snaps: ceph pg 1.6 query 2026-02-18T01:01:00.720 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:170: TEST_snaptrim_stats_multiple_snaps: jq .info.stats.objects_trimmed 2026-02-18T01:01:00.801 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:170: TEST_snaptrim_stats_multiple_snaps: expr 8 + 0 2026-02-18T01:01:00.802 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:170: TEST_snaptrim_stats_multiple_snaps: objects_trimmed=8 2026-02-18T01:01:00.803 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:172: TEST_snaptrim_stats_multiple_snaps: bc 2026-02-18T01:01:00.803 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:172: TEST_snaptrim_stats_multiple_snaps: ceph pg 1.6 query 2026-02-18T01:01:00.803 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:172: TEST_snaptrim_stats_multiple_snaps: jq .info.stats.snaptrim_duration 2026-02-18T01:01:00.882 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:172: TEST_snaptrim_stats_multiple_snaps: echo .010041243 + 0.001610087 2026-02-18T01:01:00.883 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:172: TEST_snaptrim_stats_multiple_snaps: snaptrim_duration_total=.011651330 2026-02-18T01:01:00.883 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:166: TEST_snaptrim_stats_multiple_snaps: for i in $(seq 0 $(expr $PGNUM - 1)) 2026-02-18T01:01:00.883 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:168: TEST_snaptrim_stats_multiple_snaps: local pgid=1.7 2026-02-18T01:01:00.884 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:170: TEST_snaptrim_stats_multiple_snaps: ceph pg 1.7 query 2026-02-18T01:01:00.884 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:170: TEST_snaptrim_stats_multiple_snaps: jq .info.stats.objects_trimmed 2026-02-18T01:01:00.964 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:170: TEST_snaptrim_stats_multiple_snaps: expr 8 + 2 2026-02-18T01:01:00.965 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:170: TEST_snaptrim_stats_multiple_snaps: objects_trimmed=10 2026-02-18T01:01:00.966 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:172: TEST_snaptrim_stats_multiple_snaps: bc 2026-02-18T01:01:00.966 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:172: TEST_snaptrim_stats_multiple_snaps: ceph pg 1.7 query 2026-02-18T01:01:00.967 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:172: TEST_snaptrim_stats_multiple_snaps: jq .info.stats.snaptrim_duration 2026-02-18T01:01:01.046 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:172: TEST_snaptrim_stats_multiple_snaps: echo .011651330 + 0.003140123 2026-02-18T01:01:01.047 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:172: TEST_snaptrim_stats_multiple_snaps: snaptrim_duration_total=.014791453 2026-02-18T01:01:01.048 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:174: TEST_snaptrim_stats_multiple_snaps: test 10 -eq 10 2026-02-18T01:01:01.048 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:175: TEST_snaptrim_stats_multiple_snaps: echo '.014791453 > 0.0' 2026-02-18T01:01:01.048 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:175: TEST_snaptrim_stats_multiple_snaps: bc 2026-02-18T01:01:01.048 INFO:tasks.workunit.client.0.trial069.stdout:1 2026-02-18T01:01:01.049 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:176: TEST_snaptrim_stats_multiple_snaps: expr 0 + 10 2026-02-18T01:01:01.050 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:176: TEST_snaptrim_stats_multiple_snaps: total_objects_trimmed=10 2026-02-18T01:01:01.050 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:157: TEST_snaptrim_stats_multiple_snaps: for i in `seq 1 $NUMSNAPS` 2026-02-18T01:01:01.050 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:159: TEST_snaptrim_stats_multiple_snaps: rados -p test rmsnap snap2 2026-02-18T01:01:01.119 INFO:tasks.workunit.client.0.trial069.stdout:removed pool test snap snap2 2026-02-18T01:01:01.121 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:162: TEST_snaptrim_stats_multiple_snaps: wait_for_clean 2026-02-18T01:01:01.121 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-18T01:01:01.122 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-18T01:01:01.122 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-18T01:01:01.122 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-18T01:01:01.123 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-18T01:01:01.123 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-18T01:01:01.123 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-18T01:01:01.123 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-18T01:01:01.123 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-18T01:01:01.220 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-18T01:01:01.221 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-18T01:01:01.221 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-18T01:01:01.221 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-18T01:01:01.221 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-18T01:01:01.221 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-18T01:01:01.427 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-18T01:01:01.427 INFO:tasks.workunit.client.0.trial069.stderr:1 2026-02-18T01:01:01.427 INFO:tasks.workunit.client.0.trial069.stderr:2' 2026-02-18T01:01:01.427 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-18T01:01:01.427 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T01:01:01.427 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-18T01:01:01.504 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836492 2026-02-18T01:01:01.504 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836492 2026-02-18T01:01:01.504 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836492' 2026-02-18T01:01:01.504 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T01:01:01.504 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-18T01:01:01.579 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=42949672971 2026-02-18T01:01:01.579 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 42949672971 2026-02-18T01:01:01.579 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836492 1-42949672971' 2026-02-18T01:01:01.580 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T01:01:01.580 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-18T01:01:01.655 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=64424509451 2026-02-18T01:01:01.656 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 64424509451 2026-02-18T01:01:01.656 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836492 1-42949672971 2-64424509451' 2026-02-18T01:01:01.656 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T01:01:01.656 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836492 2026-02-18T01:01:01.656 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T01:01:01.657 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-18T01:01:01.658 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-21474836492 2026-02-18T01:01:01.658 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T01:01:01.659 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=21474836492 2026-02-18T01:01:01.659 INFO:tasks.workunit.client.0.trial069.stdout:waiting osd.0 seq 21474836492 2026-02-18T01:01:01.660 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 21474836492' 2026-02-18T01:01:01.660 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T01:01:01.877 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 21474836490 -lt 21474836492 2026-02-18T01:01:01.877 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-18T01:01:02.878 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-18T01:01:02.879 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T01:01:03.085 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 21474836492 -lt 21474836492 2026-02-18T01:01:03.085 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T01:01:03.086 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-42949672971 2026-02-18T01:01:03.086 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T01:01:03.087 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=1 2026-02-18T01:01:03.088 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 1-42949672971 2026-02-18T01:01:03.088 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T01:01:03.089 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=42949672971 2026-02-18T01:01:03.089 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.1 seq 42949672971' 2026-02-18T01:01:03.089 INFO:tasks.workunit.client.0.trial069.stdout:waiting osd.1 seq 42949672971 2026-02-18T01:01:03.090 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-18T01:01:03.310 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 42949672972 -lt 42949672971 2026-02-18T01:01:03.310 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T01:01:03.311 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-64424509451 2026-02-18T01:01:03.311 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T01:01:03.312 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=2 2026-02-18T01:01:03.313 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 2-64424509451 2026-02-18T01:01:03.313 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T01:01:03.314 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=64424509451 2026-02-18T01:01:03.314 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.2 seq 64424509451' 2026-02-18T01:01:03.315 INFO:tasks.workunit.client.0.trial069.stdout:waiting osd.2 seq 64424509451 2026-02-18T01:01:03.315 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-18T01:01:03.531 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 64424509451 -lt 64424509451 2026-02-18T01:01:03.531 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-18T01:01:03.532 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T01:01:03.532 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T01:01:03.805 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 8 == 0 2026-02-18T01:01:03.806 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-18T01:01:03.806 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-18T01:01:03.806 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-18T01:01:03.806 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-18T01:01:03.806 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-18T01:01:03.806 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-18T01:01:03.806 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-18T01:01:04.007 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=8 2026-02-18T01:01:04.008 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-18T01:01:04.008 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T01:01:04.008 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T01:01:04.278 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 8 = 8 2026-02-18T01:01:04.278 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-18T01:01:04.278 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-18T01:01:04.278 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:163: TEST_snaptrim_stats_multiple_snaps: sleep 10 2026-02-18T01:01:14.279 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:164: TEST_snaptrim_stats_multiple_snaps: local objects_trimmed=0 2026-02-18T01:01:14.279 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:165: TEST_snaptrim_stats_multiple_snaps: local snaptrim_duration_total=0.0 2026-02-18T01:01:14.280 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:166: TEST_snaptrim_stats_multiple_snaps: expr 8 - 1 2026-02-18T01:01:14.281 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:166: TEST_snaptrim_stats_multiple_snaps: seq 0 7 2026-02-18T01:01:14.282 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:166: TEST_snaptrim_stats_multiple_snaps: for i in $(seq 0 $(expr $PGNUM - 1)) 2026-02-18T01:01:14.282 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:168: TEST_snaptrim_stats_multiple_snaps: local pgid=1.0 2026-02-18T01:01:14.283 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:170: TEST_snaptrim_stats_multiple_snaps: ceph pg 1.0 query 2026-02-18T01:01:14.284 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:170: TEST_snaptrim_stats_multiple_snaps: jq .info.stats.objects_trimmed 2026-02-18T01:01:14.363 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:170: TEST_snaptrim_stats_multiple_snaps: expr 0 + 2 2026-02-18T01:01:14.364 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:170: TEST_snaptrim_stats_multiple_snaps: objects_trimmed=2 2026-02-18T01:01:14.365 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:172: TEST_snaptrim_stats_multiple_snaps: bc 2026-02-18T01:01:14.365 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:172: TEST_snaptrim_stats_multiple_snaps: ceph pg 1.0 query 2026-02-18T01:01:14.365 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:172: TEST_snaptrim_stats_multiple_snaps: jq .info.stats.snaptrim_duration 2026-02-18T01:01:14.442 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:172: TEST_snaptrim_stats_multiple_snaps: echo 0.0 + 0.002397901 2026-02-18T01:01:14.443 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:172: TEST_snaptrim_stats_multiple_snaps: snaptrim_duration_total=.002397901 2026-02-18T01:01:14.443 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:166: TEST_snaptrim_stats_multiple_snaps: for i in $(seq 0 $(expr $PGNUM - 1)) 2026-02-18T01:01:14.443 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:168: TEST_snaptrim_stats_multiple_snaps: local pgid=1.1 2026-02-18T01:01:14.444 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:170: TEST_snaptrim_stats_multiple_snaps: ceph pg 1.1 query 2026-02-18T01:01:14.444 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:170: TEST_snaptrim_stats_multiple_snaps: jq .info.stats.objects_trimmed 2026-02-18T01:01:14.522 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:170: TEST_snaptrim_stats_multiple_snaps: expr 2 + 2 2026-02-18T01:01:14.523 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:170: TEST_snaptrim_stats_multiple_snaps: objects_trimmed=4 2026-02-18T01:01:14.524 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:172: TEST_snaptrim_stats_multiple_snaps: bc 2026-02-18T01:01:14.525 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:172: TEST_snaptrim_stats_multiple_snaps: ceph pg 1.1 query 2026-02-18T01:01:14.525 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:172: TEST_snaptrim_stats_multiple_snaps: jq .info.stats.snaptrim_duration 2026-02-18T01:01:14.602 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:172: TEST_snaptrim_stats_multiple_snaps: echo .002397901 + 0.002168558 2026-02-18T01:01:14.603 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:172: TEST_snaptrim_stats_multiple_snaps: snaptrim_duration_total=.004566459 2026-02-18T01:01:14.603 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:166: TEST_snaptrim_stats_multiple_snaps: for i in $(seq 0 $(expr $PGNUM - 1)) 2026-02-18T01:01:14.603 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:168: TEST_snaptrim_stats_multiple_snaps: local pgid=1.2 2026-02-18T01:01:14.604 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:170: TEST_snaptrim_stats_multiple_snaps: ceph pg 1.2 query 2026-02-18T01:01:14.604 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:170: TEST_snaptrim_stats_multiple_snaps: jq .info.stats.objects_trimmed 2026-02-18T01:01:14.682 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:170: TEST_snaptrim_stats_multiple_snaps: expr 4 + 0 2026-02-18T01:01:14.683 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:170: TEST_snaptrim_stats_multiple_snaps: objects_trimmed=4 2026-02-18T01:01:14.683 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:172: TEST_snaptrim_stats_multiple_snaps: bc 2026-02-18T01:01:14.684 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:172: TEST_snaptrim_stats_multiple_snaps: ceph pg 1.2 query 2026-02-18T01:01:14.684 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:172: TEST_snaptrim_stats_multiple_snaps: jq .info.stats.snaptrim_duration 2026-02-18T01:01:14.761 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:172: TEST_snaptrim_stats_multiple_snaps: echo .004566459 + 0.000433948 2026-02-18T01:01:14.762 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:172: TEST_snaptrim_stats_multiple_snaps: snaptrim_duration_total=.005000407 2026-02-18T01:01:14.762 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:166: TEST_snaptrim_stats_multiple_snaps: for i in $(seq 0 $(expr $PGNUM - 1)) 2026-02-18T01:01:14.762 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:168: TEST_snaptrim_stats_multiple_snaps: local pgid=1.3 2026-02-18T01:01:14.763 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:170: TEST_snaptrim_stats_multiple_snaps: ceph pg 1.3 query 2026-02-18T01:01:14.763 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:170: TEST_snaptrim_stats_multiple_snaps: jq .info.stats.objects_trimmed 2026-02-18T01:01:14.841 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:170: TEST_snaptrim_stats_multiple_snaps: expr 4 + 2 2026-02-18T01:01:14.842 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:170: TEST_snaptrim_stats_multiple_snaps: objects_trimmed=6 2026-02-18T01:01:14.843 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:172: TEST_snaptrim_stats_multiple_snaps: bc 2026-02-18T01:01:14.843 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:172: TEST_snaptrim_stats_multiple_snaps: ceph pg 1.3 query 2026-02-18T01:01:14.844 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:172: TEST_snaptrim_stats_multiple_snaps: jq .info.stats.snaptrim_duration 2026-02-18T01:01:14.920 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:172: TEST_snaptrim_stats_multiple_snaps: echo .005000407 + 0.002324592 2026-02-18T01:01:14.921 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:172: TEST_snaptrim_stats_multiple_snaps: snaptrim_duration_total=.007324999 2026-02-18T01:01:14.921 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:166: TEST_snaptrim_stats_multiple_snaps: for i in $(seq 0 $(expr $PGNUM - 1)) 2026-02-18T01:01:14.921 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:168: TEST_snaptrim_stats_multiple_snaps: local pgid=1.4 2026-02-18T01:01:14.922 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:170: TEST_snaptrim_stats_multiple_snaps: ceph pg 1.4 query 2026-02-18T01:01:14.922 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:170: TEST_snaptrim_stats_multiple_snaps: jq .info.stats.objects_trimmed 2026-02-18T01:01:15.003 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:170: TEST_snaptrim_stats_multiple_snaps: expr 6 + 1 2026-02-18T01:01:15.004 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:170: TEST_snaptrim_stats_multiple_snaps: objects_trimmed=7 2026-02-18T01:01:15.004 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:172: TEST_snaptrim_stats_multiple_snaps: bc 2026-02-18T01:01:15.005 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:172: TEST_snaptrim_stats_multiple_snaps: ceph pg 1.4 query 2026-02-18T01:01:15.005 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:172: TEST_snaptrim_stats_multiple_snaps: jq .info.stats.snaptrim_duration 2026-02-18T01:01:15.086 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:172: TEST_snaptrim_stats_multiple_snaps: echo .007324999 + 0.00329453 2026-02-18T01:01:15.087 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:172: TEST_snaptrim_stats_multiple_snaps: snaptrim_duration_total=.010619529 2026-02-18T01:01:15.087 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:166: TEST_snaptrim_stats_multiple_snaps: for i in $(seq 0 $(expr $PGNUM - 1)) 2026-02-18T01:01:15.087 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:168: TEST_snaptrim_stats_multiple_snaps: local pgid=1.5 2026-02-18T01:01:15.087 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:170: TEST_snaptrim_stats_multiple_snaps: ceph pg 1.5 query 2026-02-18T01:01:15.087 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:170: TEST_snaptrim_stats_multiple_snaps: jq .info.stats.objects_trimmed 2026-02-18T01:01:15.166 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:170: TEST_snaptrim_stats_multiple_snaps: expr 7 + 1 2026-02-18T01:01:15.167 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:170: TEST_snaptrim_stats_multiple_snaps: objects_trimmed=8 2026-02-18T01:01:15.168 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:172: TEST_snaptrim_stats_multiple_snaps: bc 2026-02-18T01:01:15.168 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:172: TEST_snaptrim_stats_multiple_snaps: ceph pg 1.5 query 2026-02-18T01:01:15.169 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:172: TEST_snaptrim_stats_multiple_snaps: jq .info.stats.snaptrim_duration 2026-02-18T01:01:15.249 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:172: TEST_snaptrim_stats_multiple_snaps: echo .010619529 + 0.001978179 2026-02-18T01:01:15.250 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:172: TEST_snaptrim_stats_multiple_snaps: snaptrim_duration_total=.012597708 2026-02-18T01:01:15.250 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:166: TEST_snaptrim_stats_multiple_snaps: for i in $(seq 0 $(expr $PGNUM - 1)) 2026-02-18T01:01:15.250 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:168: TEST_snaptrim_stats_multiple_snaps: local pgid=1.6 2026-02-18T01:01:15.251 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:170: TEST_snaptrim_stats_multiple_snaps: ceph pg 1.6 query 2026-02-18T01:01:15.251 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:170: TEST_snaptrim_stats_multiple_snaps: jq .info.stats.objects_trimmed 2026-02-18T01:01:15.329 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:170: TEST_snaptrim_stats_multiple_snaps: expr 8 + 0 2026-02-18T01:01:15.329 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:170: TEST_snaptrim_stats_multiple_snaps: objects_trimmed=8 2026-02-18T01:01:15.330 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:172: TEST_snaptrim_stats_multiple_snaps: bc 2026-02-18T01:01:15.331 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:172: TEST_snaptrim_stats_multiple_snaps: ceph pg 1.6 query 2026-02-18T01:01:15.331 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:172: TEST_snaptrim_stats_multiple_snaps: jq .info.stats.snaptrim_duration 2026-02-18T01:01:15.406 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:172: TEST_snaptrim_stats_multiple_snaps: echo .012597708 + 0.002531983 2026-02-18T01:01:15.407 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:172: TEST_snaptrim_stats_multiple_snaps: snaptrim_duration_total=.015129691 2026-02-18T01:01:15.407 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:166: TEST_snaptrim_stats_multiple_snaps: for i in $(seq 0 $(expr $PGNUM - 1)) 2026-02-18T01:01:15.407 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:168: TEST_snaptrim_stats_multiple_snaps: local pgid=1.7 2026-02-18T01:01:15.408 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:170: TEST_snaptrim_stats_multiple_snaps: ceph pg 1.7 query 2026-02-18T01:01:15.408 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:170: TEST_snaptrim_stats_multiple_snaps: jq .info.stats.objects_trimmed 2026-02-18T01:01:15.487 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:170: TEST_snaptrim_stats_multiple_snaps: expr 8 + 2 2026-02-18T01:01:15.488 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:170: TEST_snaptrim_stats_multiple_snaps: objects_trimmed=10 2026-02-18T01:01:15.488 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:172: TEST_snaptrim_stats_multiple_snaps: bc 2026-02-18T01:01:15.489 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:172: TEST_snaptrim_stats_multiple_snaps: ceph pg 1.7 query 2026-02-18T01:01:15.489 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:172: TEST_snaptrim_stats_multiple_snaps: jq .info.stats.snaptrim_duration 2026-02-18T01:01:15.571 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:172: TEST_snaptrim_stats_multiple_snaps: echo .015129691 + 0.003648579 2026-02-18T01:01:15.572 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:172: TEST_snaptrim_stats_multiple_snaps: snaptrim_duration_total=.018778270 2026-02-18T01:01:15.572 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:174: TEST_snaptrim_stats_multiple_snaps: test 10 -eq 10 2026-02-18T01:01:15.572 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:175: TEST_snaptrim_stats_multiple_snaps: echo '.018778270 > 0.0' 2026-02-18T01:01:15.573 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:175: TEST_snaptrim_stats_multiple_snaps: bc 2026-02-18T01:01:15.573 INFO:tasks.workunit.client.0.trial069.stdout:1 2026-02-18T01:01:15.573 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:176: TEST_snaptrim_stats_multiple_snaps: expr 10 + 10 2026-02-18T01:01:15.575 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:176: TEST_snaptrim_stats_multiple_snaps: total_objects_trimmed=20 2026-02-18T01:01:15.575 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:179: TEST_snaptrim_stats_multiple_snaps: test 20 -eq 20 2026-02-18T01:01:15.575 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:181: TEST_snaptrim_stats_multiple_snaps: teardown td/test-snaptrim-stats 2026-02-18T01:01:15.575 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/test-snaptrim-stats 2026-02-18T01:01:15.575 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T01:01:15.576 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/test-snaptrim-stats KILL 2026-02-18T01:01:15.576 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T01:01:15.576 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T01:01:15.576 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T01:01:15.576 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T01:01:15.577 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T01:01:15.685 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T01:01:15.685 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T01:01:15.686 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T01:01:15.686 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T01:01:15.687 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T01:01:15.688 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T01:01:15.688 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T01:01:15.689 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T01:01:15.689 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T01:01:15.689 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T01:01:15.689 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T01:01:15.690 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T01:01:15.692 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T01:01:15.692 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/test-snaptrim-stats 2026-02-18T01:01:15.729 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T01:01:15.729 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:01:15.729 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.149617 2026-02-18T01:01:15.730 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.149617 2026-02-18T01:01:15.731 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T01:01:15.731 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T01:01:15.731 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:34: run: teardown td/test-snaptrim-stats 2026-02-18T01:01:15.731 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/test-snaptrim-stats 2026-02-18T01:01:15.731 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T01:01:15.732 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/test-snaptrim-stats KILL 2026-02-18T01:01:15.732 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T01:01:15.732 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T01:01:15.732 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T01:01:15.732 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T01:01:15.732 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T01:01:15.734 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T01:01:15.734 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T01:01:15.735 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T01:01:15.735 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T01:01:15.737 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T01:01:15.737 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T01:01:15.737 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T01:01:15.738 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T01:01:15.739 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T01:01:15.739 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T01:01:15.739 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T01:01:15.740 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T01:01:15.741 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T01:01:15.741 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/test-snaptrim-stats 2026-02-18T01:01:15.742 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T01:01:15.742 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:01:15.742 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.149617 2026-02-18T01:01:15.742 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.149617 2026-02-18T01:01:15.744 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T01:01:15.744 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T01:01:15.744 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2401: main: code=0 2026-02-18T01:01:15.745 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2405: main: teardown td/test-snaptrim-stats 0 2026-02-18T01:01:15.745 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/test-snaptrim-stats 2026-02-18T01:01:15.745 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs=0 2026-02-18T01:01:15.745 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/test-snaptrim-stats KILL 2026-02-18T01:01:15.745 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T01:01:15.745 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T01:01:15.745 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T01:01:15.745 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T01:01:15.745 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T01:01:15.747 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T01:01:15.747 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T01:01:15.747 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T01:01:15.748 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T01:01:15.749 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T01:01:15.749 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T01:01:15.750 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T01:01:15.751 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T01:01:15.751 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T01:01:15.751 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T01:01:15.751 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T01:01:15.753 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T01:01:15.753 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o 0 = 1 ']' 2026-02-18T01:01:15.753 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/test-snaptrim-stats 2026-02-18T01:01:15.754 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T01:01:15.754 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:01:15.754 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.149617 2026-02-18T01:01:15.755 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.149617 2026-02-18T01:01:15.756 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T01:01:15.756 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T01:01:15.756 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2406: main: return 0 2026-02-18T01:01:15.756 INFO:teuthology.orchestra.run:Running command with timeout 3600 2026-02-18T01:01:15.756 DEBUG:teuthology.orchestra.run.trial069:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2026-02-18T01:01:15.806 INFO:tasks.workunit:Running workunit misc/ver-health.sh... 2026-02-18T01:01:15.807 DEBUG:teuthology.orchestra.run.trial069:workunit test misc/ver-health.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=adc1923395f2bcd6ae89b5d331d278364d1848ed TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh 2026-02-18T01:01:15.856 INFO:tasks.workunit.client.0.trial069.stderr:stty: 'standard input': Inappropriate ioctl for device 2026-02-18T01:01:15.859 INFO:tasks.workunit.client.0.trial069.stderr:+ PS4='${BASH_SOURCE[0]}:$LINENO: ${FUNCNAME[0]}: ' 2026-02-18T01:01:15.859 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2394: main: export PATH=.:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2026-02-18T01:01:15.859 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2394: main: PATH=.:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2026-02-18T01:01:15.859 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2395: main: export PYTHONWARNINGS=ignore 2026-02-18T01:01:15.859 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2395: main: PYTHONWARNINGS=ignore 2026-02-18T01:01:15.859 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2396: main: export CEPH_CONF=/dev/null 2026-02-18T01:01:15.859 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2396: main: CEPH_CONF=/dev/null 2026-02-18T01:01:15.859 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2397: main: unset CEPH_ARGS 2026-02-18T01:01:15.859 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2399: main: local code 2026-02-18T01:01:15.859 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2400: main: run td/ver-health 2026-02-18T01:01:15.859 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:20: run: local dir=td/ver-health 2026-02-18T01:01:15.859 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:21: run: shift 2026-02-18T01:01:15.859 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:23: run: export CEPH_MON_A=127.0.0.1:7165 2026-02-18T01:01:15.859 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:23: run: CEPH_MON_A=127.0.0.1:7165 2026-02-18T01:01:15.859 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:24: run: export CEPH_MON_B=127.0.0.1:7166 2026-02-18T01:01:15.859 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:24: run: CEPH_MON_B=127.0.0.1:7166 2026-02-18T01:01:15.859 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:25: run: export CEPH_ARGS 2026-02-18T01:01:15.859 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:26: run: uuidgen 2026-02-18T01:01:15.860 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:26: run: CEPH_ARGS+='--fsid=f12f9151-9f82-4cd0-b200-adf3932f8443 --auth-supported=none ' 2026-02-18T01:01:15.860 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:27: run: CEPH_ARGS+='--mon-host= ' 2026-02-18T01:01:15.860 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:28: run: CEPH_ARGS+='--mon_health_to_clog_tick_interval=1.0 ' 2026-02-18T01:01:15.860 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:29: run: export 'ORIG_CEPH_ARGS=--fsid=f12f9151-9f82-4cd0-b200-adf3932f8443 --auth-supported=none --mon-host= --mon_health_to_clog_tick_interval=1.0 ' 2026-02-18T01:01:15.860 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:29: run: ORIG_CEPH_ARGS='--fsid=f12f9151-9f82-4cd0-b200-adf3932f8443 --auth-supported=none --mon-host= --mon_health_to_clog_tick_interval=1.0 ' 2026-02-18T01:01:15.860 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:31: run: set 2026-02-18T01:01:15.861 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:31: run: sed -n -e 's/^\(TEST_[0-9a-z_]*\) .*/\1/p' 2026-02-18T01:01:15.862 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:31: run: local 'funcs=TEST_check_version_health_1 2026-02-18T01:01:15.862 INFO:tasks.workunit.client.0.trial069.stderr:TEST_check_version_health_2 2026-02-18T01:01:15.862 INFO:tasks.workunit.client.0.trial069.stderr:TEST_check_version_health_3' 2026-02-18T01:01:15.862 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:32: run: for func in $funcs 2026-02-18T01:01:15.862 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:33: run: setup td/ver-health 2026-02-18T01:01:15.862 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/ver-health 2026-02-18T01:01:15.863 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/ver-health 2026-02-18T01:01:15.863 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/ver-health 2026-02-18T01:01:15.863 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T01:01:15.863 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/ver-health KILL 2026-02-18T01:01:15.863 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T01:01:15.863 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T01:01:15.863 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T01:01:15.863 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T01:01:15.863 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T01:01:15.865 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T01:01:15.865 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T01:01:15.866 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T01:01:15.866 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T01:01:15.867 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T01:01:15.867 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T01:01:15.868 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T01:01:15.868 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T01:01:15.868 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T01:01:15.869 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T01:01:15.869 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T01:01:15.870 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T01:01:15.871 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T01:01:15.871 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/ver-health 2026-02-18T01:01:15.872 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T01:01:15.872 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:01:15.872 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.162951 2026-02-18T01:01:15.873 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.162951 2026-02-18T01:01:15.873 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T01:01:15.873 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T01:01:15.873 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/ver-health 2026-02-18T01:01:15.874 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-18T01:01:15.875 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:01:15.875 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.162951 2026-02-18T01:01:15.875 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.162951 2026-02-18T01:01:15.876 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-18T01:01:15.878 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 1024 -le 1024 ']' 2026-02-18T01:01:15.878 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:127: setup: ulimit -n 4096 2026-02-18T01:01:15.879 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-18T01:01:15.879 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/ver-health 1' TERM HUP INT 2026-02-18T01:01:15.879 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:34: run: TEST_check_version_health_1 td/ver-health 2026-02-18T01:01:15.879 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:68: TEST_check_version_health_1: local dir=td/ver-health 2026-02-18T01:01:15.879 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:71: TEST_check_version_health_1: CEPH_ARGS='--fsid=f12f9151-9f82-4cd0-b200-adf3932f8443 --auth-supported=none --mon-host= --mon_health_to_clog_tick_interval=1.0 --mon-host=127.0.0.1:7165 ' 2026-02-18T01:01:15.879 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:73: TEST_check_version_health_1: setup td/ver-health 2026-02-18T01:01:15.879 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/ver-health 2026-02-18T01:01:15.879 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/ver-health 2026-02-18T01:01:15.879 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/ver-health 2026-02-18T01:01:15.879 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T01:01:15.879 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/ver-health KILL 2026-02-18T01:01:15.879 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T01:01:15.879 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T01:01:15.879 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T01:01:15.879 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T01:01:15.880 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T01:01:15.880 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T01:01:15.880 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T01:01:15.881 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T01:01:15.881 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T01:01:15.883 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T01:01:15.883 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T01:01:15.883 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T01:01:15.884 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T01:01:15.884 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T01:01:15.885 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T01:01:15.885 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T01:01:15.886 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T01:01:15.887 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T01:01:15.887 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/ver-health 2026-02-18T01:01:15.889 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T01:01:15.889 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:01:15.889 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.162951 2026-02-18T01:01:15.889 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.162951 2026-02-18T01:01:15.890 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T01:01:15.890 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T01:01:15.890 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/ver-health 2026-02-18T01:01:15.892 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-18T01:01:15.892 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:01:15.892 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.162951 2026-02-18T01:01:15.892 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.162951 2026-02-18T01:01:15.894 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-18T01:01:15.894 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-18T01:01:15.895 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-18T01:01:15.895 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/ver-health 1' TERM HUP INT 2026-02-18T01:01:15.895 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:76: TEST_check_version_health_1: run_mon td/ver-health a --public-addr=127.0.0.1:7165 --mon_warn_older_version_delay=0 2026-02-18T01:01:15.895 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/ver-health 2026-02-18T01:01:15.895 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-18T01:01:15.895 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-18T01:01:15.895 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-18T01:01:15.895 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/ver-health/a 2026-02-18T01:01:15.895 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/ver-health/a --run-dir=td/ver-health --public-addr=127.0.0.1:7165 --mon_warn_older_version_delay=0 2026-02-18T01:01:15.923 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-18T01:01:15.924 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T01:01:15.924 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T01:01:15.924 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T01:01:15.924 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:01:15.924 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.162951 2026-02-18T01:01:15.924 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.162951/$cluster-$name.asok' 2026-02-18T01:01:15.925 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/ver-health/a '--log-file=td/ver-health/$name.log' '--admin-socket=/tmp/ceph-asok.162951/$cluster-$name.asok' --mon-cluster-log-file=td/ver-health/log --run-dir=td/ver-health '--pid-file=td/ver-health/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --public-addr=127.0.0.1:7165 --mon_warn_older_version_delay=0 2026-02-18T01:01:15.955 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-18T01:01:15.956 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-18T01:01:15.956 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T01:01:15.956 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-18T01:01:15.956 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-18T01:01:15.956 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-18T01:01:15.957 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-18T01:01:15.957 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T01:01:15.957 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T01:01:15.957 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T01:01:15.958 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:01:15.958 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.162951 2026-02-18T01:01:15.958 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.162951/ceph-mon.a.asok 2026-02-18T01:01:15.958 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T01:01:15.958 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.162951/ceph-mon.a.asok config get fsid 2026-02-18T01:01:16.013 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-18T01:01:16.014 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T01:01:16.014 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-18T01:01:16.014 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-18T01:01:16.014 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-18T01:01:16.014 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-18T01:01:16.014 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T01:01:16.014 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T01:01:16.015 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T01:01:16.015 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:01:16.016 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.162951 2026-02-18T01:01:16.016 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.162951/ceph-mon.a.asok 2026-02-18T01:01:16.016 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T01:01:16.016 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.162951/ceph-mon.a.asok config get mon_host 2026-02-18T01:01:16.070 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:77: TEST_check_version_health_1: run_mon td/ver-health b --public-addr=127.0.0.1:7166 --mon_warn_older_version_delay=0 2026-02-18T01:01:16.070 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/ver-health 2026-02-18T01:01:16.070 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-18T01:01:16.070 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=b 2026-02-18T01:01:16.071 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-18T01:01:16.071 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/ver-health/b 2026-02-18T01:01:16.071 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id b --mkfs --mon-data=td/ver-health/b --run-dir=td/ver-health --public-addr=127.0.0.1:7166 --mon_warn_older_version_delay=0 2026-02-18T01:01:16.089 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-18T01:01:16.089 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T01:01:16.090 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T01:01:16.090 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T01:01:16.090 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:01:16.090 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.162951 2026-02-18T01:01:16.090 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.162951/$cluster-$name.asok' 2026-02-18T01:01:16.090 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id b --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/ver-health/b '--log-file=td/ver-health/$name.log' '--admin-socket=/tmp/ceph-asok.162951/$cluster-$name.asok' --mon-cluster-log-file=td/ver-health/log --run-dir=td/ver-health '--pid-file=td/ver-health/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --public-addr=127.0.0.1:7166 --mon_warn_older_version_delay=0 2026-02-18T01:01:16.117 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-18T01:01:16.118 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon b fsid 2026-02-18T01:01:16.118 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T01:01:16.118 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=b 2026-02-18T01:01:16.119 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-18T01:01:16.120 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-18T01:01:16.120 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.b 2026-02-18T01:01:16.120 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.b 2026-02-18T01:01:16.120 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.b ']' 2026-02-18T01:01:16.120 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T01:01:16.120 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:01:16.120 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.162951 2026-02-18T01:01:16.120 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.162951/ceph-mon.b.asok 2026-02-18T01:01:16.121 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T01:01:16.121 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.162951/ceph-mon.b.asok config get fsid 2026-02-18T01:01:16.174 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon b mon_host 2026-02-18T01:01:16.174 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T01:01:16.174 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=b 2026-02-18T01:01:16.174 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-18T01:01:16.174 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-18T01:01:16.176 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.b 2026-02-18T01:01:16.176 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.b 2026-02-18T01:01:16.176 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.b ']' 2026-02-18T01:01:16.176 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T01:01:16.176 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:01:16.176 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.162951 2026-02-18T01:01:16.176 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.162951/ceph-mon.b.asok 2026-02-18T01:01:16.176 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T01:01:16.176 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.162951/ceph-mon.b.asok config get mon_host 2026-02-18T01:01:16.231 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:78: TEST_check_version_health_1: run_osd td/ver-health 0 2026-02-18T01:01:16.231 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/ver-health 2026-02-18T01:01:16.231 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T01:01:16.231 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-18T01:01:16.231 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T01:01:16.231 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/ver-health/0 2026-02-18T01:01:16.231 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=f12f9151-9f82-4cd0-b200-adf3932f8443 --auth-supported=none --mon-host= --mon_health_to_clog_tick_interval=1.0 --mon-host=127.0.0.1:7165 ' 2026-02-18T01:01:16.232 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T01:01:16.232 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T01:01:16.232 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T01:01:16.232 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/ver-health/0' 2026-02-18T01:01:16.232 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/ver-health/0/journal' 2026-02-18T01:01:16.232 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T01:01:16.232 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-18T01:01:16.232 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/ver-health' 2026-02-18T01:01:16.232 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T01:01:16.232 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T01:01:16.232 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T01:01:16.232 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T01:01:16.233 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:01:16.233 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.162951 2026-02-18T01:01:16.233 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.162951/$cluster-$name.asok' 2026-02-18T01:01:16.233 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.162951/$cluster-$name.asok' 2026-02-18T01:01:16.233 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T01:01:16.233 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T01:01:16.233 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T01:01:16.233 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/ver-health/$name.log' 2026-02-18T01:01:16.233 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/ver-health/$name.pid' 2026-02-18T01:01:16.233 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T01:01:16.233 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T01:01:16.233 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T01:01:16.233 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T01:01:16.234 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T01:01:16.234 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-18T01:01:16.234 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/ver-health/0 2026-02-18T01:01:16.234 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T01:01:16.235 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=1f106b8b-8284-416e-b620-28536866fa3a 2026-02-18T01:01:16.235 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 1f106b8b-8284-416e-b620-28536866fa3a' 2026-02-18T01:01:16.235 INFO:tasks.workunit.client.0.trial069.stdout:add osd0 1f106b8b-8284-416e-b620-28536866fa3a 2026-02-18T01:01:16.235 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T01:01:16.244 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQBcD5VpnIUPDhAAUvMamPWq8iVs21TeLvw3qg== 2026-02-18T01:01:16.244 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQBcD5VpnIUPDhAAUvMamPWq8iVs21TeLvw3qg=="}' 2026-02-18T01:01:16.244 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 1f106b8b-8284-416e-b620-28536866fa3a -i td/ver-health/0/new.json 2026-02-18T01:01:22.369 INFO:tasks.workunit.client.0.trial069.stdout:0 2026-02-18T01:01:22.380 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/ver-health/0/new.json 2026-02-18T01:01:22.381 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=f12f9151-9f82-4cd0-b200-adf3932f8443 --auth-supported=none --mon-host= --mon_health_to_clog_tick_interval=1.0 --mon-host=127.0.0.1:7165 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ver-health/0 --osd-journal=td/ver-health/0/journal --chdir= --run-dir=td/ver-health '--admin-socket=/tmp/ceph-asok.162951/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ver-health/$name.log' '--pid-file=td/ver-health/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQBcD5VpnIUPDhAAUvMamPWq8iVs21TeLvw3qg== --osd-uuid 1f106b8b-8284-416e-b620-28536866fa3a 2026-02-18T01:01:22.402 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T01:01:22.389+0000 7fac0880fa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:01:22.404 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T01:01:22.393+0000 7fac0880fa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:01:22.405 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T01:01:22.393+0000 7fac0880fa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:01:22.405 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T01:01:22.393+0000 7fac0880fa40 -1 bdev(0x56003c406c00 td/ver-health/0/block) open stat got: (1) Operation not permitted 2026-02-18T01:01:22.406 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T01:01:22.393+0000 7fac0880fa40 -1 bluestore(td/ver-health/0) _read_fsid unparsable uuid 2026-02-18T01:01:23.046 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/ver-health/0/keyring 2026-02-18T01:01:23.046 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T01:01:23.047 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-18T01:01:23.047 INFO:tasks.workunit.client.0.trial069.stdout:adding osd0 key to auth repository 2026-02-18T01:01:23.047 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/ver-health/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T01:01:23.169 INFO:tasks.workunit.client.0.trial069.stdout:start osd.0 2026-02-18T01:01:23.170 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-18T01:01:23.170 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=f12f9151-9f82-4cd0-b200-adf3932f8443 --auth-supported=none --mon-host= --mon_health_to_clog_tick_interval=1.0 --mon-host=127.0.0.1:7165 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ver-health/0 --osd-journal=td/ver-health/0/journal --chdir= --run-dir=td/ver-health '--admin-socket=/tmp/ceph-asok.162951/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ver-health/$name.log' '--pid-file=td/ver-health/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T01:01:23.171 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T01:01:23.171 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T01:01:23.171 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T01:01:23.193 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T01:01:23.181+0000 7fed29398a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:01:23.194 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T01:01:23.181+0000 7fed29398a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:01:23.195 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T01:01:23.185+0000 7fed29398a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:01:23.281 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-18T01:01:23.282 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T01:01:23.282 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-18T01:01:23.282 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T01:01:23.282 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T01:01:23.282 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:01:23.282 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T01:01:23.282 INFO:tasks.workunit.client.0.trial069.stdout:0 2026-02-18T01:01:23.283 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:01:23.283 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T01:01:23.392 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T01:01:23.581 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T01:01:23.569+0000 7fed29398a40 -1 Falling back to public interface 2026-02-18T01:01:24.205 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T01:01:24.193+0000 7fed29398a40 -1 osd.0 0 log_to_monitors true 2026-02-18T01:01:24.394 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T01:01:24.394 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:01:24.394 INFO:tasks.workunit.client.0.trial069.stdout:1 2026-02-18T01:01:24.395 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T01:01:24.395 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:01:24.395 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T01:01:24.500 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T01:01:25.501 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T01:01:25.501 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:01:25.501 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-18T01:01:25.501 INFO:tasks.workunit.client.0.trial069.stdout:2 2026-02-18T01:01:25.501 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:01:25.501 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T01:01:25.612 INFO:tasks.workunit.client.0.trial069.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/1391142257,v1:127.0.0.1:6801/1391142257] [v2:127.0.0.1:6802/1391142257,v1:127.0.0.1:6803/1391142257] exists,up 1f106b8b-8284-416e-b620-28536866fa3a 2026-02-18T01:01:25.614 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T01:01:25.614 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T01:01:25.614 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T01:01:25.614 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:79: TEST_check_version_health_1: run_osd td/ver-health 1 2026-02-18T01:01:25.614 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/ver-health 2026-02-18T01:01:25.614 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T01:01:25.614 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2026-02-18T01:01:25.614 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T01:01:25.614 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/ver-health/1 2026-02-18T01:01:25.614 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=f12f9151-9f82-4cd0-b200-adf3932f8443 --auth-supported=none --mon-host= --mon_health_to_clog_tick_interval=1.0 --mon-host=127.0.0.1:7165 ' 2026-02-18T01:01:25.614 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T01:01:25.614 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T01:01:25.614 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T01:01:25.614 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/ver-health/1' 2026-02-18T01:01:25.614 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/ver-health/1/journal' 2026-02-18T01:01:25.614 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T01:01:25.614 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-18T01:01:25.614 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/ver-health' 2026-02-18T01:01:25.615 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T01:01:25.615 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T01:01:25.615 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T01:01:25.615 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T01:01:25.615 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:01:25.615 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.162951 2026-02-18T01:01:25.615 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.162951/$cluster-$name.asok' 2026-02-18T01:01:25.615 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.162951/$cluster-$name.asok' 2026-02-18T01:01:25.616 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T01:01:25.616 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T01:01:25.616 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T01:01:25.616 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/ver-health/$name.log' 2026-02-18T01:01:25.616 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/ver-health/$name.pid' 2026-02-18T01:01:25.616 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T01:01:25.616 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T01:01:25.616 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T01:01:25.616 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T01:01:25.616 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T01:01:25.616 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-18T01:01:25.616 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/ver-health/1 2026-02-18T01:01:25.616 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T01:01:25.617 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=46ceb568-7a17-4215-978f-5f11ac8d2534 2026-02-18T01:01:25.617 INFO:tasks.workunit.client.0.trial069.stdout:add osd1 46ceb568-7a17-4215-978f-5f11ac8d2534 2026-02-18T01:01:25.617 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 46ceb568-7a17-4215-978f-5f11ac8d2534' 2026-02-18T01:01:25.617 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T01:01:25.629 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQBlD5Vp8BgFJRAAYPuofQZCD9+0llrVrLcK0g== 2026-02-18T01:01:25.629 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQBlD5Vp8BgFJRAAYPuofQZCD9+0llrVrLcK0g=="}' 2026-02-18T01:01:25.629 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 46ceb568-7a17-4215-978f-5f11ac8d2534 -i td/ver-health/1/new.json 2026-02-18T01:01:25.748 INFO:tasks.workunit.client.0.trial069.stdout:1 2026-02-18T01:01:25.758 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/ver-health/1/new.json 2026-02-18T01:01:25.759 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=f12f9151-9f82-4cd0-b200-adf3932f8443 --auth-supported=none --mon-host= --mon_health_to_clog_tick_interval=1.0 --mon-host=127.0.0.1:7165 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ver-health/1 --osd-journal=td/ver-health/1/journal --chdir= --run-dir=td/ver-health '--admin-socket=/tmp/ceph-asok.162951/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ver-health/$name.log' '--pid-file=td/ver-health/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQBlD5Vp8BgFJRAAYPuofQZCD9+0llrVrLcK0g== --osd-uuid 46ceb568-7a17-4215-978f-5f11ac8d2534 2026-02-18T01:01:25.777 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T01:01:25.765+0000 7f06fd392a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:01:25.778 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T01:01:25.765+0000 7f06fd392a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:01:25.779 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T01:01:25.769+0000 7f06fd392a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:01:25.780 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T01:01:25.769+0000 7f06fd392a40 -1 bdev(0x559157218c00 td/ver-health/1/block) open stat got: (1) Operation not permitted 2026-02-18T01:01:25.780 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T01:01:25.769+0000 7f06fd392a40 -1 bluestore(td/ver-health/1) _read_fsid unparsable uuid 2026-02-18T01:01:26.442 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/ver-health/1/keyring 2026-02-18T01:01:26.442 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T01:01:26.443 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2026-02-18T01:01:26.443 INFO:tasks.workunit.client.0.trial069.stdout:adding osd1 key to auth repository 2026-02-18T01:01:26.444 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/ver-health/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T01:01:26.560 INFO:tasks.workunit.client.0.trial069.stdout:start osd.1 2026-02-18T01:01:26.561 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2026-02-18T01:01:26.561 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=f12f9151-9f82-4cd0-b200-adf3932f8443 --auth-supported=none --mon-host= --mon_health_to_clog_tick_interval=1.0 --mon-host=127.0.0.1:7165 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ver-health/1 --osd-journal=td/ver-health/1/journal --chdir= --run-dir=td/ver-health '--admin-socket=/tmp/ceph-asok.162951/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ver-health/$name.log' '--pid-file=td/ver-health/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T01:01:26.561 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T01:01:26.561 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T01:01:26.561 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T01:01:26.577 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T01:01:26.565+0000 7fa9e696aa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:01:26.578 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T01:01:26.565+0000 7fa9e696aa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:01:26.579 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T01:01:26.569+0000 7fa9e696aa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:01:26.667 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2026-02-18T01:01:26.667 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T01:01:26.668 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-18T01:01:26.668 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T01:01:26.668 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T01:01:26.668 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:01:26.668 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T01:01:26.668 INFO:tasks.workunit.client.0.trial069.stdout:0 2026-02-18T01:01:26.669 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:01:26.669 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-18T01:01:26.776 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T01:01:26.905 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T01:01:26.893+0000 7fa9e696aa40 -1 Falling back to public interface 2026-02-18T01:01:27.516 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T01:01:27.505+0000 7fa9e696aa40 -1 osd.1 0 log_to_monitors true 2026-02-18T01:01:27.777 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T01:01:27.777 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:01:27.777 INFO:tasks.workunit.client.0.trial069.stdout:1 2026-02-18T01:01:27.778 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T01:01:27.778 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:01:27.778 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-18T01:01:27.893 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T01:01:28.894 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T01:01:28.894 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:01:28.894 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-18T01:01:28.894 INFO:tasks.workunit.client.0.trial069.stdout:2 2026-02-18T01:01:28.894 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:01:28.894 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-18T01:01:29.005 INFO:tasks.workunit.client.0.trial069.stdout:osd.1 up in weight 1 up_from 10 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6808/2446438532,v1:127.0.0.1:6809/2446438532] [v2:127.0.0.1:6810/2446438532,v1:127.0.0.1:6811/2446438532] exists,up 46ceb568-7a17-4215-978f-5f11ac8d2534 2026-02-18T01:01:29.006 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T01:01:29.006 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T01:01:29.006 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T01:01:29.006 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:80: TEST_check_version_health_1: run_osd td/ver-health 2 2026-02-18T01:01:29.006 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/ver-health 2026-02-18T01:01:29.006 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T01:01:29.006 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2026-02-18T01:01:29.006 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T01:01:29.006 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/ver-health/2 2026-02-18T01:01:29.006 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=f12f9151-9f82-4cd0-b200-adf3932f8443 --auth-supported=none --mon-host= --mon_health_to_clog_tick_interval=1.0 --mon-host=127.0.0.1:7165 ' 2026-02-18T01:01:29.006 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T01:01:29.008 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T01:01:29.008 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T01:01:29.008 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/ver-health/2' 2026-02-18T01:01:29.008 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/ver-health/2/journal' 2026-02-18T01:01:29.009 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T01:01:29.009 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-18T01:01:29.009 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/ver-health' 2026-02-18T01:01:29.009 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T01:01:29.009 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T01:01:29.009 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T01:01:29.009 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T01:01:29.009 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:01:29.009 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.162951 2026-02-18T01:01:29.009 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.162951/$cluster-$name.asok' 2026-02-18T01:01:29.009 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.162951/$cluster-$name.asok' 2026-02-18T01:01:29.009 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T01:01:29.009 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T01:01:29.009 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T01:01:29.009 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/ver-health/$name.log' 2026-02-18T01:01:29.009 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/ver-health/$name.pid' 2026-02-18T01:01:29.009 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T01:01:29.009 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T01:01:29.009 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T01:01:29.009 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T01:01:29.009 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T01:01:29.009 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-18T01:01:29.009 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/ver-health/2 2026-02-18T01:01:29.009 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T01:01:29.010 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=922b6616-170f-4f54-a227-61066bb22e98 2026-02-18T01:01:29.010 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 922b6616-170f-4f54-a227-61066bb22e98' 2026-02-18T01:01:29.010 INFO:tasks.workunit.client.0.trial069.stdout:add osd2 922b6616-170f-4f54-a227-61066bb22e98 2026-02-18T01:01:29.011 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T01:01:29.022 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQBpD5VpyH/QABAA1+X+cy15lEH3VeXSd9hcCg== 2026-02-18T01:01:29.022 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQBpD5VpyH/QABAA1+X+cy15lEH3VeXSd9hcCg=="}' 2026-02-18T01:01:29.022 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 922b6616-170f-4f54-a227-61066bb22e98 -i td/ver-health/2/new.json 2026-02-18T01:01:29.142 INFO:tasks.workunit.client.0.trial069.stdout:2 2026-02-18T01:01:29.151 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/ver-health/2/new.json 2026-02-18T01:01:29.152 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --fsid=f12f9151-9f82-4cd0-b200-adf3932f8443 --auth-supported=none --mon-host= --mon_health_to_clog_tick_interval=1.0 --mon-host=127.0.0.1:7165 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ver-health/2 --osd-journal=td/ver-health/2/journal --chdir= --run-dir=td/ver-health '--admin-socket=/tmp/ceph-asok.162951/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ver-health/$name.log' '--pid-file=td/ver-health/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQBpD5VpyH/QABAA1+X+cy15lEH3VeXSd9hcCg== --osd-uuid 922b6616-170f-4f54-a227-61066bb22e98 2026-02-18T01:01:29.176 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T01:01:29.165+0000 7fa3c0c32a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:01:29.178 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T01:01:29.165+0000 7fa3c0c32a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:01:29.178 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T01:01:29.165+0000 7fa3c0c32a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:01:29.179 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T01:01:29.169+0000 7fa3c0c32a40 -1 bdev(0x56139b26ec00 td/ver-health/2/block) open stat got: (1) Operation not permitted 2026-02-18T01:01:29.179 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T01:01:29.169+0000 7fa3c0c32a40 -1 bluestore(td/ver-health/2) _read_fsid unparsable uuid 2026-02-18T01:01:29.811 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/ver-health/2/keyring 2026-02-18T01:01:29.811 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T01:01:29.812 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2026-02-18T01:01:29.812 INFO:tasks.workunit.client.0.trial069.stdout:adding osd2 key to auth repository 2026-02-18T01:01:29.813 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/ver-health/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T01:01:29.936 INFO:tasks.workunit.client.0.trial069.stdout:start osd.2 2026-02-18T01:01:29.937 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2026-02-18T01:01:29.937 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --fsid=f12f9151-9f82-4cd0-b200-adf3932f8443 --auth-supported=none --mon-host= --mon_health_to_clog_tick_interval=1.0 --mon-host=127.0.0.1:7165 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ver-health/2 --osd-journal=td/ver-health/2/journal --chdir= --run-dir=td/ver-health '--admin-socket=/tmp/ceph-asok.162951/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ver-health/$name.log' '--pid-file=td/ver-health/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T01:01:29.937 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T01:01:29.937 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T01:01:29.937 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T01:01:29.952 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T01:01:29.941+0000 7f654673ca40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:01:29.954 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T01:01:29.941+0000 7f654673ca40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:01:29.955 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T01:01:29.941+0000 7f654673ca40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:01:30.045 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2026-02-18T01:01:30.045 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T01:01:30.045 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-18T01:01:30.045 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T01:01:30.045 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T01:01:30.046 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:01:30.046 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T01:01:30.046 INFO:tasks.workunit.client.0.trial069.stdout:0 2026-02-18T01:01:30.047 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:01:30.047 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-18T01:01:30.155 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T01:01:30.397 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T01:01:30.385+0000 7f654673ca40 -1 Falling back to public interface 2026-02-18T01:01:30.996 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T01:01:30.985+0000 7f654673ca40 -1 osd.2 0 log_to_monitors true 2026-02-18T01:01:31.157 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T01:01:31.157 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:01:31.158 INFO:tasks.workunit.client.0.trial069.stdout:1 2026-02-18T01:01:31.158 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T01:01:31.158 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:01:31.158 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-18T01:01:31.265 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T01:01:32.267 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T01:01:32.267 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:01:32.267 INFO:tasks.workunit.client.0.trial069.stdout:2 2026-02-18T01:01:32.268 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-18T01:01:32.268 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:01:32.268 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-18T01:01:32.377 INFO:tasks.workunit.client.0.trial069.stdout:osd.2 up in weight 1 up_from 15 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6816/1223576282,v1:127.0.0.1:6817/1223576282] [v2:127.0.0.1:6818/1223576282,v1:127.0.0.1:6819/1223576282] exists,up 922b6616-170f-4f54-a227-61066bb22e98 2026-02-18T01:01:32.378 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T01:01:32.378 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T01:01:32.378 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T01:01:32.378 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:82: TEST_check_version_health_1: sleep 5 2026-02-18T01:01:37.379 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:83: TEST_check_version_health_1: ceph health detail 2026-02-18T01:01:37.482 INFO:tasks.workunit.client.0.trial069.stdout:HEALTH_OK 2026-02-18T01:01:37.489 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:85: TEST_check_version_health_1: ceph health detail 2026-02-18T01:01:37.490 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:85: TEST_check_version_health_1: grep DAEMON_OLD_VERSION 2026-02-18T01:01:37.613 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:87: TEST_check_version_health_1: kill_daemons td/ver-health KILL osd.1 2026-02-18T01:01:37.614 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T01:01:37.615 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T01:01:37.615 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T01:01:37.615 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T01:01:37.615 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T01:01:37.724 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T01:01:37.724 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:88: TEST_check_version_health_1: ceph_debug_version_for_testing=01.00.00-gversion-test 2026-02-18T01:01:37.724 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:88: TEST_check_version_health_1: activate_osd td/ver-health 1 2026-02-18T01:01:37.724 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/ver-health 2026-02-18T01:01:37.724 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-18T01:01:37.725 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-18T01:01:37.725 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-18T01:01:37.725 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/ver-health/1 2026-02-18T01:01:37.725 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=f12f9151-9f82-4cd0-b200-adf3932f8443 --auth-supported=none --mon-host= --mon_health_to_clog_tick_interval=1.0 --mon-host=127.0.0.1:7165 ' 2026-02-18T01:01:37.725 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T01:01:37.725 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T01:01:37.725 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T01:01:37.725 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/ver-health/1' 2026-02-18T01:01:37.725 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/ver-health/1/journal' 2026-02-18T01:01:37.725 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-18T01:01:37.725 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-18T01:01:37.726 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/ver-health' 2026-02-18T01:01:37.726 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-18T01:01:37.726 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T01:01:37.726 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T01:01:37.726 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T01:01:37.726 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:01:37.726 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.162951 2026-02-18T01:01:37.726 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.162951/$cluster-$name.asok' 2026-02-18T01:01:37.726 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.162951/$cluster-$name.asok' 2026-02-18T01:01:37.726 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-18T01:01:37.726 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/ver-health/$name.log' 2026-02-18T01:01:37.726 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/ver-health/$name.pid' 2026-02-18T01:01:37.727 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T01:01:37.727 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T01:01:37.727 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T01:01:37.727 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T01:01:37.727 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-18T01:01:37.727 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-18T01:01:37.727 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/ver-health/1 2026-02-18T01:01:37.727 INFO:tasks.workunit.client.0.trial069.stdout:start osd.1 2026-02-18T01:01:37.728 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-18T01:01:37.728 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=f12f9151-9f82-4cd0-b200-adf3932f8443 --auth-supported=none --mon-host= --mon_health_to_clog_tick_interval=1.0 --mon-host=127.0.0.1:7165 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ver-health/1 --osd-journal=td/ver-health/1/journal --chdir= --run-dir=td/ver-health '--admin-socket=/tmp/ceph-asok.162951/$cluster-$name.asok' --debug-osd=20 '--log-file=td/ver-health/$name.log' '--pid-file=td/ver-health/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T01:01:37.729 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/ver-health/1/whoami 2026-02-18T01:01:37.729 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-18T01:01:37.729 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-18T01:01:37.729 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-18T01:01:37.729 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-18T01:01:37.742 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T01:01:37.729+0000 7f139e8b0a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:01:37.744 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T01:01:37.733+0000 7f139e8b0a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:01:37.745 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T01:01:37.733+0000 7f139e8b0a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:01:37.833 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-18T01:01:37.833 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T01:01:37.833 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-18T01:01:37.833 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T01:01:37.833 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T01:01:37.833 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:01:37.833 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T01:01:37.834 INFO:tasks.workunit.client.0.trial069.stdout:0 2026-02-18T01:01:37.834 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:01:37.834 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-18T01:01:37.943 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T01:01:38.120 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T01:01:38.109+0000 7f139e8b0a40 -1 Falling back to public interface 2026-02-18T01:01:38.715 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T01:01:38.701+0000 7f139e8b0a40 -1 osd.1 16 log_to_monitors true 2026-02-18T01:01:38.944 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T01:01:38.945 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:01:38.945 INFO:tasks.workunit.client.0.trial069.stdout:1 2026-02-18T01:01:38.946 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T01:01:38.946 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:01:38.946 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-18T01:01:39.051 INFO:tasks.workunit.client.0.trial069.stdout:osd.1 up in weight 1 up_from 19 up_thru 0 down_at 17 last_clean_interval [10,16) [v2:127.0.0.1:6808/2628430656,v1:127.0.0.1:6809/2628430656] [v2:127.0.0.1:6810/2628430656,v1:127.0.0.1:6811/2628430656] exists,up 46ceb568-7a17-4215-978f-5f11ac8d2534 2026-02-18T01:01:39.052 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T01:01:39.053 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T01:01:39.053 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T01:01:39.053 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:90: TEST_check_version_health_1: wait_for_health_string 'HEALTH_WARN .*There is a daemon running an older version of ceph' 2026-02-18T01:01:39.053 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:40: wait_for_health_string: local 'grep_string=HEALTH_WARN .*There is a daemon running an older version of ceph' 2026-02-18T01:01:39.053 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:41: wait_for_health_string: local seconds=20 2026-02-18T01:01:39.053 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:44: wait_for_health_string: set -o pipefail 2026-02-18T01:01:39.053 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:45: wait_for_health_string: PASSED=false 2026-02-18T01:01:39.053 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:46: wait_for_health_string: (( i=0 )) 2026-02-18T01:01:39.053 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:46: wait_for_health_string: (( i < 20 )) 2026-02-18T01:01:39.053 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:47: wait_for_health_string: ceph health 2026-02-18T01:01:39.053 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:47: wait_for_health_string: grep -q 'HEALTH_WARN .*There is a daemon running an older version of ceph' 2026-02-18T01:01:39.160 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:52: wait_for_health_string: sleep 1 2026-02-18T01:01:40.161 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:46: wait_for_health_string: (( i++ )) 2026-02-18T01:01:40.161 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:46: wait_for_health_string: (( i < 20 )) 2026-02-18T01:01:40.162 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:47: wait_for_health_string: ceph health 2026-02-18T01:01:40.162 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:47: wait_for_health_string: grep -q 'HEALTH_WARN .*There is a daemon running an older version of ceph' 2026-02-18T01:01:40.272 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:52: wait_for_health_string: sleep 1 2026-02-18T01:01:41.273 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:46: wait_for_health_string: (( i++ )) 2026-02-18T01:01:41.273 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:46: wait_for_health_string: (( i < 20 )) 2026-02-18T01:01:41.273 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:47: wait_for_health_string: ceph health 2026-02-18T01:01:41.273 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:47: wait_for_health_string: grep -q 'HEALTH_WARN .*There is a daemon running an older version of ceph' 2026-02-18T01:01:41.382 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:52: wait_for_health_string: sleep 1 2026-02-18T01:01:42.384 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:46: wait_for_health_string: (( i++ )) 2026-02-18T01:01:42.384 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:46: wait_for_health_string: (( i < 20 )) 2026-02-18T01:01:42.385 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:47: wait_for_health_string: ceph health 2026-02-18T01:01:42.385 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:47: wait_for_health_string: grep -q 'HEALTH_WARN .*There is a daemon running an older version of ceph' 2026-02-18T01:01:42.493 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:52: wait_for_health_string: sleep 1 2026-02-18T01:01:43.494 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:46: wait_for_health_string: (( i++ )) 2026-02-18T01:01:43.494 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:46: wait_for_health_string: (( i < 20 )) 2026-02-18T01:01:43.494 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:47: wait_for_health_string: ceph health 2026-02-18T01:01:43.494 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:47: wait_for_health_string: grep -q 'HEALTH_WARN .*There is a daemon running an older version of ceph' 2026-02-18T01:01:43.607 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:52: wait_for_health_string: sleep 1 2026-02-18T01:01:44.609 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:46: wait_for_health_string: (( i++ )) 2026-02-18T01:01:44.609 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:46: wait_for_health_string: (( i < 20 )) 2026-02-18T01:01:44.610 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:47: wait_for_health_string: ceph health 2026-02-18T01:01:44.610 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:47: wait_for_health_string: grep -q 'HEALTH_WARN .*There is a daemon running an older version of ceph' 2026-02-18T01:01:44.725 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:52: wait_for_health_string: sleep 1 2026-02-18T01:01:45.727 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:46: wait_for_health_string: (( i++ )) 2026-02-18T01:01:45.727 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:46: wait_for_health_string: (( i < 20 )) 2026-02-18T01:01:45.727 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:47: wait_for_health_string: ceph health 2026-02-18T01:01:45.727 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:47: wait_for_health_string: grep -q 'HEALTH_WARN .*There is a daemon running an older version of ceph' 2026-02-18T01:01:45.840 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:52: wait_for_health_string: sleep 1 2026-02-18T01:01:46.841 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:46: wait_for_health_string: (( i++ )) 2026-02-18T01:01:46.841 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:46: wait_for_health_string: (( i < 20 )) 2026-02-18T01:01:46.842 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:47: wait_for_health_string: ceph health 2026-02-18T01:01:46.842 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:47: wait_for_health_string: grep -q 'HEALTH_WARN .*There is a daemon running an older version of ceph' 2026-02-18T01:01:46.953 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:49: wait_for_health_string: PASSED=true 2026-02-18T01:01:46.953 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:50: wait_for_health_string: break 2026-02-18T01:01:46.953 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:54: wait_for_health_string: set +o pipefail 2026-02-18T01:01:46.953 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:57: wait_for_health_string: '[' true = false ']' 2026-02-18T01:01:46.953 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:61: wait_for_health_string: return 0 2026-02-18T01:01:46.953 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:92: TEST_check_version_health_1: ceph health detail 2026-02-18T01:01:47.069 INFO:tasks.workunit.client.0.trial069.stdout:HEALTH_WARN There is a daemon running an older version of ceph 2026-02-18T01:01:47.069 INFO:tasks.workunit.client.0.trial069.stdout:[WRN] DAEMON_OLD_VERSION: There is a daemon running an older version of ceph 2026-02-18T01:01:47.069 INFO:tasks.workunit.client.0.trial069.stdout: osd.1 is running an older version of ceph: 01.00.00-gversion-test 2026-02-18T01:01:47.076 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:94: TEST_check_version_health_1: ceph health detail 2026-02-18T01:01:47.077 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:94: TEST_check_version_health_1: grep -q 'HEALTH_WARN .*There is a daemon running an older version of ceph' 2026-02-18T01:01:47.198 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:95: TEST_check_version_health_1: ceph health detail 2026-02-18T01:01:47.198 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:95: TEST_check_version_health_1: grep -q '^[[]WRN[]] DAEMON_OLD_VERSION: There is a daemon running an older version of ceph' 2026-02-18T01:01:47.328 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:96: TEST_check_version_health_1: ceph health detail 2026-02-18T01:01:47.328 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:96: TEST_check_version_health_1: grep -q 'osd.1 is running an older version of ceph: 01.00.00-gversion-test' 2026-02-18T01:01:47.451 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:98: TEST_check_version_health_1: kill_daemons td/ver-health KILL osd.2 2026-02-18T01:01:47.452 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T01:01:47.452 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T01:01:47.452 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T01:01:47.453 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T01:01:47.453 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T01:01:47.562 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T01:01:47.563 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:99: TEST_check_version_health_1: ceph_debug_version_for_testing=01.00.00-gversion-test 2026-02-18T01:01:47.563 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:99: TEST_check_version_health_1: activate_osd td/ver-health 2 2026-02-18T01:01:47.563 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/ver-health 2026-02-18T01:01:47.563 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-18T01:01:47.563 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=2 2026-02-18T01:01:47.563 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-18T01:01:47.563 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/ver-health/2 2026-02-18T01:01:47.563 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=f12f9151-9f82-4cd0-b200-adf3932f8443 --auth-supported=none --mon-host= --mon_health_to_clog_tick_interval=1.0 --mon-host=127.0.0.1:7165 ' 2026-02-18T01:01:47.563 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T01:01:47.563 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T01:01:47.563 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T01:01:47.564 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/ver-health/2' 2026-02-18T01:01:47.564 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/ver-health/2/journal' 2026-02-18T01:01:47.564 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-18T01:01:47.564 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-18T01:01:47.564 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/ver-health' 2026-02-18T01:01:47.564 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-18T01:01:47.564 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T01:01:47.564 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T01:01:47.564 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T01:01:47.564 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:01:47.564 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.162951 2026-02-18T01:01:47.564 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.162951/$cluster-$name.asok' 2026-02-18T01:01:47.565 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.162951/$cluster-$name.asok' 2026-02-18T01:01:47.565 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-18T01:01:47.565 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/ver-health/$name.log' 2026-02-18T01:01:47.565 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/ver-health/$name.pid' 2026-02-18T01:01:47.565 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T01:01:47.565 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T01:01:47.565 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T01:01:47.565 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T01:01:47.565 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-18T01:01:47.566 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-18T01:01:47.566 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/ver-health/2 2026-02-18T01:01:47.566 INFO:tasks.workunit.client.0.trial069.stdout:start osd.2 2026-02-18T01:01:47.567 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.2 2026-02-18T01:01:47.567 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 2 --fsid=f12f9151-9f82-4cd0-b200-adf3932f8443 --auth-supported=none --mon-host= --mon_health_to_clog_tick_interval=1.0 --mon-host=127.0.0.1:7165 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ver-health/2 --osd-journal=td/ver-health/2/journal --chdir= --run-dir=td/ver-health '--admin-socket=/tmp/ceph-asok.162951/$cluster-$name.asok' --debug-osd=20 '--log-file=td/ver-health/$name.log' '--pid-file=td/ver-health/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T01:01:47.568 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/ver-health/2/whoami 2026-02-18T01:01:47.568 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 2 = 2 ']' 2026-02-18T01:01:47.568 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-18T01:01:47.568 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-18T01:01:47.568 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-18T01:01:47.581 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T01:01:47.569+0000 7f346c7d1a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:01:47.582 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T01:01:47.569+0000 7f346c7d1a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:01:47.583 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T01:01:47.573+0000 7f346c7d1a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:01:47.671 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 2 2026-02-18T01:01:47.672 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T01:01:47.672 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-18T01:01:47.672 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T01:01:47.672 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T01:01:47.672 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:01:47.672 INFO:tasks.workunit.client.0.trial069.stdout:0 2026-02-18T01:01:47.673 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T01:01:47.673 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:01:47.673 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-18T01:01:47.785 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T01:01:47.961 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T01:01:47.949+0000 7f346c7d1a40 -1 Falling back to public interface 2026-02-18T01:01:48.524 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T01:01:48.513+0000 7f346c7d1a40 -1 osd.2 19 log_to_monitors true 2026-02-18T01:01:48.786 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T01:01:48.786 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:01:48.787 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T01:01:48.787 INFO:tasks.workunit.client.0.trial069.stdout:1 2026-02-18T01:01:48.787 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:01:48.788 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-18T01:01:48.897 INFO:tasks.workunit.client.0.trial069.stdout:osd.2 up in weight 1 up_from 22 up_thru 0 down_at 20 last_clean_interval [15,19) [v2:127.0.0.1:6816/292676497,v1:127.0.0.1:6817/292676497] [v2:127.0.0.1:6818/292676497,v1:127.0.0.1:6819/292676497] exists,up 922b6616-170f-4f54-a227-61066bb22e98 2026-02-18T01:01:48.897 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T01:01:48.897 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T01:01:48.897 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T01:01:48.897 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:100: TEST_check_version_health_1: kill_daemons td/ver-health KILL osd.0 2026-02-18T01:01:48.898 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T01:01:48.898 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T01:01:48.898 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T01:01:48.898 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T01:01:48.898 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T01:01:49.008 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T01:01:49.009 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:101: TEST_check_version_health_1: ceph_debug_version_for_testing=02.00.00-gversion-test 2026-02-18T01:01:49.009 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:101: TEST_check_version_health_1: activate_osd td/ver-health 0 2026-02-18T01:01:49.009 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/ver-health 2026-02-18T01:01:49.009 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-18T01:01:49.009 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-18T01:01:49.009 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-18T01:01:49.009 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/ver-health/0 2026-02-18T01:01:49.009 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=f12f9151-9f82-4cd0-b200-adf3932f8443 --auth-supported=none --mon-host= --mon_health_to_clog_tick_interval=1.0 --mon-host=127.0.0.1:7165 ' 2026-02-18T01:01:49.010 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T01:01:49.010 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T01:01:49.010 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T01:01:49.010 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/ver-health/0' 2026-02-18T01:01:49.010 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/ver-health/0/journal' 2026-02-18T01:01:49.010 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-18T01:01:49.010 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-18T01:01:49.010 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/ver-health' 2026-02-18T01:01:49.010 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-18T01:01:49.011 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T01:01:49.011 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T01:01:49.011 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T01:01:49.011 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:01:49.011 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.162951 2026-02-18T01:01:49.011 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.162951/$cluster-$name.asok' 2026-02-18T01:01:49.011 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.162951/$cluster-$name.asok' 2026-02-18T01:01:49.011 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-18T01:01:49.011 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/ver-health/$name.log' 2026-02-18T01:01:49.011 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/ver-health/$name.pid' 2026-02-18T01:01:49.011 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T01:01:49.011 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T01:01:49.012 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T01:01:49.012 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T01:01:49.012 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-18T01:01:49.012 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-18T01:01:49.012 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/ver-health/0 2026-02-18T01:01:49.012 INFO:tasks.workunit.client.0.trial069.stdout:start osd.0 2026-02-18T01:01:49.013 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-18T01:01:49.013 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=f12f9151-9f82-4cd0-b200-adf3932f8443 --auth-supported=none --mon-host= --mon_health_to_clog_tick_interval=1.0 --mon-host=127.0.0.1:7165 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ver-health/0 --osd-journal=td/ver-health/0/journal --chdir= --run-dir=td/ver-health '--admin-socket=/tmp/ceph-asok.162951/$cluster-$name.asok' --debug-osd=20 '--log-file=td/ver-health/$name.log' '--pid-file=td/ver-health/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T01:01:49.013 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/ver-health/0/whoami 2026-02-18T01:01:49.014 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-18T01:01:49.014 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-18T01:01:49.014 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-18T01:01:49.014 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-18T01:01:49.032 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T01:01:49.021+0000 7f6cecc3fa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:01:49.033 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T01:01:49.021+0000 7f6cecc3fa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:01:49.034 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T01:01:49.021+0000 7f6cecc3fa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:01:49.121 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-18T01:01:49.121 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T01:01:49.121 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-18T01:01:49.122 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T01:01:49.122 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T01:01:49.122 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:01:49.122 INFO:tasks.workunit.client.0.trial069.stdout:0 2026-02-18T01:01:49.123 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T01:01:49.123 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:01:49.123 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T01:01:49.229 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T01:01:49.448 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T01:01:49.437+0000 7f6cecc3fa40 -1 Falling back to public interface 2026-02-18T01:01:50.119 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T01:01:50.105+0000 7f6cecc3fa40 -1 osd.0 22 log_to_monitors true 2026-02-18T01:01:50.230 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T01:01:50.231 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:01:50.231 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T01:01:50.231 INFO:tasks.workunit.client.0.trial069.stdout:1 2026-02-18T01:01:50.232 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:01:50.232 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T01:01:50.335 INFO:tasks.workunit.client.0.trial069.stdout:osd.0 up in weight 1 up_from 25 up_thru 0 down_at 23 last_clean_interval [5,22) [v2:127.0.0.1:6800/2200189090,v1:127.0.0.1:6801/2200189090] [v2:127.0.0.1:6802/2200189090,v1:127.0.0.1:6803/2200189090] exists,up 1f106b8b-8284-416e-b620-28536866fa3a 2026-02-18T01:01:50.337 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T01:01:50.337 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T01:01:50.337 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T01:01:50.337 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:103: TEST_check_version_health_1: wait_for_health_string 'HEALTH_ERR .*There are daemons running multiple old versions of ceph' 2026-02-18T01:01:50.337 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:40: wait_for_health_string: local 'grep_string=HEALTH_ERR .*There are daemons running multiple old versions of ceph' 2026-02-18T01:01:50.337 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:41: wait_for_health_string: local seconds=20 2026-02-18T01:01:50.337 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:44: wait_for_health_string: set -o pipefail 2026-02-18T01:01:50.337 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:45: wait_for_health_string: PASSED=false 2026-02-18T01:01:50.337 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:46: wait_for_health_string: (( i=0 )) 2026-02-18T01:01:50.337 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:46: wait_for_health_string: (( i < 20 )) 2026-02-18T01:01:50.338 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:47: wait_for_health_string: ceph health 2026-02-18T01:01:50.338 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:47: wait_for_health_string: grep -q 'HEALTH_ERR .*There are daemons running multiple old versions of ceph' 2026-02-18T01:01:50.444 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:52: wait_for_health_string: sleep 1 2026-02-18T01:01:51.445 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:46: wait_for_health_string: (( i++ )) 2026-02-18T01:01:51.446 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:46: wait_for_health_string: (( i < 20 )) 2026-02-18T01:01:51.446 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:47: wait_for_health_string: ceph health 2026-02-18T01:01:51.446 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:47: wait_for_health_string: grep -q 'HEALTH_ERR .*There are daemons running multiple old versions of ceph' 2026-02-18T01:01:51.558 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:49: wait_for_health_string: PASSED=true 2026-02-18T01:01:51.558 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:50: wait_for_health_string: break 2026-02-18T01:01:51.559 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:54: wait_for_health_string: set +o pipefail 2026-02-18T01:01:51.559 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:57: wait_for_health_string: '[' true = false ']' 2026-02-18T01:01:51.559 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:61: wait_for_health_string: return 0 2026-02-18T01:01:51.559 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:105: TEST_check_version_health_1: ceph health detail 2026-02-18T01:01:51.660 INFO:tasks.workunit.client.0.trial069.stdout:HEALTH_ERR There are daemons running multiple old versions of ceph 2026-02-18T01:01:51.661 INFO:tasks.workunit.client.0.trial069.stdout:[ERR] DAEMON_OLD_VERSION: There are daemons running multiple old versions of ceph 2026-02-18T01:01:51.661 INFO:tasks.workunit.client.0.trial069.stdout: osd.1 osd.2 are running an older version of ceph: 01.00.00-gversion-test 2026-02-18T01:01:51.661 INFO:tasks.workunit.client.0.trial069.stdout: osd.0 is running an older version of ceph: 02.00.00-gversion-test 2026-02-18T01:01:51.668 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:106: TEST_check_version_health_1: ceph health detail 2026-02-18T01:01:51.668 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:106: TEST_check_version_health_1: grep -q 'HEALTH_ERR .*There are daemons running multiple old versions of ceph' 2026-02-18T01:01:51.797 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:107: TEST_check_version_health_1: ceph health detail 2026-02-18T01:01:51.797 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:107: TEST_check_version_health_1: grep -q '^[[]ERR[]] DAEMON_OLD_VERSION: There are daemons running multiple old versions of ceph' 2026-02-18T01:01:51.906 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:108: TEST_check_version_health_1: ceph health detail 2026-02-18T01:01:51.906 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:108: TEST_check_version_health_1: grep -q 'osd.1 osd.2 are running an older version of ceph: 01.00.00-gversion-test' 2026-02-18T01:01:52.032 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:109: TEST_check_version_health_1: ceph health detail 2026-02-18T01:01:52.032 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:109: TEST_check_version_health_1: grep -q 'osd.0 is running an older version of ceph: 02.00.00-gversion-test' 2026-02-18T01:01:52.155 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:35: run: teardown td/ver-health 2026-02-18T01:01:52.155 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/ver-health 2026-02-18T01:01:52.155 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T01:01:52.155 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/ver-health KILL 2026-02-18T01:01:52.155 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T01:01:52.155 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T01:01:52.155 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T01:01:52.155 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T01:01:52.156 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T01:01:52.265 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T01:01:52.265 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T01:01:52.266 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T01:01:52.267 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T01:01:52.268 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T01:01:52.268 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T01:01:52.268 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T01:01:52.269 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T01:01:52.269 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T01:01:52.270 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T01:01:52.270 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T01:01:52.271 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T01:01:52.272 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T01:01:52.272 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/ver-health 2026-02-18T01:01:52.283 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T01:01:52.283 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:01:52.283 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.162951 2026-02-18T01:01:52.283 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.162951 2026-02-18T01:01:52.285 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T01:01:52.285 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T01:01:52.285 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:32: run: for func in $funcs 2026-02-18T01:01:52.285 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:33: run: setup td/ver-health 2026-02-18T01:01:52.285 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/ver-health 2026-02-18T01:01:52.285 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/ver-health 2026-02-18T01:01:52.286 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/ver-health 2026-02-18T01:01:52.286 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T01:01:52.286 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/ver-health KILL 2026-02-18T01:01:52.286 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T01:01:52.286 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T01:01:52.286 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T01:01:52.286 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T01:01:52.286 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T01:01:52.287 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T01:01:52.288 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T01:01:52.288 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T01:01:52.289 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T01:01:52.290 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T01:01:52.290 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T01:01:52.290 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T01:01:52.291 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T01:01:52.291 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T01:01:52.292 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T01:01:52.292 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T01:01:52.293 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T01:01:52.294 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T01:01:52.294 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/ver-health 2026-02-18T01:01:52.295 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T01:01:52.295 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:01:52.295 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.162951 2026-02-18T01:01:52.295 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.162951 2026-02-18T01:01:52.296 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T01:01:52.297 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T01:01:52.297 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/ver-health 2026-02-18T01:01:52.298 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-18T01:01:52.298 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:01:52.298 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.162951 2026-02-18T01:01:52.298 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.162951 2026-02-18T01:01:52.300 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-18T01:01:52.301 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-18T01:01:52.302 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-18T01:01:52.302 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/ver-health 1' TERM HUP INT 2026-02-18T01:01:52.302 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:34: run: TEST_check_version_health_2 td/ver-health 2026-02-18T01:01:52.302 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:114: TEST_check_version_health_2: local dir=td/ver-health 2026-02-18T01:01:52.302 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:117: TEST_check_version_health_2: CEPH_ARGS='--fsid=f12f9151-9f82-4cd0-b200-adf3932f8443 --auth-supported=none --mon-host= --mon_health_to_clog_tick_interval=1.0 --mon-host=127.0.0.1:7165 ' 2026-02-18T01:01:52.302 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:119: TEST_check_version_health_2: setup td/ver-health 2026-02-18T01:01:52.302 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/ver-health 2026-02-18T01:01:52.302 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/ver-health 2026-02-18T01:01:52.302 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/ver-health 2026-02-18T01:01:52.302 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T01:01:52.303 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/ver-health KILL 2026-02-18T01:01:52.303 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T01:01:52.303 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T01:01:52.303 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T01:01:52.303 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T01:01:52.303 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T01:01:52.303 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T01:01:52.304 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T01:01:52.304 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T01:01:52.305 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T01:01:52.305 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T01:01:52.306 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T01:01:52.306 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T01:01:52.307 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T01:01:52.307 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T01:01:52.308 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T01:01:52.308 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T01:01:52.309 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T01:01:52.309 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T01:01:52.310 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/ver-health 2026-02-18T01:01:52.311 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T01:01:52.311 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:01:52.311 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.162951 2026-02-18T01:01:52.311 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.162951 2026-02-18T01:01:52.312 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T01:01:52.312 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T01:01:52.312 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/ver-health 2026-02-18T01:01:52.314 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-18T01:01:52.314 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:01:52.314 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.162951 2026-02-18T01:01:52.314 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.162951 2026-02-18T01:01:52.315 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-18T01:01:52.316 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-18T01:01:52.317 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-18T01:01:52.317 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/ver-health 1' TERM HUP INT 2026-02-18T01:01:52.317 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:122: TEST_check_version_health_2: run_mon td/ver-health a --public-addr=127.0.0.1:7165 --mon_warn_older_version_delay=0 2026-02-18T01:01:52.317 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/ver-health 2026-02-18T01:01:52.317 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-18T01:01:52.317 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-18T01:01:52.317 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-18T01:01:52.317 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/ver-health/a 2026-02-18T01:01:52.317 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/ver-health/a --run-dir=td/ver-health --public-addr=127.0.0.1:7165 --mon_warn_older_version_delay=0 2026-02-18T01:01:52.338 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-18T01:01:52.338 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T01:01:52.338 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T01:01:52.339 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T01:01:52.339 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:01:52.339 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.162951 2026-02-18T01:01:52.339 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.162951/$cluster-$name.asok' 2026-02-18T01:01:52.339 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/ver-health/a '--log-file=td/ver-health/$name.log' '--admin-socket=/tmp/ceph-asok.162951/$cluster-$name.asok' --mon-cluster-log-file=td/ver-health/log --run-dir=td/ver-health '--pid-file=td/ver-health/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --public-addr=127.0.0.1:7165 --mon_warn_older_version_delay=0 2026-02-18T01:01:52.367 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-18T01:01:52.368 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-18T01:01:52.368 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T01:01:52.368 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-18T01:01:52.368 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-18T01:01:52.368 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-18T01:01:52.369 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-18T01:01:52.369 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T01:01:52.370 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T01:01:52.370 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T01:01:52.370 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:01:52.370 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.162951 2026-02-18T01:01:52.370 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.162951/ceph-mon.a.asok 2026-02-18T01:01:52.370 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T01:01:52.370 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.162951/ceph-mon.a.asok config get fsid 2026-02-18T01:01:52.426 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-18T01:01:52.426 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T01:01:52.426 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-18T01:01:52.426 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-18T01:01:52.427 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-18T01:01:52.427 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-18T01:01:52.427 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T01:01:52.427 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T01:01:52.427 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T01:01:52.428 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:01:52.428 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.162951 2026-02-18T01:01:52.428 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.162951/ceph-mon.a.asok 2026-02-18T01:01:52.428 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T01:01:52.428 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.162951/ceph-mon.a.asok config get mon_host 2026-02-18T01:01:52.482 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:123: TEST_check_version_health_2: run_mon td/ver-health b --public-addr=127.0.0.1:7166 --mon_warn_older_version_delay=0 2026-02-18T01:01:52.482 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/ver-health 2026-02-18T01:01:52.483 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-18T01:01:52.483 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=b 2026-02-18T01:01:52.483 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-18T01:01:52.483 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/ver-health/b 2026-02-18T01:01:52.483 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id b --mkfs --mon-data=td/ver-health/b --run-dir=td/ver-health --public-addr=127.0.0.1:7166 --mon_warn_older_version_delay=0 2026-02-18T01:01:52.502 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-18T01:01:52.502 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T01:01:52.502 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T01:01:52.502 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T01:01:52.502 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:01:52.502 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.162951 2026-02-18T01:01:52.503 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.162951/$cluster-$name.asok' 2026-02-18T01:01:52.503 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id b --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/ver-health/b '--log-file=td/ver-health/$name.log' '--admin-socket=/tmp/ceph-asok.162951/$cluster-$name.asok' --mon-cluster-log-file=td/ver-health/log --run-dir=td/ver-health '--pid-file=td/ver-health/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --public-addr=127.0.0.1:7166 --mon_warn_older_version_delay=0 2026-02-18T01:01:52.528 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-18T01:01:52.529 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon b fsid 2026-02-18T01:01:52.529 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T01:01:52.529 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=b 2026-02-18T01:01:52.529 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-18T01:01:52.530 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-18T01:01:52.531 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.b 2026-02-18T01:01:52.531 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.b 2026-02-18T01:01:52.531 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.b ']' 2026-02-18T01:01:52.531 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T01:01:52.531 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:01:52.531 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.162951 2026-02-18T01:01:52.531 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.162951/ceph-mon.b.asok 2026-02-18T01:01:52.531 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T01:01:52.531 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.162951/ceph-mon.b.asok config get fsid 2026-02-18T01:01:52.586 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon b mon_host 2026-02-18T01:01:52.586 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T01:01:52.586 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=b 2026-02-18T01:01:52.586 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-18T01:01:52.586 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-18T01:01:52.587 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.b 2026-02-18T01:01:52.588 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.b 2026-02-18T01:01:52.588 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.b ']' 2026-02-18T01:01:52.588 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T01:01:52.588 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:01:52.588 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.162951 2026-02-18T01:01:52.588 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.162951/ceph-mon.b.asok 2026-02-18T01:01:52.588 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T01:01:52.588 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.162951/ceph-mon.b.asok config get mon_host 2026-02-18T01:01:52.643 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:124: TEST_check_version_health_2: run_osd td/ver-health 0 2026-02-18T01:01:52.643 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/ver-health 2026-02-18T01:01:52.643 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T01:01:52.643 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-18T01:01:52.643 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T01:01:52.643 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/ver-health/0 2026-02-18T01:01:52.643 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=f12f9151-9f82-4cd0-b200-adf3932f8443 --auth-supported=none --mon-host= --mon_health_to_clog_tick_interval=1.0 --mon-host=127.0.0.1:7165 ' 2026-02-18T01:01:52.643 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T01:01:52.643 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T01:01:52.644 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T01:01:52.644 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/ver-health/0' 2026-02-18T01:01:52.644 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/ver-health/0/journal' 2026-02-18T01:01:52.644 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T01:01:52.644 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-18T01:01:52.644 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/ver-health' 2026-02-18T01:01:52.644 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T01:01:52.644 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T01:01:52.644 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T01:01:52.644 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T01:01:52.644 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:01:52.644 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.162951 2026-02-18T01:01:52.644 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.162951/$cluster-$name.asok' 2026-02-18T01:01:52.646 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.162951/$cluster-$name.asok' 2026-02-18T01:01:52.646 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T01:01:52.646 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T01:01:52.646 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T01:01:52.646 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/ver-health/$name.log' 2026-02-18T01:01:52.646 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/ver-health/$name.pid' 2026-02-18T01:01:52.646 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T01:01:52.646 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T01:01:52.646 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T01:01:52.647 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T01:01:52.647 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T01:01:52.647 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-18T01:01:52.647 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/ver-health/0 2026-02-18T01:01:52.647 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T01:01:52.647 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=5cb02d31-1f8e-4bdd-9fc2-7a4b60ecdf30 2026-02-18T01:01:52.647 INFO:tasks.workunit.client.0.trial069.stdout:add osd0 5cb02d31-1f8e-4bdd-9fc2-7a4b60ecdf30 2026-02-18T01:01:52.648 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 5cb02d31-1f8e-4bdd-9fc2-7a4b60ecdf30' 2026-02-18T01:01:52.648 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T01:01:52.656 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQCAD5Vpg36lJhAAly4flCHzzz7POXWLEbUdOw== 2026-02-18T01:01:52.656 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQCAD5Vpg36lJhAAly4flCHzzz7POXWLEbUdOw=="}' 2026-02-18T01:01:52.656 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 5cb02d31-1f8e-4bdd-9fc2-7a4b60ecdf30 -i td/ver-health/0/new.json 2026-02-18T01:01:58.779 INFO:tasks.workunit.client.0.trial069.stdout:0 2026-02-18T01:01:58.789 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/ver-health/0/new.json 2026-02-18T01:01:58.790 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=f12f9151-9f82-4cd0-b200-adf3932f8443 --auth-supported=none --mon-host= --mon_health_to_clog_tick_interval=1.0 --mon-host=127.0.0.1:7165 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ver-health/0 --osd-journal=td/ver-health/0/journal --chdir= --run-dir=td/ver-health '--admin-socket=/tmp/ceph-asok.162951/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ver-health/$name.log' '--pid-file=td/ver-health/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCAD5Vpg36lJhAAly4flCHzzz7POXWLEbUdOw== --osd-uuid 5cb02d31-1f8e-4bdd-9fc2-7a4b60ecdf30 2026-02-18T01:01:58.812 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T01:01:58.802+0000 7f58c3032a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:01:58.814 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T01:01:58.802+0000 7f58c3032a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:01:58.815 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T01:01:58.806+0000 7f58c3032a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:01:58.816 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T01:01:58.806+0000 7f58c3032a40 -1 bdev(0x55ae3cc60c00 td/ver-health/0/block) open stat got: (1) Operation not permitted 2026-02-18T01:01:58.816 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T01:01:58.806+0000 7f58c3032a40 -1 bluestore(td/ver-health/0) _read_fsid unparsable uuid 2026-02-18T01:01:59.451 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/ver-health/0/keyring 2026-02-18T01:01:59.452 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T01:01:59.452 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-18T01:01:59.453 INFO:tasks.workunit.client.0.trial069.stdout:adding osd0 key to auth repository 2026-02-18T01:01:59.453 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/ver-health/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T01:01:59.576 INFO:tasks.workunit.client.0.trial069.stdout:start osd.0 2026-02-18T01:01:59.577 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-18T01:01:59.578 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=f12f9151-9f82-4cd0-b200-adf3932f8443 --auth-supported=none --mon-host= --mon_health_to_clog_tick_interval=1.0 --mon-host=127.0.0.1:7165 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ver-health/0 --osd-journal=td/ver-health/0/journal --chdir= --run-dir=td/ver-health '--admin-socket=/tmp/ceph-asok.162951/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ver-health/$name.log' '--pid-file=td/ver-health/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T01:01:59.578 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T01:01:59.578 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T01:01:59.578 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T01:01:59.599 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T01:01:59.590+0000 7fc317bb3a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:01:59.601 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T01:01:59.590+0000 7fc317bb3a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:01:59.603 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T01:01:59.594+0000 7fc317bb3a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:01:59.689 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-18T01:01:59.689 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T01:01:59.689 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-18T01:01:59.689 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T01:01:59.689 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T01:01:59.690 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:01:59.690 INFO:tasks.workunit.client.0.trial069.stdout:0 2026-02-18T01:01:59.691 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T01:01:59.691 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:01:59.691 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T01:01:59.798 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T01:01:59.977 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T01:01:59.966+0000 7fc317bb3a40 -1 Falling back to public interface 2026-02-18T01:02:00.647 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T01:02:00.638+0000 7fc317bb3a40 -1 osd.0 0 log_to_monitors true 2026-02-18T01:02:00.799 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T01:02:00.799 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:02:00.800 INFO:tasks.workunit.client.0.trial069.stdout:1 2026-02-18T01:02:00.800 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T01:02:00.801 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:02:00.801 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T01:02:00.912 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T01:02:01.913 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T01:02:01.913 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:02:01.914 INFO:tasks.workunit.client.0.trial069.stdout:2 2026-02-18T01:02:01.914 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-18T01:02:01.915 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:02:01.915 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T01:02:02.023 INFO:tasks.workunit.client.0.trial069.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/3692061662,v1:127.0.0.1:6801/3692061662] [v2:127.0.0.1:6802/3692061662,v1:127.0.0.1:6803/3692061662] exists,up 5cb02d31-1f8e-4bdd-9fc2-7a4b60ecdf30 2026-02-18T01:02:02.026 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T01:02:02.026 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T01:02:02.026 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T01:02:02.027 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:125: TEST_check_version_health_2: run_osd td/ver-health 1 2026-02-18T01:02:02.027 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/ver-health 2026-02-18T01:02:02.027 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T01:02:02.027 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2026-02-18T01:02:02.027 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T01:02:02.027 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/ver-health/1 2026-02-18T01:02:02.027 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=f12f9151-9f82-4cd0-b200-adf3932f8443 --auth-supported=none --mon-host= --mon_health_to_clog_tick_interval=1.0 --mon-host=127.0.0.1:7165 ' 2026-02-18T01:02:02.027 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T01:02:02.027 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T01:02:02.027 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T01:02:02.027 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/ver-health/1' 2026-02-18T01:02:02.028 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/ver-health/1/journal' 2026-02-18T01:02:02.028 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T01:02:02.028 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-18T01:02:02.028 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/ver-health' 2026-02-18T01:02:02.028 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T01:02:02.028 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T01:02:02.028 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T01:02:02.028 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T01:02:02.028 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:02:02.028 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.162951 2026-02-18T01:02:02.028 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.162951/$cluster-$name.asok' 2026-02-18T01:02:02.028 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.162951/$cluster-$name.asok' 2026-02-18T01:02:02.029 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T01:02:02.029 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T01:02:02.029 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T01:02:02.029 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/ver-health/$name.log' 2026-02-18T01:02:02.029 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/ver-health/$name.pid' 2026-02-18T01:02:02.029 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T01:02:02.029 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T01:02:02.029 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T01:02:02.029 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T01:02:02.029 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T01:02:02.029 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-18T01:02:02.029 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/ver-health/1 2026-02-18T01:02:02.029 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T01:02:02.030 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=758f7cea-e6ed-46e9-ba11-ad555808f131 2026-02-18T01:02:02.030 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 758f7cea-e6ed-46e9-ba11-ad555808f131' 2026-02-18T01:02:02.031 INFO:tasks.workunit.client.0.trial069.stdout:add osd1 758f7cea-e6ed-46e9-ba11-ad555808f131 2026-02-18T01:02:02.031 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T01:02:02.040 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQCKD5VpYYzmARAA6i3HGHNg732thNlpe1/86w== 2026-02-18T01:02:02.040 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQCKD5VpYYzmARAA6i3HGHNg732thNlpe1/86w=="}' 2026-02-18T01:02:02.040 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 758f7cea-e6ed-46e9-ba11-ad555808f131 -i td/ver-health/1/new.json 2026-02-18T01:02:02.160 INFO:tasks.workunit.client.0.trial069.stdout:1 2026-02-18T01:02:02.167 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/ver-health/1/new.json 2026-02-18T01:02:02.168 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=f12f9151-9f82-4cd0-b200-adf3932f8443 --auth-supported=none --mon-host= --mon_health_to_clog_tick_interval=1.0 --mon-host=127.0.0.1:7165 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ver-health/1 --osd-journal=td/ver-health/1/journal --chdir= --run-dir=td/ver-health '--admin-socket=/tmp/ceph-asok.162951/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ver-health/$name.log' '--pid-file=td/ver-health/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCKD5VpYYzmARAA6i3HGHNg732thNlpe1/86w== --osd-uuid 758f7cea-e6ed-46e9-ba11-ad555808f131 2026-02-18T01:02:02.184 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T01:02:02.174+0000 7fcc22b3ea40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:02:02.185 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T01:02:02.174+0000 7fcc22b3ea40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:02:02.187 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T01:02:02.174+0000 7fcc22b3ea40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:02:02.187 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T01:02:02.178+0000 7fcc22b3ea40 -1 bdev(0x55892e3f8c00 td/ver-health/1/block) open stat got: (1) Operation not permitted 2026-02-18T01:02:02.187 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T01:02:02.178+0000 7fcc22b3ea40 -1 bluestore(td/ver-health/1) _read_fsid unparsable uuid 2026-02-18T01:02:02.814 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/ver-health/1/keyring 2026-02-18T01:02:02.814 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T01:02:02.815 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2026-02-18T01:02:02.815 INFO:tasks.workunit.client.0.trial069.stdout:adding osd1 key to auth repository 2026-02-18T01:02:02.816 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/ver-health/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T01:02:02.930 INFO:tasks.workunit.client.0.trial069.stdout:start osd.1 2026-02-18T01:02:02.931 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2026-02-18T01:02:02.931 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=f12f9151-9f82-4cd0-b200-adf3932f8443 --auth-supported=none --mon-host= --mon_health_to_clog_tick_interval=1.0 --mon-host=127.0.0.1:7165 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ver-health/1 --osd-journal=td/ver-health/1/journal --chdir= --run-dir=td/ver-health '--admin-socket=/tmp/ceph-asok.162951/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ver-health/$name.log' '--pid-file=td/ver-health/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T01:02:02.931 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T01:02:02.931 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T01:02:02.931 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T01:02:02.953 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T01:02:02.942+0000 7fcfbcf6da40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:02:02.954 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T01:02:02.942+0000 7fcfbcf6da40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:02:02.956 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T01:02:02.946+0000 7fcfbcf6da40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:02:03.040 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2026-02-18T01:02:03.040 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T01:02:03.041 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-18T01:02:03.041 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T01:02:03.041 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T01:02:03.041 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:02:03.041 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T01:02:03.041 INFO:tasks.workunit.client.0.trial069.stdout:0 2026-02-18T01:02:03.042 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:02:03.042 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-18T01:02:03.152 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T01:02:03.320 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T01:02:03.310+0000 7fcfbcf6da40 -1 Falling back to public interface 2026-02-18T01:02:03.863 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T01:02:03.850+0000 7fcfbcf6da40 -1 osd.1 0 log_to_monitors true 2026-02-18T01:02:04.154 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T01:02:04.154 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:02:04.155 INFO:tasks.workunit.client.0.trial069.stdout:1 2026-02-18T01:02:04.155 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T01:02:04.155 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:02:04.155 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-18T01:02:04.265 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T01:02:05.266 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T01:02:05.267 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:02:05.267 INFO:tasks.workunit.client.0.trial069.stdout:2 2026-02-18T01:02:05.268 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-18T01:02:05.268 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:02:05.268 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-18T01:02:05.376 INFO:tasks.workunit.client.0.trial069.stdout:osd.1 up in weight 1 up_from 9 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6808/1838123088,v1:127.0.0.1:6809/1838123088] [v2:127.0.0.1:6810/1838123088,v1:127.0.0.1:6811/1838123088] exists,up 758f7cea-e6ed-46e9-ba11-ad555808f131 2026-02-18T01:02:05.379 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T01:02:05.379 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T01:02:05.379 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T01:02:05.379 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:126: TEST_check_version_health_2: run_osd td/ver-health 2 2026-02-18T01:02:05.379 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/ver-health 2026-02-18T01:02:05.380 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T01:02:05.380 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2026-02-18T01:02:05.380 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T01:02:05.380 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/ver-health/2 2026-02-18T01:02:05.380 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=f12f9151-9f82-4cd0-b200-adf3932f8443 --auth-supported=none --mon-host= --mon_health_to_clog_tick_interval=1.0 --mon-host=127.0.0.1:7165 ' 2026-02-18T01:02:05.380 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T01:02:05.380 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T01:02:05.380 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T01:02:05.380 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/ver-health/2' 2026-02-18T01:02:05.380 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/ver-health/2/journal' 2026-02-18T01:02:05.380 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T01:02:05.380 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-18T01:02:05.381 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/ver-health' 2026-02-18T01:02:05.381 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T01:02:05.381 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T01:02:05.381 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T01:02:05.381 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T01:02:05.381 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:02:05.381 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.162951 2026-02-18T01:02:05.381 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.162951/$cluster-$name.asok' 2026-02-18T01:02:05.381 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.162951/$cluster-$name.asok' 2026-02-18T01:02:05.381 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T01:02:05.381 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T01:02:05.381 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T01:02:05.382 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/ver-health/$name.log' 2026-02-18T01:02:05.382 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/ver-health/$name.pid' 2026-02-18T01:02:05.382 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T01:02:05.382 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T01:02:05.382 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T01:02:05.382 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T01:02:05.382 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T01:02:05.382 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-18T01:02:05.382 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/ver-health/2 2026-02-18T01:02:05.382 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T01:02:05.383 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=5d1c4621-3338-4f5f-b3f0-a0fee0f479a0 2026-02-18T01:02:05.383 INFO:tasks.workunit.client.0.trial069.stdout:add osd2 5d1c4621-3338-4f5f-b3f0-a0fee0f479a0 2026-02-18T01:02:05.383 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 5d1c4621-3338-4f5f-b3f0-a0fee0f479a0' 2026-02-18T01:02:05.384 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T01:02:05.393 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQCND5VptBrsFhAA8BKkPuEpmrimvMJV5UFrOA== 2026-02-18T01:02:05.393 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQCND5VptBrsFhAA8BKkPuEpmrimvMJV5UFrOA=="}' 2026-02-18T01:02:05.393 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 5d1c4621-3338-4f5f-b3f0-a0fee0f479a0 -i td/ver-health/2/new.json 2026-02-18T01:02:05.515 INFO:tasks.workunit.client.0.trial069.stdout:2 2026-02-18T01:02:05.522 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/ver-health/2/new.json 2026-02-18T01:02:05.523 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --fsid=f12f9151-9f82-4cd0-b200-adf3932f8443 --auth-supported=none --mon-host= --mon_health_to_clog_tick_interval=1.0 --mon-host=127.0.0.1:7165 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ver-health/2 --osd-journal=td/ver-health/2/journal --chdir= --run-dir=td/ver-health '--admin-socket=/tmp/ceph-asok.162951/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ver-health/$name.log' '--pid-file=td/ver-health/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCND5VptBrsFhAA8BKkPuEpmrimvMJV5UFrOA== --osd-uuid 5d1c4621-3338-4f5f-b3f0-a0fee0f479a0 2026-02-18T01:02:05.540 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T01:02:05.530+0000 7f3d71a42a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:02:05.542 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T01:02:05.530+0000 7f3d71a42a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:02:05.543 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T01:02:05.534+0000 7f3d71a42a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:02:05.543 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T01:02:05.534+0000 7f3d71a42a40 -1 bdev(0x560aa49c4c00 td/ver-health/2/block) open stat got: (1) Operation not permitted 2026-02-18T01:02:05.544 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T01:02:05.534+0000 7f3d71a42a40 -1 bluestore(td/ver-health/2) _read_fsid unparsable uuid 2026-02-18T01:02:06.186 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/ver-health/2/keyring 2026-02-18T01:02:06.186 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T01:02:06.187 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2026-02-18T01:02:06.187 INFO:tasks.workunit.client.0.trial069.stdout:adding osd2 key to auth repository 2026-02-18T01:02:06.188 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/ver-health/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T01:02:06.309 INFO:tasks.workunit.client.0.trial069.stdout:start osd.2 2026-02-18T01:02:06.310 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2026-02-18T01:02:06.310 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --fsid=f12f9151-9f82-4cd0-b200-adf3932f8443 --auth-supported=none --mon-host= --mon_health_to_clog_tick_interval=1.0 --mon-host=127.0.0.1:7165 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ver-health/2 --osd-journal=td/ver-health/2/journal --chdir= --run-dir=td/ver-health '--admin-socket=/tmp/ceph-asok.162951/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ver-health/$name.log' '--pid-file=td/ver-health/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T01:02:06.310 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T01:02:06.311 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T01:02:06.311 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T01:02:06.325 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T01:02:06.314+0000 7fccfc6bca40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:02:06.326 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T01:02:06.314+0000 7fccfc6bca40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:02:06.327 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T01:02:06.318+0000 7fccfc6bca40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:02:06.419 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2026-02-18T01:02:06.419 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T01:02:06.419 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-18T01:02:06.419 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T01:02:06.419 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T01:02:06.420 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:02:06.420 INFO:tasks.workunit.client.0.trial069.stdout:0 2026-02-18T01:02:06.421 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T01:02:06.421 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:02:06.421 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-18T01:02:06.529 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T01:02:06.740 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T01:02:06.730+0000 7fccfc6bca40 -1 Falling back to public interface 2026-02-18T01:02:07.280 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T01:02:07.270+0000 7fccfc6bca40 -1 osd.2 0 log_to_monitors true 2026-02-18T01:02:07.529 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T01:02:07.530 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:02:07.530 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T01:02:07.530 INFO:tasks.workunit.client.0.trial069.stdout:1 2026-02-18T01:02:07.530 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:02:07.530 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-18T01:02:07.643 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T01:02:08.645 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T01:02:08.645 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:02:08.646 INFO:tasks.workunit.client.0.trial069.stdout:2 2026-02-18T01:02:08.646 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-18T01:02:08.646 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:02:08.646 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-18T01:02:08.755 INFO:tasks.workunit.client.0.trial069.stdout:osd.2 up in weight 1 up_from 14 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6816/2710010669,v1:127.0.0.1:6817/2710010669] [v2:127.0.0.1:6818/2710010669,v1:127.0.0.1:6819/2710010669] exists,up 5d1c4621-3338-4f5f-b3f0-a0fee0f479a0 2026-02-18T01:02:08.756 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T01:02:08.756 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T01:02:08.756 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T01:02:08.756 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:127: TEST_check_version_health_2: run_mgr td/ver-health x 2026-02-18T01:02:08.756 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/ver-health 2026-02-18T01:02:08.757 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-18T01:02:08.757 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-18T01:02:08.757 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-18T01:02:08.757 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/ver-health/x 2026-02-18T01:02:08.757 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-18T01:02:08.867 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-18T01:02:08.868 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T01:02:08.868 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T01:02:08.868 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T01:02:08.868 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:02:08.868 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.162951 2026-02-18T01:02:08.868 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.162951/$cluster-$name.asok' 2026-02-18T01:02:08.869 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-18T01:02:08.869 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/ver-health/x '--log-file=td/ver-health/$name.log' '--admin-socket=/tmp/ceph-asok.162951/$cluster-$name.asok' --run-dir=td/ver-health '--pid-file=td/ver-health/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-18T01:02:08.887 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:128: TEST_check_version_health_2: run_mgr td/ver-health y 2026-02-18T01:02:08.887 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/ver-health 2026-02-18T01:02:08.887 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-18T01:02:08.887 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=y 2026-02-18T01:02:08.888 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-18T01:02:08.888 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/ver-health/y 2026-02-18T01:02:08.888 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-18T01:02:09.000 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-18T01:02:09.001 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T01:02:09.001 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T01:02:09.001 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T01:02:09.001 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:02:09.001 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.162951 2026-02-18T01:02:09.001 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.162951/$cluster-$name.asok' 2026-02-18T01:02:09.002 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-18T01:02:09.002 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id y --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/ver-health/y '--log-file=td/ver-health/$name.log' '--admin-socket=/tmp/ceph-asok.162951/$cluster-$name.asok' --run-dir=td/ver-health '--pid-file=td/ver-health/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-18T01:02:09.019 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:129: TEST_check_version_health_2: run_mds td/ver-health m 2026-02-18T01:02:09.019 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:570: run_mds: local dir=td/ver-health 2026-02-18T01:02:09.019 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:571: run_mds: shift 2026-02-18T01:02:09.019 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:572: run_mds: local id=m 2026-02-18T01:02:09.019 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:573: run_mds: shift 2026-02-18T01:02:09.019 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:574: run_mds: local data=td/ver-health/m 2026-02-18T01:02:09.019 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:577: run_mds: get_asok_path 2026-02-18T01:02:09.019 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T01:02:09.020 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T01:02:09.020 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T01:02:09.020 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:02:09.020 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.162951 2026-02-18T01:02:09.020 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.162951/$cluster-$name.asok' 2026-02-18T01:02:09.020 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:577: run_mds: ceph-mds --id m --debug-mds 20 --debug-objecter 20 --debug-ms 20 --chdir= --mds-data=td/ver-health/m '--log-file=td/ver-health/$name.log' '--admin-socket=/tmp/ceph-asok.162951/$cluster-$name.asok' --run-dir=td/ver-health '--pid-file=td/ver-health/$name.pid' 2026-02-18T01:02:09.043 INFO:tasks.workunit.client.0.trial069.stdout:starting mds.m at 2026-02-18T01:02:09.048 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:130: TEST_check_version_health_2: run_mds td/ver-health n 2026-02-18T01:02:09.049 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:570: run_mds: local dir=td/ver-health 2026-02-18T01:02:09.049 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:571: run_mds: shift 2026-02-18T01:02:09.049 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:572: run_mds: local id=n 2026-02-18T01:02:09.049 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:573: run_mds: shift 2026-02-18T01:02:09.049 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:574: run_mds: local data=td/ver-health/n 2026-02-18T01:02:09.049 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:577: run_mds: get_asok_path 2026-02-18T01:02:09.049 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T01:02:09.049 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T01:02:09.049 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T01:02:09.049 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:02:09.050 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.162951 2026-02-18T01:02:09.050 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.162951/$cluster-$name.asok' 2026-02-18T01:02:09.050 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:577: run_mds: ceph-mds --id n --debug-mds 20 --debug-objecter 20 --debug-ms 20 --chdir= --mds-data=td/ver-health/n '--log-file=td/ver-health/$name.log' '--admin-socket=/tmp/ceph-asok.162951/$cluster-$name.asok' --run-dir=td/ver-health '--pid-file=td/ver-health/$name.pid' 2026-02-18T01:02:09.064 INFO:tasks.workunit.client.0.trial069.stdout:starting mds.n at 2026-02-18T01:02:09.068 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:132: TEST_check_version_health_2: sleep 5 2026-02-18T01:02:14.069 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:133: TEST_check_version_health_2: ceph health detail 2026-02-18T01:02:14.338 INFO:tasks.workunit.client.0.trial069.stdout:HEALTH_OK 2026-02-18T01:02:14.347 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:135: TEST_check_version_health_2: ceph health detail 2026-02-18T01:02:14.347 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:135: TEST_check_version_health_2: grep DAEMON_OLD_VERSION 2026-02-18T01:02:14.620 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:137: TEST_check_version_health_2: kill_daemons td/ver-health KILL mon.b 2026-02-18T01:02:14.620 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T01:02:14.621 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T01:02:14.621 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T01:02:14.621 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T01:02:14.621 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T01:02:14.729 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T01:02:14.730 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:138: TEST_check_version_health_2: ceph_debug_version_for_testing=01.00.00-gversion-test 2026-02-18T01:02:14.730 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:138: TEST_check_version_health_2: run_mon td/ver-health b --mon_warn_older_version_delay=0 2026-02-18T01:02:14.730 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/ver-health 2026-02-18T01:02:14.730 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-18T01:02:14.730 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=b 2026-02-18T01:02:14.730 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-18T01:02:14.730 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/ver-health/b 2026-02-18T01:02:14.730 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id b --mkfs --mon-data=td/ver-health/b --run-dir=td/ver-health --mon_warn_older_version_delay=0 2026-02-18T01:02:14.744 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T01:02:14.734+0000 7f9510c3bec0 -1 'td/ver-health/b' already exists and is not empty: monitor may already exist 2026-02-18T01:02:14.745 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-18T01:02:14.746 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T01:02:14.746 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T01:02:14.746 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T01:02:14.747 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:02:14.747 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.162951 2026-02-18T01:02:14.747 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.162951/$cluster-$name.asok' 2026-02-18T01:02:14.747 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id b --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/ver-health/b '--log-file=td/ver-health/$name.log' '--admin-socket=/tmp/ceph-asok.162951/$cluster-$name.asok' --mon-cluster-log-file=td/ver-health/log --run-dir=td/ver-health '--pid-file=td/ver-health/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --mon_warn_older_version_delay=0 2026-02-18T01:02:14.780 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-18T01:02:14.781 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon b fsid 2026-02-18T01:02:14.781 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T01:02:14.781 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=b 2026-02-18T01:02:14.781 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-18T01:02:14.782 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-18T01:02:14.782 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.b 2026-02-18T01:02:14.782 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.b 2026-02-18T01:02:14.782 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.b ']' 2026-02-18T01:02:14.782 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T01:02:14.782 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:02:14.782 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.162951 2026-02-18T01:02:14.783 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.162951/ceph-mon.b.asok 2026-02-18T01:02:14.783 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T01:02:14.783 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.162951/ceph-mon.b.asok config get fsid 2026-02-18T01:02:14.838 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon b mon_host 2026-02-18T01:02:14.839 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T01:02:14.839 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=b 2026-02-18T01:02:14.839 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-18T01:02:14.839 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-18T01:02:14.839 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.b 2026-02-18T01:02:14.839 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.b 2026-02-18T01:02:14.839 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.b ']' 2026-02-18T01:02:14.840 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T01:02:14.840 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:02:14.840 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.162951 2026-02-18T01:02:14.841 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.162951/ceph-mon.b.asok 2026-02-18T01:02:14.841 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T01:02:14.841 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.162951/ceph-mon.b.asok config get mon_host 2026-02-18T01:02:14.894 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:142: TEST_check_version_health_2: kill_daemons td/ver-health KILL mds.m 2026-02-18T01:02:14.895 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T01:02:14.895 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T01:02:14.895 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T01:02:14.895 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T01:02:14.895 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T01:02:15.003 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T01:02:15.003 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:143: TEST_check_version_health_2: ceph_debug_version_for_testing=01.00.00-gversion-test 2026-02-18T01:02:15.003 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:143: TEST_check_version_health_2: run_mds td/ver-health m 2026-02-18T01:02:15.003 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:570: run_mds: local dir=td/ver-health 2026-02-18T01:02:15.004 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:571: run_mds: shift 2026-02-18T01:02:15.004 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:572: run_mds: local id=m 2026-02-18T01:02:15.004 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:573: run_mds: shift 2026-02-18T01:02:15.004 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:574: run_mds: local data=td/ver-health/m 2026-02-18T01:02:15.004 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:577: run_mds: get_asok_path 2026-02-18T01:02:15.004 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T01:02:15.004 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T01:02:15.004 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T01:02:15.004 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:02:15.004 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.162951 2026-02-18T01:02:15.004 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.162951/$cluster-$name.asok' 2026-02-18T01:02:15.005 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:577: run_mds: ceph-mds --id m --debug-mds 20 --debug-objecter 20 --debug-ms 20 --chdir= --mds-data=td/ver-health/m '--log-file=td/ver-health/$name.log' '--admin-socket=/tmp/ceph-asok.162951/$cluster-$name.asok' --run-dir=td/ver-health '--pid-file=td/ver-health/$name.pid' 2026-02-18T01:02:15.027 INFO:tasks.workunit.client.0.trial069.stdout:starting mds.m at 2026-02-18T01:02:15.032 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:145: TEST_check_version_health_2: wait_for_health_string 'HEALTH_WARN .*There are daemons running an older version of ceph' 2026-02-18T01:02:15.033 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:40: wait_for_health_string: local 'grep_string=HEALTH_WARN .*There are daemons running an older version of ceph' 2026-02-18T01:02:15.033 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:41: wait_for_health_string: local seconds=20 2026-02-18T01:02:15.033 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:44: wait_for_health_string: set -o pipefail 2026-02-18T01:02:15.033 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:45: wait_for_health_string: PASSED=false 2026-02-18T01:02:15.033 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:46: wait_for_health_string: (( i=0 )) 2026-02-18T01:02:15.033 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:46: wait_for_health_string: (( i < 20 )) 2026-02-18T01:02:15.033 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:47: wait_for_health_string: ceph health 2026-02-18T01:02:15.033 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:47: wait_for_health_string: grep -q 'HEALTH_WARN .*There are daemons running an older version of ceph' 2026-02-18T01:02:15.281 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:52: wait_for_health_string: sleep 1 2026-02-18T01:02:16.283 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:46: wait_for_health_string: (( i++ )) 2026-02-18T01:02:16.283 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:46: wait_for_health_string: (( i < 20 )) 2026-02-18T01:02:16.283 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:47: wait_for_health_string: ceph health 2026-02-18T01:02:16.283 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:47: wait_for_health_string: grep -q 'HEALTH_WARN .*There are daemons running an older version of ceph' 2026-02-18T01:02:16.527 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:52: wait_for_health_string: sleep 1 2026-02-18T01:02:17.529 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:46: wait_for_health_string: (( i++ )) 2026-02-18T01:02:17.529 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:46: wait_for_health_string: (( i < 20 )) 2026-02-18T01:02:17.530 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:47: wait_for_health_string: ceph health 2026-02-18T01:02:17.530 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:47: wait_for_health_string: grep -q 'HEALTH_WARN .*There are daemons running an older version of ceph' 2026-02-18T01:02:17.776 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:49: wait_for_health_string: PASSED=true 2026-02-18T01:02:17.776 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:50: wait_for_health_string: break 2026-02-18T01:02:17.776 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:54: wait_for_health_string: set +o pipefail 2026-02-18T01:02:17.776 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:57: wait_for_health_string: '[' true = false ']' 2026-02-18T01:02:17.776 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:61: wait_for_health_string: return 0 2026-02-18T01:02:17.776 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:147: TEST_check_version_health_2: ceph health detail 2026-02-18T01:02:18.048 INFO:tasks.workunit.client.0.trial069.stdout:HEALTH_WARN There are daemons running an older version of ceph 2026-02-18T01:02:18.049 INFO:tasks.workunit.client.0.trial069.stdout:[WRN] DAEMON_OLD_VERSION: There are daemons running an older version of ceph 2026-02-18T01:02:18.049 INFO:tasks.workunit.client.0.trial069.stdout: mon.b mds.m are running an older version of ceph: 01.00.00-gversion-test 2026-02-18T01:02:18.058 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:149: TEST_check_version_health_2: ceph health detail 2026-02-18T01:02:18.058 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:149: TEST_check_version_health_2: grep -q 'HEALTH_WARN .*There are daemons running an older version of ceph' 2026-02-18T01:02:18.351 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:150: TEST_check_version_health_2: ceph health detail 2026-02-18T01:02:18.351 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:150: TEST_check_version_health_2: grep -q '^[[]WRN[]] DAEMON_OLD_VERSION: There are daemons running an older version of ceph' 2026-02-18T01:02:18.649 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:151: TEST_check_version_health_2: ceph health detail 2026-02-18T01:02:18.649 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:151: TEST_check_version_health_2: grep -q 'mon.b mds.m are running an older version of ceph: 01.00.00-gversion-test' 2026-02-18T01:02:18.941 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:153: TEST_check_version_health_2: kill_daemons td/ver-health KILL osd.2 2026-02-18T01:02:18.942 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T01:02:18.943 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T01:02:18.943 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T01:02:18.943 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T01:02:18.943 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T01:02:19.053 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T01:02:19.053 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:154: TEST_check_version_health_2: ceph_debug_version_for_testing=01.00.00-gversion-test 2026-02-18T01:02:19.054 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:154: TEST_check_version_health_2: activate_osd td/ver-health 2 2026-02-18T01:02:19.054 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/ver-health 2026-02-18T01:02:19.054 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-18T01:02:19.054 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=2 2026-02-18T01:02:19.054 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-18T01:02:19.054 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/ver-health/2 2026-02-18T01:02:19.054 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=f12f9151-9f82-4cd0-b200-adf3932f8443 --auth-supported=none --mon-host= --mon_health_to_clog_tick_interval=1.0 --mon-host=127.0.0.1:7165 ' 2026-02-18T01:02:19.054 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T01:02:19.054 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T01:02:19.054 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T01:02:19.054 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/ver-health/2' 2026-02-18T01:02:19.055 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/ver-health/2/journal' 2026-02-18T01:02:19.055 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-18T01:02:19.055 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-18T01:02:19.055 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/ver-health' 2026-02-18T01:02:19.055 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-18T01:02:19.055 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T01:02:19.055 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T01:02:19.055 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T01:02:19.055 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:02:19.055 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.162951 2026-02-18T01:02:19.055 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.162951/$cluster-$name.asok' 2026-02-18T01:02:19.055 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.162951/$cluster-$name.asok' 2026-02-18T01:02:19.055 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-18T01:02:19.056 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/ver-health/$name.log' 2026-02-18T01:02:19.056 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/ver-health/$name.pid' 2026-02-18T01:02:19.056 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T01:02:19.056 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T01:02:19.056 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T01:02:19.056 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T01:02:19.056 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-18T01:02:19.056 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-18T01:02:19.056 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/ver-health/2 2026-02-18T01:02:19.057 INFO:tasks.workunit.client.0.trial069.stdout:start osd.2 2026-02-18T01:02:19.058 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.2 2026-02-18T01:02:19.058 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 2 --fsid=f12f9151-9f82-4cd0-b200-adf3932f8443 --auth-supported=none --mon-host= --mon_health_to_clog_tick_interval=1.0 --mon-host=127.0.0.1:7165 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ver-health/2 --osd-journal=td/ver-health/2/journal --chdir= --run-dir=td/ver-health '--admin-socket=/tmp/ceph-asok.162951/$cluster-$name.asok' --debug-osd=20 '--log-file=td/ver-health/$name.log' '--pid-file=td/ver-health/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T01:02:19.058 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/ver-health/2/whoami 2026-02-18T01:02:19.058 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 2 = 2 ']' 2026-02-18T01:02:19.058 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-18T01:02:19.058 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-18T01:02:19.058 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-18T01:02:19.072 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T01:02:19.062+0000 7f4cee984a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:02:19.074 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T01:02:19.062+0000 7f4cee984a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:02:19.074 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T01:02:19.062+0000 7f4cee984a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:02:19.269 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 2 2026-02-18T01:02:19.270 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T01:02:19.270 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-18T01:02:19.270 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T01:02:19.270 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T01:02:19.270 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:02:19.270 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T01:02:19.270 INFO:tasks.workunit.client.0.trial069.stdout:0 2026-02-18T01:02:19.271 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:02:19.271 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-18T01:02:19.480 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T01:02:19.532 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T01:02:19.522+0000 7f4cee984a40 -1 Falling back to public interface 2026-02-18T01:02:20.203 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T01:02:20.194+0000 7f4cee984a40 -1 osd.2 15 log_to_monitors true 2026-02-18T01:02:20.481 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T01:02:20.482 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:02:20.482 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T01:02:20.482 INFO:tasks.workunit.client.0.trial069.stdout:1 2026-02-18T01:02:20.482 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:02:20.483 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-18T01:02:20.688 INFO:tasks.workunit.client.0.trial069.stdout:osd.2 up in weight 1 up_from 18 up_thru 0 down_at 16 last_clean_interval [14,15) [v2:127.0.0.1:6816/368316573,v1:127.0.0.1:6817/368316573] [v2:127.0.0.1:6818/368316573,v1:127.0.0.1:6819/368316573] exists,up 5d1c4621-3338-4f5f-b3f0-a0fee0f479a0 2026-02-18T01:02:20.688 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T01:02:20.688 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T01:02:20.688 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T01:02:20.688 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:155: TEST_check_version_health_2: kill_daemons td/ver-health KILL osd.0 2026-02-18T01:02:20.688 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T01:02:20.688 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T01:02:20.689 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T01:02:20.689 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T01:02:20.689 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T01:02:20.801 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T01:02:20.801 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:156: TEST_check_version_health_2: ceph_debug_version_for_testing=02.00.00-gversion-test 2026-02-18T01:02:20.801 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:156: TEST_check_version_health_2: activate_osd td/ver-health 0 2026-02-18T01:02:20.801 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/ver-health 2026-02-18T01:02:20.802 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-18T01:02:20.802 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-18T01:02:20.802 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-18T01:02:20.802 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/ver-health/0 2026-02-18T01:02:20.802 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=f12f9151-9f82-4cd0-b200-adf3932f8443 --auth-supported=none --mon-host= --mon_health_to_clog_tick_interval=1.0 --mon-host=127.0.0.1:7165 ' 2026-02-18T01:02:20.802 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T01:02:20.802 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T01:02:20.802 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T01:02:20.802 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/ver-health/0' 2026-02-18T01:02:20.803 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/ver-health/0/journal' 2026-02-18T01:02:20.803 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-18T01:02:20.803 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-18T01:02:20.803 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/ver-health' 2026-02-18T01:02:20.803 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-18T01:02:20.803 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T01:02:20.803 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T01:02:20.803 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T01:02:20.803 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:02:20.804 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.162951 2026-02-18T01:02:20.804 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.162951/$cluster-$name.asok' 2026-02-18T01:02:20.804 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.162951/$cluster-$name.asok' 2026-02-18T01:02:20.804 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-18T01:02:20.804 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/ver-health/$name.log' 2026-02-18T01:02:20.804 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/ver-health/$name.pid' 2026-02-18T01:02:20.804 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T01:02:20.804 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T01:02:20.804 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T01:02:20.804 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T01:02:20.805 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-18T01:02:20.805 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-18T01:02:20.805 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/ver-health/0 2026-02-18T01:02:20.805 INFO:tasks.workunit.client.0.trial069.stdout:start osd.0 2026-02-18T01:02:20.806 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-18T01:02:20.807 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=f12f9151-9f82-4cd0-b200-adf3932f8443 --auth-supported=none --mon-host= --mon_health_to_clog_tick_interval=1.0 --mon-host=127.0.0.1:7165 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ver-health/0 --osd-journal=td/ver-health/0/journal --chdir= --run-dir=td/ver-health '--admin-socket=/tmp/ceph-asok.162951/$cluster-$name.asok' --debug-osd=20 '--log-file=td/ver-health/$name.log' '--pid-file=td/ver-health/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T01:02:20.807 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/ver-health/0/whoami 2026-02-18T01:02:20.807 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-18T01:02:20.807 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-18T01:02:20.807 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-18T01:02:20.807 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-18T01:02:20.824 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T01:02:20.814+0000 7f69d7fdea40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:02:20.825 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T01:02:20.814+0000 7f69d7fdea40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:02:20.826 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T01:02:20.814+0000 7f69d7fdea40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:02:21.008 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-18T01:02:21.008 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T01:02:21.008 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-18T01:02:21.008 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T01:02:21.009 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T01:02:21.009 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:02:21.009 INFO:tasks.workunit.client.0.trial069.stdout:0 2026-02-18T01:02:21.010 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T01:02:21.010 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:02:21.010 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T01:02:21.223 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T01:02:21.300 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T01:02:21.290+0000 7f69d7fdea40 -1 Falling back to public interface 2026-02-18T01:02:22.007 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T01:02:21.998+0000 7f69d7fdea40 -1 osd.0 17 log_to_monitors true 2026-02-18T01:02:22.224 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T01:02:22.224 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:02:22.224 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T01:02:22.225 INFO:tasks.workunit.client.0.trial069.stdout:1 2026-02-18T01:02:22.225 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:02:22.225 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T01:02:22.439 INFO:tasks.workunit.client.0.trial069.stdout:osd.0 up in weight 1 up_from 22 up_thru 0 down_at 19 last_clean_interval [5,17) [v2:127.0.0.1:6800/1390235436,v1:127.0.0.1:6801/1390235436] [v2:127.0.0.1:6802/1390235436,v1:127.0.0.1:6803/1390235436] exists,up 5cb02d31-1f8e-4bdd-9fc2-7a4b60ecdf30 2026-02-18T01:02:22.441 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T01:02:22.441 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T01:02:22.441 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T01:02:22.441 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:158: TEST_check_version_health_2: wait_for_health_string 'HEALTH_ERR .*There are daemons running multiple old versions of ceph' 2026-02-18T01:02:22.441 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:40: wait_for_health_string: local 'grep_string=HEALTH_ERR .*There are daemons running multiple old versions of ceph' 2026-02-18T01:02:22.441 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:41: wait_for_health_string: local seconds=20 2026-02-18T01:02:22.442 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:44: wait_for_health_string: set -o pipefail 2026-02-18T01:02:22.442 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:45: wait_for_health_string: PASSED=false 2026-02-18T01:02:22.442 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:46: wait_for_health_string: (( i=0 )) 2026-02-18T01:02:22.442 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:46: wait_for_health_string: (( i < 20 )) 2026-02-18T01:02:22.442 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:47: wait_for_health_string: ceph health 2026-02-18T01:02:22.442 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:47: wait_for_health_string: grep -q 'HEALTH_ERR .*There are daemons running multiple old versions of ceph' 2026-02-18T01:02:22.691 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:49: wait_for_health_string: PASSED=true 2026-02-18T01:02:22.691 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:50: wait_for_health_string: break 2026-02-18T01:02:22.691 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:54: wait_for_health_string: set +o pipefail 2026-02-18T01:02:22.691 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:57: wait_for_health_string: '[' true = false ']' 2026-02-18T01:02:22.692 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:61: wait_for_health_string: return 0 2026-02-18T01:02:22.692 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:160: TEST_check_version_health_2: ceph health detail 2026-02-18T01:02:22.961 INFO:tasks.workunit.client.0.trial069.stdout:HEALTH_ERR There are daemons running multiple old versions of ceph 2026-02-18T01:02:22.961 INFO:tasks.workunit.client.0.trial069.stdout:[ERR] DAEMON_OLD_VERSION: There are daemons running multiple old versions of ceph 2026-02-18T01:02:22.962 INFO:tasks.workunit.client.0.trial069.stdout: mon.b osd.2 mds.m are running an older version of ceph: 01.00.00-gversion-test 2026-02-18T01:02:22.962 INFO:tasks.workunit.client.0.trial069.stdout: osd.0 is running an older version of ceph: 02.00.00-gversion-test 2026-02-18T01:02:22.971 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:161: TEST_check_version_health_2: ceph health 2026-02-18T01:02:22.971 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:161: TEST_check_version_health_2: grep -q 'HEALTH_ERR .*There are daemons running multiple old versions of ceph' 2026-02-18T01:02:23.228 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:162: TEST_check_version_health_2: ceph health detail 2026-02-18T01:02:23.228 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:162: TEST_check_version_health_2: grep -q 'HEALTH_ERR .*There are daemons running multiple old versions of ceph' 2026-02-18T01:02:23.515 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:163: TEST_check_version_health_2: ceph health detail 2026-02-18T01:02:23.515 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:163: TEST_check_version_health_2: grep -q '^[[]ERR[]] DAEMON_OLD_VERSION: There are daemons running multiple old versions of ceph' 2026-02-18T01:02:23.789 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:164: TEST_check_version_health_2: ceph health detail 2026-02-18T01:02:23.790 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:164: TEST_check_version_health_2: grep -q 'mon.b osd.2 mds.m are running an older version of ceph: 01.00.00-gversion-test' 2026-02-18T01:02:24.077 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:165: TEST_check_version_health_2: ceph health detail 2026-02-18T01:02:24.077 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:165: TEST_check_version_health_2: grep -q 'osd.0 is running an older version of ceph: 02.00.00-gversion-test' 2026-02-18T01:02:24.375 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:35: run: teardown td/ver-health 2026-02-18T01:02:24.376 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/ver-health 2026-02-18T01:02:24.376 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T01:02:24.376 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/ver-health KILL 2026-02-18T01:02:24.376 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T01:02:24.376 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T01:02:24.376 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T01:02:24.376 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T01:02:24.376 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T01:02:24.487 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T01:02:24.487 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T01:02:24.488 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T01:02:24.488 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T01:02:24.490 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T01:02:24.490 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T01:02:24.490 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T01:02:24.491 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T01:02:24.491 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T01:02:24.492 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T01:02:24.492 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T01:02:24.493 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T01:02:24.494 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T01:02:24.494 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/ver-health 2026-02-18T01:02:24.508 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T01:02:24.508 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:02:24.508 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.162951 2026-02-18T01:02:24.508 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.162951 2026-02-18T01:02:24.510 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T01:02:24.511 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T01:02:24.511 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:32: run: for func in $funcs 2026-02-18T01:02:24.511 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:33: run: setup td/ver-health 2026-02-18T01:02:24.511 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/ver-health 2026-02-18T01:02:24.511 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/ver-health 2026-02-18T01:02:24.511 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/ver-health 2026-02-18T01:02:24.511 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T01:02:24.511 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/ver-health KILL 2026-02-18T01:02:24.511 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T01:02:24.511 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T01:02:24.512 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T01:02:24.512 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T01:02:24.512 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T01:02:24.513 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T01:02:24.513 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T01:02:24.514 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T01:02:24.514 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T01:02:24.515 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T01:02:24.515 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T01:02:24.516 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T01:02:24.517 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T01:02:24.517 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T01:02:24.517 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T01:02:24.518 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T01:02:24.518 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T01:02:24.520 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T01:02:24.520 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/ver-health 2026-02-18T01:02:24.521 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T01:02:24.521 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:02:24.521 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.162951 2026-02-18T01:02:24.521 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.162951 2026-02-18T01:02:24.522 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T01:02:24.522 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T01:02:24.522 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/ver-health 2026-02-18T01:02:24.524 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-18T01:02:24.524 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:02:24.524 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.162951 2026-02-18T01:02:24.524 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.162951 2026-02-18T01:02:24.526 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-18T01:02:24.528 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-18T01:02:24.528 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-18T01:02:24.528 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/ver-health 1' TERM HUP INT 2026-02-18T01:02:24.528 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:34: run: TEST_check_version_health_3 td/ver-health 2026-02-18T01:02:24.528 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:170: TEST_check_version_health_3: local dir=td/ver-health 2026-02-18T01:02:24.528 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:173: TEST_check_version_health_3: CEPH_ARGS='--fsid=f12f9151-9f82-4cd0-b200-adf3932f8443 --auth-supported=none --mon-host= --mon_health_to_clog_tick_interval=1.0 --mon-host=127.0.0.1:7165 ' 2026-02-18T01:02:24.528 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:175: TEST_check_version_health_3: setup td/ver-health 2026-02-18T01:02:24.528 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/ver-health 2026-02-18T01:02:24.529 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/ver-health 2026-02-18T01:02:24.529 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/ver-health 2026-02-18T01:02:24.529 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T01:02:24.529 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/ver-health KILL 2026-02-18T01:02:24.529 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T01:02:24.529 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T01:02:24.529 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T01:02:24.529 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T01:02:24.529 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T01:02:24.530 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T01:02:24.530 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T01:02:24.531 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T01:02:24.531 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T01:02:24.533 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T01:02:24.533 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T01:02:24.533 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T01:02:24.534 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T01:02:24.534 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T01:02:24.535 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T01:02:24.535 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T01:02:24.536 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T01:02:24.537 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T01:02:24.537 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/ver-health 2026-02-18T01:02:24.538 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T01:02:24.538 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:02:24.538 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.162951 2026-02-18T01:02:24.539 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.162951 2026-02-18T01:02:24.539 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T01:02:24.539 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T01:02:24.540 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/ver-health 2026-02-18T01:02:24.541 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-18T01:02:24.541 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:02:24.541 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.162951 2026-02-18T01:02:24.541 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.162951 2026-02-18T01:02:24.542 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-18T01:02:24.544 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-18T01:02:24.544 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-18T01:02:24.544 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/ver-health 1' TERM HUP INT 2026-02-18T01:02:24.544 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:178: TEST_check_version_health_3: run_mon td/ver-health a --public-addr=127.0.0.1:7165 2026-02-18T01:02:24.544 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/ver-health 2026-02-18T01:02:24.544 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-18T01:02:24.544 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-18T01:02:24.544 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-18T01:02:24.544 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/ver-health/a 2026-02-18T01:02:24.544 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/ver-health/a --run-dir=td/ver-health --public-addr=127.0.0.1:7165 2026-02-18T01:02:24.565 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-18T01:02:24.565 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T01:02:24.565 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T01:02:24.566 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T01:02:24.566 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:02:24.566 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.162951 2026-02-18T01:02:24.566 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.162951/$cluster-$name.asok' 2026-02-18T01:02:24.566 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/ver-health/a '--log-file=td/ver-health/$name.log' '--admin-socket=/tmp/ceph-asok.162951/$cluster-$name.asok' --mon-cluster-log-file=td/ver-health/log --run-dir=td/ver-health '--pid-file=td/ver-health/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --public-addr=127.0.0.1:7165 2026-02-18T01:02:24.596 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-18T01:02:24.597 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-18T01:02:24.597 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T01:02:24.598 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-18T01:02:24.598 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-18T01:02:24.599 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-18T01:02:24.599 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-18T01:02:24.599 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T01:02:24.599 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T01:02:24.599 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T01:02:24.599 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:02:24.599 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.162951 2026-02-18T01:02:24.599 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.162951/ceph-mon.a.asok 2026-02-18T01:02:24.600 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T01:02:24.600 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.162951/ceph-mon.a.asok config get fsid 2026-02-18T01:02:24.656 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-18T01:02:24.656 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T01:02:24.656 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-18T01:02:24.656 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-18T01:02:24.656 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-18T01:02:24.657 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-18T01:02:24.657 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T01:02:24.658 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T01:02:24.658 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T01:02:24.658 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:02:24.658 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.162951 2026-02-18T01:02:24.658 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.162951/ceph-mon.a.asok 2026-02-18T01:02:24.658 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T01:02:24.658 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.162951/ceph-mon.a.asok config get mon_host 2026-02-18T01:02:24.713 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:179: TEST_check_version_health_3: run_mon td/ver-health b --public-addr=127.0.0.1:7166 2026-02-18T01:02:24.713 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/ver-health 2026-02-18T01:02:24.713 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-18T01:02:24.714 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=b 2026-02-18T01:02:24.714 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-18T01:02:24.714 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/ver-health/b 2026-02-18T01:02:24.714 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id b --mkfs --mon-data=td/ver-health/b --run-dir=td/ver-health --public-addr=127.0.0.1:7166 2026-02-18T01:02:24.732 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-18T01:02:24.732 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T01:02:24.733 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T01:02:24.733 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T01:02:24.734 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:02:24.734 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.162951 2026-02-18T01:02:24.734 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.162951/$cluster-$name.asok' 2026-02-18T01:02:24.734 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id b --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/ver-health/b '--log-file=td/ver-health/$name.log' '--admin-socket=/tmp/ceph-asok.162951/$cluster-$name.asok' --mon-cluster-log-file=td/ver-health/log --run-dir=td/ver-health '--pid-file=td/ver-health/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --public-addr=127.0.0.1:7166 2026-02-18T01:02:24.763 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-18T01:02:24.764 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon b fsid 2026-02-18T01:02:24.764 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T01:02:24.764 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=b 2026-02-18T01:02:24.764 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-18T01:02:24.764 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-18T01:02:24.766 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.b 2026-02-18T01:02:24.766 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.b 2026-02-18T01:02:24.766 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.b ']' 2026-02-18T01:02:24.766 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T01:02:24.766 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:02:24.766 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.162951 2026-02-18T01:02:24.766 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.162951/ceph-mon.b.asok 2026-02-18T01:02:24.766 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T01:02:24.766 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.162951/ceph-mon.b.asok config get fsid 2026-02-18T01:02:24.822 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon b mon_host 2026-02-18T01:02:24.822 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T01:02:24.822 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=b 2026-02-18T01:02:24.822 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-18T01:02:24.822 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-18T01:02:24.824 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.b 2026-02-18T01:02:24.824 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.b 2026-02-18T01:02:24.824 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.b ']' 2026-02-18T01:02:24.824 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T01:02:24.824 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:02:24.824 INFO:tasks.workunit.client.0.trial069.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.162951 2026-02-18T01:02:24.824 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.162951/ceph-mon.b.asok 2026-02-18T01:02:24.824 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T01:02:24.824 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.162951/ceph-mon.b.asok config get mon_host 2026-02-18T01:02:24.882 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:181: TEST_check_version_health_3: local start_osd_time=69 2026-02-18T01:02:24.882 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:183: TEST_check_version_health_3: EXTRA_OPTS=' --osd-objectstore=memstore' 2026-02-18T01:02:24.882 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:183: TEST_check_version_health_3: run_osd td/ver-health 0 2026-02-18T01:02:24.882 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/ver-health 2026-02-18T01:02:24.882 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T01:02:24.882 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-18T01:02:24.882 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T01:02:24.882 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/ver-health/0 2026-02-18T01:02:24.883 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=f12f9151-9f82-4cd0-b200-adf3932f8443 --auth-supported=none --mon-host= --mon_health_to_clog_tick_interval=1.0 --mon-host=127.0.0.1:7165 ' 2026-02-18T01:02:24.883 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T01:02:24.883 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T01:02:24.883 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T01:02:24.883 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/ver-health/0' 2026-02-18T01:02:24.883 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/ver-health/0/journal' 2026-02-18T01:02:24.883 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T01:02:24.883 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+=' --osd-objectstore=memstore' 2026-02-18T01:02:24.883 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/ver-health' 2026-02-18T01:02:24.883 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T01:02:24.883 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T01:02:24.884 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T01:02:24.884 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T01:02:24.884 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:02:24.884 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.162951 2026-02-18T01:02:24.884 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.162951/$cluster-$name.asok' 2026-02-18T01:02:24.884 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.162951/$cluster-$name.asok' 2026-02-18T01:02:24.884 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T01:02:24.884 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T01:02:24.884 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T01:02:24.884 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/ver-health/$name.log' 2026-02-18T01:02:24.884 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/ver-health/$name.pid' 2026-02-18T01:02:24.885 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T01:02:24.885 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T01:02:24.885 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T01:02:24.885 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T01:02:24.885 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T01:02:24.885 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-18T01:02:24.885 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/ver-health/0 2026-02-18T01:02:24.886 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T01:02:24.886 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=37612818-022e-4667-9178-4145fa36ac68 2026-02-18T01:02:24.886 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 37612818-022e-4667-9178-4145fa36ac68' 2026-02-18T01:02:24.886 INFO:tasks.workunit.client.0.trial069.stdout:add osd0 37612818-022e-4667-9178-4145fa36ac68 2026-02-18T01:02:24.887 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T01:02:24.896 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQCgD5VpRFT1NBAAJonqSU6UlG1aMelVqIQmKw== 2026-02-18T01:02:24.896 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQCgD5VpRFT1NBAAJonqSU6UlG1aMelVqIQmKw=="}' 2026-02-18T01:02:24.897 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 37612818-022e-4667-9178-4145fa36ac68 -i td/ver-health/0/new.json 2026-02-18T01:02:31.020 INFO:tasks.workunit.client.0.trial069.stdout:0 2026-02-18T01:02:31.028 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/ver-health/0/new.json 2026-02-18T01:02:31.029 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=f12f9151-9f82-4cd0-b200-adf3932f8443 --auth-supported=none --mon-host= --mon_health_to_clog_tick_interval=1.0 --mon-host=127.0.0.1:7165 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ver-health/0 --osd-journal=td/ver-health/0/journal --chdir= --osd-objectstore=memstore --run-dir=td/ver-health '--admin-socket=/tmp/ceph-asok.162951/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ver-health/$name.log' '--pid-file=td/ver-health/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCgD5VpRFT1NBAAJonqSU6UlG1aMelVqIQmKw== --osd-uuid 37612818-022e-4667-9178-4145fa36ac68 2026-02-18T01:02:31.045 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T01:02:31.034+0000 7f31f95a8a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:02:31.046 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T01:02:31.034+0000 7f31f95a8a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:02:31.047 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T01:02:31.038+0000 7f31f95a8a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:02:31.048 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T01:02:31.038+0000 7f31f95a8a40 -1 memstore(td/ver-health/0) td/ver-health/0 2026-02-18T01:02:31.056 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/ver-health/0/keyring 2026-02-18T01:02:31.056 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T01:02:31.057 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-18T01:02:31.058 INFO:tasks.workunit.client.0.trial069.stdout:adding osd0 key to auth repository 2026-02-18T01:02:31.058 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/ver-health/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T01:02:31.179 INFO:tasks.workunit.client.0.trial069.stdout:start osd.0 2026-02-18T01:02:31.180 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-18T01:02:31.180 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=f12f9151-9f82-4cd0-b200-adf3932f8443 --auth-supported=none --mon-host= --mon_health_to_clog_tick_interval=1.0 --mon-host=127.0.0.1:7165 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ver-health/0 --osd-journal=td/ver-health/0/journal --chdir= --osd-objectstore=memstore --run-dir=td/ver-health '--admin-socket=/tmp/ceph-asok.162951/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ver-health/$name.log' '--pid-file=td/ver-health/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T01:02:31.180 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T01:02:31.180 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T01:02:31.180 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T01:02:31.203 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T01:02:31.194+0000 7f6c2068ba40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:02:31.205 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T01:02:31.194+0000 7f6c2068ba40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:02:31.205 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T01:02:31.194+0000 7f6c2068ba40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:02:31.208 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T01:02:31.198+0000 7f6c2068ba40 -1 Falling back to public interface 2026-02-18T01:02:31.215 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T01:02:31.206+0000 7f6c2068ba40 -1 osd.0 0 log_to_monitors true 2026-02-18T01:02:31.288 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-18T01:02:31.289 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T01:02:31.289 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-18T01:02:31.289 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T01:02:31.289 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T01:02:31.289 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:02:31.289 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T01:02:31.289 INFO:tasks.workunit.client.0.trial069.stdout:0 2026-02-18T01:02:31.290 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:02:31.290 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T01:02:31.398 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T01:02:32.399 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T01:02:32.400 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:02:32.400 INFO:tasks.workunit.client.0.trial069.stdout:1 2026-02-18T01:02:32.401 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T01:02:32.401 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:02:32.401 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T01:02:32.507 INFO:tasks.workunit.client.0.trial069.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/3360401291,v1:127.0.0.1:6801/3360401291] [v2:127.0.0.1:6802/3360401291,v1:127.0.0.1:6803/3360401291] exists,up 37612818-022e-4667-9178-4145fa36ac68 2026-02-18T01:02:32.510 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T01:02:32.510 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T01:02:32.510 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T01:02:32.510 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:184: TEST_check_version_health_3: EXTRA_OPTS=' --osd-objectstore=memstore' 2026-02-18T01:02:32.511 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:184: TEST_check_version_health_3: run_osd td/ver-health 1 2026-02-18T01:02:32.511 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/ver-health 2026-02-18T01:02:32.511 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T01:02:32.511 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2026-02-18T01:02:32.511 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T01:02:32.511 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/ver-health/1 2026-02-18T01:02:32.511 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=f12f9151-9f82-4cd0-b200-adf3932f8443 --auth-supported=none --mon-host= --mon_health_to_clog_tick_interval=1.0 --mon-host=127.0.0.1:7165 ' 2026-02-18T01:02:32.511 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T01:02:32.511 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T01:02:32.511 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T01:02:32.511 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/ver-health/1' 2026-02-18T01:02:32.511 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/ver-health/1/journal' 2026-02-18T01:02:32.512 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T01:02:32.512 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+=' --osd-objectstore=memstore' 2026-02-18T01:02:32.512 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/ver-health' 2026-02-18T01:02:32.512 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T01:02:32.512 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T01:02:32.512 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T01:02:32.512 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T01:02:32.512 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:02:32.512 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.162951 2026-02-18T01:02:32.512 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.162951/$cluster-$name.asok' 2026-02-18T01:02:32.512 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.162951/$cluster-$name.asok' 2026-02-18T01:02:32.512 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T01:02:32.512 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T01:02:32.513 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T01:02:32.513 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/ver-health/$name.log' 2026-02-18T01:02:32.513 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/ver-health/$name.pid' 2026-02-18T01:02:32.513 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T01:02:32.513 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T01:02:32.513 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T01:02:32.513 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T01:02:32.513 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T01:02:32.513 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-18T01:02:32.513 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/ver-health/1 2026-02-18T01:02:32.514 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T01:02:32.514 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=b4ff3094-3834-4650-a289-0ac3efc7a8ea 2026-02-18T01:02:32.514 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 b4ff3094-3834-4650-a289-0ac3efc7a8ea' 2026-02-18T01:02:32.515 INFO:tasks.workunit.client.0.trial069.stdout:add osd1 b4ff3094-3834-4650-a289-0ac3efc7a8ea 2026-02-18T01:02:32.515 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T01:02:32.525 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQCoD5VpGgbSHhAAygPDUAypKXyFHpxy6T5j0g== 2026-02-18T01:02:32.525 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQCoD5VpGgbSHhAAygPDUAypKXyFHpxy6T5j0g=="}' 2026-02-18T01:02:32.525 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new b4ff3094-3834-4650-a289-0ac3efc7a8ea -i td/ver-health/1/new.json 2026-02-18T01:02:32.642 INFO:tasks.workunit.client.0.trial069.stdout:1 2026-02-18T01:02:32.652 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/ver-health/1/new.json 2026-02-18T01:02:32.653 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=f12f9151-9f82-4cd0-b200-adf3932f8443 --auth-supported=none --mon-host= --mon_health_to_clog_tick_interval=1.0 --mon-host=127.0.0.1:7165 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ver-health/1 --osd-journal=td/ver-health/1/journal --chdir= --osd-objectstore=memstore --run-dir=td/ver-health '--admin-socket=/tmp/ceph-asok.162951/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ver-health/$name.log' '--pid-file=td/ver-health/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCoD5VpGgbSHhAAygPDUAypKXyFHpxy6T5j0g== --osd-uuid b4ff3094-3834-4650-a289-0ac3efc7a8ea 2026-02-18T01:02:32.677 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T01:02:32.666+0000 7f115a326a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:02:32.679 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T01:02:32.670+0000 7f115a326a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:02:32.680 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T01:02:32.670+0000 7f115a326a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:02:32.680 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T01:02:32.670+0000 7f115a326a40 -1 memstore(td/ver-health/1) td/ver-health/1 2026-02-18T01:02:32.689 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/ver-health/1/keyring 2026-02-18T01:02:32.689 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T01:02:32.690 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2026-02-18T01:02:32.690 INFO:tasks.workunit.client.0.trial069.stdout:adding osd1 key to auth repository 2026-02-18T01:02:32.690 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/ver-health/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T01:02:32.810 INFO:tasks.workunit.client.0.trial069.stdout:start osd.1 2026-02-18T01:02:32.811 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2026-02-18T01:02:32.811 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=f12f9151-9f82-4cd0-b200-adf3932f8443 --auth-supported=none --mon-host= --mon_health_to_clog_tick_interval=1.0 --mon-host=127.0.0.1:7165 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ver-health/1 --osd-journal=td/ver-health/1/journal --chdir= --osd-objectstore=memstore --run-dir=td/ver-health '--admin-socket=/tmp/ceph-asok.162951/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ver-health/$name.log' '--pid-file=td/ver-health/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T01:02:32.811 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T01:02:32.812 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T01:02:32.812 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T01:02:32.825 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T01:02:32.814+0000 7f6d8c645a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:02:32.827 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T01:02:32.818+0000 7f6d8c645a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:02:32.828 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T01:02:32.818+0000 7f6d8c645a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:02:32.830 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T01:02:32.818+0000 7f6d8c645a40 -1 Falling back to public interface 2026-02-18T01:02:32.836 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T01:02:32.826+0000 7f6d8c645a40 -1 osd.1 0 log_to_monitors true 2026-02-18T01:02:32.916 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2026-02-18T01:02:32.916 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T01:02:32.916 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-18T01:02:32.916 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T01:02:32.917 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T01:02:32.917 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:02:32.917 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T01:02:32.917 INFO:tasks.workunit.client.0.trial069.stdout:0 2026-02-18T01:02:32.917 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:02:32.918 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-18T01:02:33.027 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T01:02:34.028 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T01:02:34.028 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:02:34.029 INFO:tasks.workunit.client.0.trial069.stdout:1 2026-02-18T01:02:34.029 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T01:02:34.030 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:02:34.030 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-18T01:02:34.139 INFO:tasks.workunit.client.0.trial069.stdout:osd.1 up in weight 1 up_from 10 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6808/502745,v1:127.0.0.1:6809/502745] [v2:127.0.0.1:6810/502745,v1:127.0.0.1:6811/502745] exists,up b4ff3094-3834-4650-a289-0ac3efc7a8ea 2026-02-18T01:02:34.143 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T01:02:34.143 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T01:02:34.143 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T01:02:34.143 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:185: TEST_check_version_health_3: EXTRA_OPTS=' --osd-objectstore=memstore' 2026-02-18T01:02:34.143 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:185: TEST_check_version_health_3: run_osd td/ver-health 2 2026-02-18T01:02:34.143 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/ver-health 2026-02-18T01:02:34.143 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T01:02:34.144 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2026-02-18T01:02:34.144 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T01:02:34.144 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/ver-health/2 2026-02-18T01:02:34.144 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=f12f9151-9f82-4cd0-b200-adf3932f8443 --auth-supported=none --mon-host= --mon_health_to_clog_tick_interval=1.0 --mon-host=127.0.0.1:7165 ' 2026-02-18T01:02:34.144 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T01:02:34.144 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T01:02:34.144 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T01:02:34.144 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/ver-health/2' 2026-02-18T01:02:34.144 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/ver-health/2/journal' 2026-02-18T01:02:34.144 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T01:02:34.144 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+=' --osd-objectstore=memstore' 2026-02-18T01:02:34.144 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/ver-health' 2026-02-18T01:02:34.144 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T01:02:34.145 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T01:02:34.145 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T01:02:34.145 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T01:02:34.145 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:02:34.145 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.162951 2026-02-18T01:02:34.145 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.162951/$cluster-$name.asok' 2026-02-18T01:02:34.145 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.162951/$cluster-$name.asok' 2026-02-18T01:02:34.145 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T01:02:34.145 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T01:02:34.145 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T01:02:34.145 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/ver-health/$name.log' 2026-02-18T01:02:34.146 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/ver-health/$name.pid' 2026-02-18T01:02:34.146 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T01:02:34.146 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T01:02:34.146 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T01:02:34.146 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T01:02:34.146 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T01:02:34.146 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-18T01:02:34.146 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/ver-health/2 2026-02-18T01:02:34.146 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T01:02:34.147 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=22c9316d-f712-4647-b3d3-d87d45cc4b8c 2026-02-18T01:02:34.147 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 22c9316d-f712-4647-b3d3-d87d45cc4b8c' 2026-02-18T01:02:34.147 INFO:tasks.workunit.client.0.trial069.stdout:add osd2 22c9316d-f712-4647-b3d3-d87d45cc4b8c 2026-02-18T01:02:34.148 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T01:02:34.156 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQCqD5Vp6oLVCBAAY0/zwwhPAjXzIAAVh6rPfw== 2026-02-18T01:02:34.156 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQCqD5Vp6oLVCBAAY0/zwwhPAjXzIAAVh6rPfw=="}' 2026-02-18T01:02:34.156 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 22c9316d-f712-4647-b3d3-d87d45cc4b8c -i td/ver-health/2/new.json 2026-02-18T01:02:34.277 INFO:tasks.workunit.client.0.trial069.stdout:2 2026-02-18T01:02:34.284 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/ver-health/2/new.json 2026-02-18T01:02:34.285 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --fsid=f12f9151-9f82-4cd0-b200-adf3932f8443 --auth-supported=none --mon-host= --mon_health_to_clog_tick_interval=1.0 --mon-host=127.0.0.1:7165 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ver-health/2 --osd-journal=td/ver-health/2/journal --chdir= --osd-objectstore=memstore --run-dir=td/ver-health '--admin-socket=/tmp/ceph-asok.162951/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ver-health/$name.log' '--pid-file=td/ver-health/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCqD5Vp6oLVCBAAY0/zwwhPAjXzIAAVh6rPfw== --osd-uuid 22c9316d-f712-4647-b3d3-d87d45cc4b8c 2026-02-18T01:02:34.301 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T01:02:34.290+0000 7fea8b20da40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:02:34.303 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T01:02:34.294+0000 7fea8b20da40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:02:34.304 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T01:02:34.294+0000 7fea8b20da40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:02:34.304 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T01:02:34.294+0000 7fea8b20da40 -1 memstore(td/ver-health/2) td/ver-health/2 2026-02-18T01:02:34.313 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/ver-health/2/keyring 2026-02-18T01:02:34.313 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T01:02:34.314 INFO:tasks.workunit.client.0.trial069.stdout:adding osd2 key to auth repository 2026-02-18T01:02:34.314 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2026-02-18T01:02:34.315 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/ver-health/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T01:02:34.436 INFO:tasks.workunit.client.0.trial069.stdout:start osd.2 2026-02-18T01:02:34.437 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2026-02-18T01:02:34.437 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --fsid=f12f9151-9f82-4cd0-b200-adf3932f8443 --auth-supported=none --mon-host= --mon_health_to_clog_tick_interval=1.0 --mon-host=127.0.0.1:7165 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ver-health/2 --osd-journal=td/ver-health/2/journal --chdir= --osd-objectstore=memstore --run-dir=td/ver-health '--admin-socket=/tmp/ceph-asok.162951/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ver-health/$name.log' '--pid-file=td/ver-health/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T01:02:34.437 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T01:02:34.437 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T01:02:34.437 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T01:02:34.460 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T01:02:34.450+0000 7fd1899c8a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:02:34.461 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T01:02:34.450+0000 7fd1899c8a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:02:34.462 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T01:02:34.450+0000 7fd1899c8a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:02:34.464 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T01:02:34.454+0000 7fd1899c8a40 -1 Falling back to public interface 2026-02-18T01:02:34.473 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T01:02:34.462+0000 7fd1899c8a40 -1 osd.2 0 log_to_monitors true 2026-02-18T01:02:34.544 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2026-02-18T01:02:34.544 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T01:02:34.545 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-18T01:02:34.545 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T01:02:34.545 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T01:02:34.545 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:02:34.545 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T01:02:34.545 INFO:tasks.workunit.client.0.trial069.stdout:0 2026-02-18T01:02:34.546 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:02:34.546 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-18T01:02:34.657 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T01:02:35.658 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T01:02:35.659 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:02:35.659 INFO:tasks.workunit.client.0.trial069.stdout:1 2026-02-18T01:02:35.660 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T01:02:35.660 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:02:35.660 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-18T01:02:35.768 INFO:tasks.workunit.client.0.trial069.stdout:osd.2 up in weight 1 up_from 14 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6816/2078544082,v1:127.0.0.1:6817/2078544082] [v2:127.0.0.1:6818/2078544082,v1:127.0.0.1:6819/2078544082] exists,up 22c9316d-f712-4647-b3d3-d87d45cc4b8c 2026-02-18T01:02:35.769 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T01:02:35.769 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T01:02:35.769 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T01:02:35.769 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:187: TEST_check_version_health_3: local warn_older_version_delay=31 2026-02-18T01:02:35.769 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:189: TEST_check_version_health_3: sleep 5 2026-02-18T01:02:40.770 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:190: TEST_check_version_health_3: ceph health detail 2026-02-18T01:02:40.874 INFO:tasks.workunit.client.0.trial069.stdout:HEALTH_OK 2026-02-18T01:02:40.884 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:192: TEST_check_version_health_3: ceph health detail 2026-02-18T01:02:40.885 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:192: TEST_check_version_health_3: grep DAEMON_OLD_VERSION 2026-02-18T01:02:40.998 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:193: TEST_check_version_health_3: ceph tell 'mon.*' injectargs '--mon_warn_older_version_delay 31' 2026-02-18T01:02:41.062 INFO:tasks.workunit.client.0.trial069.stdout:mon.a: {} 2026-02-18T01:02:41.070 INFO:tasks.workunit.client.0.trial069.stdout:mon.b: {} 2026-02-18T01:02:41.080 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:194: TEST_check_version_health_3: kill_daemons td/ver-health KILL osd.1 2026-02-18T01:02:41.081 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T01:02:41.081 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T01:02:41.081 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T01:02:41.081 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T01:02:41.081 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T01:02:41.190 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T01:02:41.190 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:195: TEST_check_version_health_3: EXTRA_OPTS=' --osd-objectstore=memstore' 2026-02-18T01:02:41.190 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:195: TEST_check_version_health_3: ceph_debug_version_for_testing=01.00.00-gversion-test 2026-02-18T01:02:41.190 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:195: TEST_check_version_health_3: activate_osd td/ver-health 1 2026-02-18T01:02:41.190 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/ver-health 2026-02-18T01:02:41.190 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-18T01:02:41.190 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-18T01:02:41.191 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-18T01:02:41.191 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/ver-health/1 2026-02-18T01:02:41.191 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=f12f9151-9f82-4cd0-b200-adf3932f8443 --auth-supported=none --mon-host= --mon_health_to_clog_tick_interval=1.0 --mon-host=127.0.0.1:7165 ' 2026-02-18T01:02:41.191 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T01:02:41.191 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T01:02:41.191 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T01:02:41.191 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/ver-health/1' 2026-02-18T01:02:41.191 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/ver-health/1/journal' 2026-02-18T01:02:41.191 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-18T01:02:41.191 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+=' --osd-objectstore=memstore' 2026-02-18T01:02:41.191 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/ver-health' 2026-02-18T01:02:41.191 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-18T01:02:41.191 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T01:02:41.192 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T01:02:41.192 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T01:02:41.192 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:02:41.192 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.162951 2026-02-18T01:02:41.192 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.162951/$cluster-$name.asok' 2026-02-18T01:02:41.193 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.162951/$cluster-$name.asok' 2026-02-18T01:02:41.193 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-18T01:02:41.193 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/ver-health/$name.log' 2026-02-18T01:02:41.193 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/ver-health/$name.pid' 2026-02-18T01:02:41.194 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T01:02:41.194 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T01:02:41.194 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T01:02:41.194 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T01:02:41.194 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-18T01:02:41.194 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-18T01:02:41.194 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/ver-health/1 2026-02-18T01:02:41.194 INFO:tasks.workunit.client.0.trial069.stdout:start osd.1 2026-02-18T01:02:41.195 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-18T01:02:41.195 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=f12f9151-9f82-4cd0-b200-adf3932f8443 --auth-supported=none --mon-host= --mon_health_to_clog_tick_interval=1.0 --mon-host=127.0.0.1:7165 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ver-health/1 --osd-journal=td/ver-health/1/journal --chdir= --osd-objectstore=memstore --run-dir=td/ver-health '--admin-socket=/tmp/ceph-asok.162951/$cluster-$name.asok' --debug-osd=20 '--log-file=td/ver-health/$name.log' '--pid-file=td/ver-health/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T01:02:41.195 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/ver-health/1/whoami 2026-02-18T01:02:41.195 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-18T01:02:41.195 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-18T01:02:41.196 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-18T01:02:41.196 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-18T01:02:41.210 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T01:02:41.198+0000 7f79f979ca40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:02:41.212 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T01:02:41.202+0000 7f79f979ca40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:02:41.213 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T01:02:41.202+0000 7f79f979ca40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:02:41.214 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T01:02:41.206+0000 7f79f979ca40 -1 Falling back to public interface 2026-02-18T01:02:41.220 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T01:02:41.210+0000 7f79f979ca40 -1 osd.1 0 log_to_monitors true 2026-02-18T01:02:41.301 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-18T01:02:41.301 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T01:02:41.301 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-18T01:02:41.301 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T01:02:41.301 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T01:02:41.301 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:02:41.301 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T01:02:41.302 INFO:tasks.workunit.client.0.trial069.stdout:0 2026-02-18T01:02:41.302 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:02:41.302 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-18T01:02:41.416 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T01:02:42.417 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T01:02:42.417 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:02:42.418 INFO:tasks.workunit.client.0.trial069.stdout:1 2026-02-18T01:02:42.418 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T01:02:42.419 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:02:42.419 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-18T01:02:42.527 INFO:tasks.workunit.client.0.trial069.stdout:osd.1 up in weight 1 up_from 17 up_thru 0 down_at 15 last_clean_interval [0,0) [v2:127.0.0.1:6808/2077346897,v1:127.0.0.1:6809/2077346897] [v2:127.0.0.1:6810/2077346897,v1:127.0.0.1:6811/2077346897] exists,up b4ff3094-3834-4650-a289-0ac3efc7a8ea 2026-02-18T01:02:42.528 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T01:02:42.528 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T01:02:42.528 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T01:02:42.528 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:200: TEST_check_version_health_3: sleep 10 2026-02-18T01:02:52.529 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:202: TEST_check_version_health_3: ceph health detail 2026-02-18T01:02:52.529 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:202: TEST_check_version_health_3: grep DAEMON_OLD_VERSION 2026-02-18T01:02:52.637 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:205: TEST_check_version_health_3: wait_for_health_string 'HEALTH_WARN .*There is a daemon running an older version of ceph' 20 2026-02-18T01:02:52.638 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:40: wait_for_health_string: local 'grep_string=HEALTH_WARN .*There is a daemon running an older version of ceph' 2026-02-18T01:02:52.638 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:41: wait_for_health_string: local seconds=20 2026-02-18T01:02:52.638 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:44: wait_for_health_string: set -o pipefail 2026-02-18T01:02:52.638 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:45: wait_for_health_string: PASSED=false 2026-02-18T01:02:52.638 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:46: wait_for_health_string: (( i=0 )) 2026-02-18T01:02:52.638 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:46: wait_for_health_string: (( i < 20 )) 2026-02-18T01:02:52.638 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:47: wait_for_health_string: ceph health 2026-02-18T01:02:52.638 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:47: wait_for_health_string: grep -q 'HEALTH_WARN .*There is a daemon running an older version of ceph' 2026-02-18T01:02:52.749 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:52: wait_for_health_string: sleep 1 2026-02-18T01:02:53.751 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:46: wait_for_health_string: (( i++ )) 2026-02-18T01:02:53.751 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:46: wait_for_health_string: (( i < 20 )) 2026-02-18T01:02:53.751 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:47: wait_for_health_string: ceph health 2026-02-18T01:02:53.752 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:47: wait_for_health_string: grep -q 'HEALTH_WARN .*There is a daemon running an older version of ceph' 2026-02-18T01:02:53.864 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:52: wait_for_health_string: sleep 1 2026-02-18T01:02:54.865 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:46: wait_for_health_string: (( i++ )) 2026-02-18T01:02:54.866 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:46: wait_for_health_string: (( i < 20 )) 2026-02-18T01:02:54.866 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:47: wait_for_health_string: ceph health 2026-02-18T01:02:54.867 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:47: wait_for_health_string: grep -q 'HEALTH_WARN .*There is a daemon running an older version of ceph' 2026-02-18T01:02:54.977 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:52: wait_for_health_string: sleep 1 2026-02-18T01:02:55.978 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:46: wait_for_health_string: (( i++ )) 2026-02-18T01:02:55.978 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:46: wait_for_health_string: (( i < 20 )) 2026-02-18T01:02:55.979 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:47: wait_for_health_string: ceph health 2026-02-18T01:02:55.979 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:47: wait_for_health_string: grep -q 'HEALTH_WARN .*There is a daemon running an older version of ceph' 2026-02-18T01:02:56.092 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:52: wait_for_health_string: sleep 1 2026-02-18T01:02:57.094 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:46: wait_for_health_string: (( i++ )) 2026-02-18T01:02:57.094 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:46: wait_for_health_string: (( i < 20 )) 2026-02-18T01:02:57.095 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:47: wait_for_health_string: ceph health 2026-02-18T01:02:57.095 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:47: wait_for_health_string: grep -q 'HEALTH_WARN .*There is a daemon running an older version of ceph' 2026-02-18T01:02:57.203 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:52: wait_for_health_string: sleep 1 2026-02-18T01:02:58.205 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:46: wait_for_health_string: (( i++ )) 2026-02-18T01:02:58.205 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:46: wait_for_health_string: (( i < 20 )) 2026-02-18T01:02:58.205 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:47: wait_for_health_string: ceph health 2026-02-18T01:02:58.206 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:47: wait_for_health_string: grep -q 'HEALTH_WARN .*There is a daemon running an older version of ceph' 2026-02-18T01:02:58.320 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:52: wait_for_health_string: sleep 1 2026-02-18T01:02:59.321 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:46: wait_for_health_string: (( i++ )) 2026-02-18T01:02:59.322 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:46: wait_for_health_string: (( i < 20 )) 2026-02-18T01:02:59.322 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:47: wait_for_health_string: ceph health 2026-02-18T01:02:59.322 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:47: wait_for_health_string: grep -q 'HEALTH_WARN .*There is a daemon running an older version of ceph' 2026-02-18T01:02:59.432 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:52: wait_for_health_string: sleep 1 2026-02-18T01:03:00.434 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:46: wait_for_health_string: (( i++ )) 2026-02-18T01:03:00.434 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:46: wait_for_health_string: (( i < 20 )) 2026-02-18T01:03:00.434 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:47: wait_for_health_string: ceph health 2026-02-18T01:03:00.434 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:47: wait_for_health_string: grep -q 'HEALTH_WARN .*There is a daemon running an older version of ceph' 2026-02-18T01:03:00.545 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:52: wait_for_health_string: sleep 1 2026-02-18T01:03:01.546 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:46: wait_for_health_string: (( i++ )) 2026-02-18T01:03:01.546 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:46: wait_for_health_string: (( i < 20 )) 2026-02-18T01:03:01.547 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:47: wait_for_health_string: ceph health 2026-02-18T01:03:01.547 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:47: wait_for_health_string: grep -q 'HEALTH_WARN .*There is a daemon running an older version of ceph' 2026-02-18T01:03:01.659 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:52: wait_for_health_string: sleep 1 2026-02-18T01:03:02.660 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:46: wait_for_health_string: (( i++ )) 2026-02-18T01:03:02.660 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:46: wait_for_health_string: (( i < 20 )) 2026-02-18T01:03:02.660 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:47: wait_for_health_string: ceph health 2026-02-18T01:03:02.661 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:47: wait_for_health_string: grep -q 'HEALTH_WARN .*There is a daemon running an older version of ceph' 2026-02-18T01:03:02.770 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:52: wait_for_health_string: sleep 1 2026-02-18T01:03:03.772 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:46: wait_for_health_string: (( i++ )) 2026-02-18T01:03:03.772 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:46: wait_for_health_string: (( i < 20 )) 2026-02-18T01:03:03.772 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:47: wait_for_health_string: ceph health 2026-02-18T01:03:03.773 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:47: wait_for_health_string: grep -q 'HEALTH_WARN .*There is a daemon running an older version of ceph' 2026-02-18T01:03:03.882 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:52: wait_for_health_string: sleep 1 2026-02-18T01:03:04.883 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:46: wait_for_health_string: (( i++ )) 2026-02-18T01:03:04.884 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:46: wait_for_health_string: (( i < 20 )) 2026-02-18T01:03:04.884 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:47: wait_for_health_string: ceph health 2026-02-18T01:03:04.884 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:47: wait_for_health_string: grep -q 'HEALTH_WARN .*There is a daemon running an older version of ceph' 2026-02-18T01:03:04.992 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:49: wait_for_health_string: PASSED=true 2026-02-18T01:03:04.992 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:50: wait_for_health_string: break 2026-02-18T01:03:04.993 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:54: wait_for_health_string: set +o pipefail 2026-02-18T01:03:04.993 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:57: wait_for_health_string: '[' true = false ']' 2026-02-18T01:03:04.993 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:61: wait_for_health_string: return 0 2026-02-18T01:03:04.993 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:207: TEST_check_version_health_3: ceph health detail 2026-02-18T01:03:05.108 INFO:tasks.workunit.client.0.trial069.stdout:HEALTH_WARN There is a daemon running an older version of ceph 2026-02-18T01:03:05.109 INFO:tasks.workunit.client.0.trial069.stdout:[WRN] DAEMON_OLD_VERSION: There is a daemon running an older version of ceph 2026-02-18T01:03:05.109 INFO:tasks.workunit.client.0.trial069.stdout: osd.1 is running an older version of ceph: 01.00.00-gversion-test 2026-02-18T01:03:05.116 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:209: TEST_check_version_health_3: ceph health detail 2026-02-18T01:03:05.116 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:209: TEST_check_version_health_3: grep -q 'HEALTH_WARN .*There is a daemon running an older version of ceph' 2026-02-18T01:03:05.239 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:210: TEST_check_version_health_3: ceph health detail 2026-02-18T01:03:05.240 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:210: TEST_check_version_health_3: grep -q '^[[]WRN[]] DAEMON_OLD_VERSION: There is a daemon running an older version of ceph' 2026-02-18T01:03:05.363 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:211: TEST_check_version_health_3: ceph health detail 2026-02-18T01:03:05.363 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:211: TEST_check_version_health_3: grep -q 'osd.1 is running an older version of ceph: 01.00.00-gversion-test' 2026-02-18T01:03:05.489 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:213: TEST_check_version_health_3: kill_daemons td/ver-health KILL osd.2 2026-02-18T01:03:05.489 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T01:03:05.490 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T01:03:05.490 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T01:03:05.490 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T01:03:05.490 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T01:03:05.599 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T01:03:05.599 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:214: TEST_check_version_health_3: ceph_debug_version_for_testing=01.00.00-gversion-test 2026-02-18T01:03:05.600 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:214: TEST_check_version_health_3: activate_osd td/ver-health 2 2026-02-18T01:03:05.600 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/ver-health 2026-02-18T01:03:05.600 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-18T01:03:05.600 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=2 2026-02-18T01:03:05.600 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-18T01:03:05.600 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/ver-health/2 2026-02-18T01:03:05.600 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=f12f9151-9f82-4cd0-b200-adf3932f8443 --auth-supported=none --mon-host= --mon_health_to_clog_tick_interval=1.0 --mon-host=127.0.0.1:7165 ' 2026-02-18T01:03:05.600 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T01:03:05.601 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T01:03:05.601 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T01:03:05.601 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/ver-health/2' 2026-02-18T01:03:05.601 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/ver-health/2/journal' 2026-02-18T01:03:05.601 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-18T01:03:05.601 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-18T01:03:05.601 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/ver-health' 2026-02-18T01:03:05.602 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-18T01:03:05.602 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T01:03:05.602 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T01:03:05.602 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T01:03:05.602 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:03:05.602 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.162951 2026-02-18T01:03:05.602 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.162951/$cluster-$name.asok' 2026-02-18T01:03:05.602 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.162951/$cluster-$name.asok' 2026-02-18T01:03:05.602 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-18T01:03:05.602 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/ver-health/$name.log' 2026-02-18T01:03:05.603 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/ver-health/$name.pid' 2026-02-18T01:03:05.603 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T01:03:05.603 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T01:03:05.603 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T01:03:05.603 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T01:03:05.603 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-18T01:03:05.603 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-18T01:03:05.603 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/ver-health/2 2026-02-18T01:03:05.604 INFO:tasks.workunit.client.0.trial069.stdout:start osd.2 2026-02-18T01:03:05.605 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.2 2026-02-18T01:03:05.605 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 2 --fsid=f12f9151-9f82-4cd0-b200-adf3932f8443 --auth-supported=none --mon-host= --mon_health_to_clog_tick_interval=1.0 --mon-host=127.0.0.1:7165 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ver-health/2 --osd-journal=td/ver-health/2/journal --chdir= --run-dir=td/ver-health '--admin-socket=/tmp/ceph-asok.162951/$cluster-$name.asok' --debug-osd=20 '--log-file=td/ver-health/$name.log' '--pid-file=td/ver-health/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T01:03:05.605 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/ver-health/2/whoami 2026-02-18T01:03:05.605 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 2 = 2 ']' 2026-02-18T01:03:05.605 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-18T01:03:05.606 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-18T01:03:05.606 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-18T01:03:05.618 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T01:03:05.606+0000 7f012a6b1a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:03:05.619 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T01:03:05.610+0000 7f012a6b1a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:03:05.620 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T01:03:05.610+0000 7f012a6b1a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:03:05.622 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T01:03:05.610+0000 7f012a6b1a40 -1 Falling back to public interface 2026-02-18T01:03:05.630 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T01:03:05.618+0000 7f012a6b1a40 -1 osd.2 0 log_to_monitors true 2026-02-18T01:03:05.708 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 2 2026-02-18T01:03:05.708 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T01:03:05.709 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-18T01:03:05.709 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T01:03:05.709 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T01:03:05.710 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:03:05.710 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T01:03:05.710 INFO:tasks.workunit.client.0.trial069.stdout:0 2026-02-18T01:03:05.711 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:03:05.711 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-18T01:03:05.818 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T01:03:06.819 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T01:03:06.819 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:03:06.820 INFO:tasks.workunit.client.0.trial069.stdout:1 2026-02-18T01:03:06.820 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T01:03:06.820 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:03:06.821 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-18T01:03:06.930 INFO:tasks.workunit.client.0.trial069.stdout:osd.2 up in weight 1 up_from 21 up_thru 0 down_at 19 last_clean_interval [0,0) [v2:127.0.0.1:6816/89590406,v1:127.0.0.1:6817/89590406] [v2:127.0.0.1:6818/89590406,v1:127.0.0.1:6819/89590406] exists,up 22c9316d-f712-4647-b3d3-d87d45cc4b8c 2026-02-18T01:03:06.931 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T01:03:06.931 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T01:03:06.931 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T01:03:06.931 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:215: TEST_check_version_health_3: kill_daemons td/ver-health KILL osd.0 2026-02-18T01:03:06.931 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T01:03:06.931 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T01:03:06.932 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T01:03:06.932 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T01:03:06.932 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T01:03:07.040 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T01:03:07.041 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:216: TEST_check_version_health_3: ceph_debug_version_for_testing=02.00.00-gversion-test 2026-02-18T01:03:07.041 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:216: TEST_check_version_health_3: activate_osd td/ver-health 0 2026-02-18T01:03:07.041 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/ver-health 2026-02-18T01:03:07.041 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-18T01:03:07.041 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-18T01:03:07.041 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-18T01:03:07.041 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/ver-health/0 2026-02-18T01:03:07.041 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=f12f9151-9f82-4cd0-b200-adf3932f8443 --auth-supported=none --mon-host= --mon_health_to_clog_tick_interval=1.0 --mon-host=127.0.0.1:7165 ' 2026-02-18T01:03:07.042 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T01:03:07.042 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T01:03:07.042 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T01:03:07.042 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/ver-health/0' 2026-02-18T01:03:07.042 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/ver-health/0/journal' 2026-02-18T01:03:07.042 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-18T01:03:07.042 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-18T01:03:07.042 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/ver-health' 2026-02-18T01:03:07.042 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-18T01:03:07.043 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T01:03:07.043 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T01:03:07.043 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T01:03:07.043 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:03:07.043 INFO:tasks.workunit.client.0.trial069.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.162951 2026-02-18T01:03:07.044 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.162951/$cluster-$name.asok' 2026-02-18T01:03:07.044 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.162951/$cluster-$name.asok' 2026-02-18T01:03:07.044 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-18T01:03:07.044 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/ver-health/$name.log' 2026-02-18T01:03:07.044 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/ver-health/$name.pid' 2026-02-18T01:03:07.045 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T01:03:07.045 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T01:03:07.045 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T01:03:07.045 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T01:03:07.045 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-18T01:03:07.045 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-18T01:03:07.045 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/ver-health/0 2026-02-18T01:03:07.045 INFO:tasks.workunit.client.0.trial069.stdout:start osd.0 2026-02-18T01:03:07.046 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-18T01:03:07.046 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=f12f9151-9f82-4cd0-b200-adf3932f8443 --auth-supported=none --mon-host= --mon_health_to_clog_tick_interval=1.0 --mon-host=127.0.0.1:7165 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ver-health/0 --osd-journal=td/ver-health/0/journal --chdir= --run-dir=td/ver-health '--admin-socket=/tmp/ceph-asok.162951/$cluster-$name.asok' --debug-osd=20 '--log-file=td/ver-health/$name.log' '--pid-file=td/ver-health/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T01:03:07.047 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/ver-health/0/whoami 2026-02-18T01:03:07.047 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-18T01:03:07.047 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-18T01:03:07.047 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-18T01:03:07.047 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-18T01:03:07.062 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T01:03:07.050+0000 7f95c9d06a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:03:07.063 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T01:03:07.054+0000 7f95c9d06a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:03:07.064 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T01:03:07.054+0000 7f95c9d06a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T01:03:07.066 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T01:03:07.054+0000 7f95c9d06a40 -1 Falling back to public interface 2026-02-18T01:03:07.070 INFO:tasks.workunit.client.0.trial069.stderr:2026-02-18T01:03:07.062+0000 7f95c9d06a40 -1 osd.0 0 log_to_monitors true 2026-02-18T01:03:07.152 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-18T01:03:07.152 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T01:03:07.152 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-18T01:03:07.152 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T01:03:07.152 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T01:03:07.152 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:03:07.153 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T01:03:07.153 INFO:tasks.workunit.client.0.trial069.stdout:0 2026-02-18T01:03:07.153 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:03:07.153 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T01:03:07.258 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T01:03:08.260 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T01:03:08.260 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T01:03:08.261 INFO:tasks.workunit.client.0.trial069.stdout:1 2026-02-18T01:03:08.261 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T01:03:08.261 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T01:03:08.261 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T01:03:08.371 INFO:tasks.workunit.client.0.trial069.stdout:osd.0 up in weight 1 up_from 25 up_thru 0 down_at 24 last_clean_interval [0,0) [v2:127.0.0.1:6800/1060554234,v1:127.0.0.1:6801/1060554234] [v2:127.0.0.1:6802/1060554234,v1:127.0.0.1:6803/1060554234] exists,up 37612818-022e-4667-9178-4145fa36ac68 2026-02-18T01:03:08.372 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T01:03:08.372 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T01:03:08.372 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T01:03:08.372 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:218: TEST_check_version_health_3: wait_for_health_string 'HEALTH_ERR .*There are daemons running multiple old versions of ceph' 2026-02-18T01:03:08.372 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:40: wait_for_health_string: local 'grep_string=HEALTH_ERR .*There are daemons running multiple old versions of ceph' 2026-02-18T01:03:08.372 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:41: wait_for_health_string: local seconds=20 2026-02-18T01:03:08.372 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:44: wait_for_health_string: set -o pipefail 2026-02-18T01:03:08.373 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:45: wait_for_health_string: PASSED=false 2026-02-18T01:03:08.373 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:46: wait_for_health_string: (( i=0 )) 2026-02-18T01:03:08.373 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:46: wait_for_health_string: (( i < 20 )) 2026-02-18T01:03:08.373 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:47: wait_for_health_string: ceph health 2026-02-18T01:03:08.373 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:47: wait_for_health_string: grep -q 'HEALTH_ERR .*There are daemons running multiple old versions of ceph' 2026-02-18T01:03:08.482 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:52: wait_for_health_string: sleep 1 2026-02-18T01:03:09.484 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:46: wait_for_health_string: (( i++ )) 2026-02-18T01:03:09.484 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:46: wait_for_health_string: (( i < 20 )) 2026-02-18T01:03:09.484 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:47: wait_for_health_string: ceph health 2026-02-18T01:03:09.485 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:47: wait_for_health_string: grep -q 'HEALTH_ERR .*There are daemons running multiple old versions of ceph' 2026-02-18T01:03:09.596 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:52: wait_for_health_string: sleep 1 2026-02-18T01:03:10.597 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:46: wait_for_health_string: (( i++ )) 2026-02-18T01:03:10.597 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:46: wait_for_health_string: (( i < 20 )) 2026-02-18T01:03:10.597 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:47: wait_for_health_string: ceph health 2026-02-18T01:03:10.598 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:47: wait_for_health_string: grep -q 'HEALTH_ERR .*There are daemons running multiple old versions of ceph' 2026-02-18T01:03:10.710 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:49: wait_for_health_string: PASSED=true 2026-02-18T01:03:10.710 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:50: wait_for_health_string: break 2026-02-18T01:03:10.710 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:54: wait_for_health_string: set +o pipefail 2026-02-18T01:03:10.710 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:57: wait_for_health_string: '[' true = false ']' 2026-02-18T01:03:10.710 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:61: wait_for_health_string: return 0 2026-02-18T01:03:10.710 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:220: TEST_check_version_health_3: ceph health detail 2026-02-18T01:03:10.811 INFO:tasks.workunit.client.0.trial069.stdout:HEALTH_ERR There are daemons running multiple old versions of ceph 2026-02-18T01:03:10.812 INFO:tasks.workunit.client.0.trial069.stdout:[ERR] DAEMON_OLD_VERSION: There are daemons running multiple old versions of ceph 2026-02-18T01:03:10.812 INFO:tasks.workunit.client.0.trial069.stdout: osd.1 osd.2 are running an older version of ceph: 01.00.00-gversion-test 2026-02-18T01:03:10.812 INFO:tasks.workunit.client.0.trial069.stdout: osd.0 is running an older version of ceph: 02.00.00-gversion-test 2026-02-18T01:03:10.819 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:221: TEST_check_version_health_3: ceph health detail 2026-02-18T01:03:10.819 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:221: TEST_check_version_health_3: grep -q 'HEALTH_ERR .*There are daemons running multiple old versions of ceph' 2026-02-18T01:03:10.946 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:222: TEST_check_version_health_3: ceph health detail 2026-02-18T01:03:10.946 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:222: TEST_check_version_health_3: grep -q '^[[]ERR[]] DAEMON_OLD_VERSION: There are daemons running multiple old versions of ceph' 2026-02-18T01:03:11.069 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:223: TEST_check_version_health_3: ceph health detail 2026-02-18T01:03:11.070 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:223: TEST_check_version_health_3: grep -q 'osd.1 osd.2 are running an older version of ceph: 01.00.00-gversion-test' 2026-02-18T01:03:11.193 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:224: TEST_check_version_health_3: ceph health detail 2026-02-18T01:03:11.193 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:224: TEST_check_version_health_3: grep -q 'osd.0 is running an older version of ceph: 02.00.00-gversion-test' 2026-02-18T01:03:11.322 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:35: run: teardown td/ver-health 2026-02-18T01:03:11.322 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/ver-health 2026-02-18T01:03:11.323 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T01:03:11.323 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/ver-health KILL 2026-02-18T01:03:11.323 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T01:03:11.323 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T01:03:11.324 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T01:03:11.324 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T01:03:11.324 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T01:03:11.433 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T01:03:11.433 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T01:03:11.434 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T01:03:11.434 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T01:03:11.435 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T01:03:11.435 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T01:03:11.436 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T01:03:11.437 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T01:03:11.437 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T01:03:11.437 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T01:03:11.438 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T01:03:11.438 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T01:03:11.439 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T01:03:11.439 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/ver-health 2026-02-18T01:03:11.447 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T01:03:11.447 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:03:11.447 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.162951 2026-02-18T01:03:11.447 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.162951 2026-02-18T01:03:11.449 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T01:03:11.449 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T01:03:11.449 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2401: main: code=0 2026-02-18T01:03:11.449 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2405: main: teardown td/ver-health 0 2026-02-18T01:03:11.449 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/ver-health 2026-02-18T01:03:11.449 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs=0 2026-02-18T01:03:11.450 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/ver-health KILL 2026-02-18T01:03:11.450 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T01:03:11.450 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T01:03:11.450 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T01:03:11.450 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T01:03:11.450 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T01:03:11.451 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T01:03:11.451 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T01:03:11.452 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T01:03:11.452 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T01:03:11.453 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T01:03:11.453 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T01:03:11.454 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T01:03:11.455 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T01:03:11.455 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T01:03:11.455 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T01:03:11.456 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T01:03:11.457 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T01:03:11.458 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o 0 = 1 ']' 2026-02-18T01:03:11.458 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/ver-health 2026-02-18T01:03:11.459 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T01:03:11.459 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T01:03:11.460 INFO:tasks.workunit.client.0.trial069.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.162951 2026-02-18T01:03:11.460 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.162951 2026-02-18T01:03:11.461 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T01:03:11.461 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T01:03:11.461 INFO:tasks.workunit.client.0.trial069.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2406: main: return 0 2026-02-18T01:03:11.462 INFO:teuthology.orchestra.run:Running command with timeout 3600 2026-02-18T01:03:11.462 DEBUG:teuthology.orchestra.run.trial069:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2026-02-18T01:03:11.515 INFO:tasks.workunit:Stopping ['misc'] on client.0... 2026-02-18T01:03:11.515 DEBUG:teuthology.orchestra.run.trial069:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2026-02-18T01:03:11.874 DEBUG:teuthology.parallel:result is None 2026-02-18T01:03:11.875 DEBUG:teuthology.orchestra.run.trial069:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2026-02-18T01:03:11.883 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2026-02-18T01:03:11.884 DEBUG:teuthology.orchestra.run.trial069:> rmdir -- /home/ubuntu/cephtest/mnt.0 2026-02-18T01:03:11.930 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2026-02-18T01:03:11.930 DEBUG:teuthology.run_tasks:Unwinding manager install 2026-02-18T01:03:11.945 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2026-02-18T01:03:11.945 DEBUG:teuthology.orchestra.run.trial069:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-18T01:03:12.083 DEBUG:teuthology.run_tasks:Unwinding manager clock 2026-02-18T01:03:12.094 INFO:teuthology.task.clock:Checking final clock skew... 2026-02-18T01:03:12.095 DEBUG:teuthology.orchestra.run.trial069:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-18T01:03:12.153 INFO:teuthology.orchestra.run.trial069.stdout: remote refid st t when poll reach delay offset jitter 2026-02-18T01:03:12.153 INFO:teuthology.orchestra.run.trial069.stdout:============================================================================== 2026-02-18T01:03:12.153 INFO:teuthology.orchestra.run.trial069.stdout:+66.42.71.197 (6 45.33.53.84 3 u 30 64 377 62.053 +7.619 6.121 2026-02-18T01:03:12.154 INFO:teuthology.orchestra.run.trial069.stdout:+69.164.213.136 47.187.174.51 2 u 17 64 377 3.344 +7.834 0.917 2026-02-18T01:03:12.154 INFO:teuthology.orchestra.run.trial069.stdout:+38.45.64.130 129.134.25.123 2 u 22 64 377 20.780 +7.705 1.206 2026-02-18T01:03:12.154 INFO:teuthology.orchestra.run.trial069.stdout:*ntp0.alb1.inoc. 172.21.4.40 2 u 22 64 377 6.871 +8.866 1.582 2026-02-18T01:03:12.154 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2026-02-18T01:03:12.166 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2026-02-18T01:03:12.166 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2026-02-18T01:03:12.180 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2026-02-18T01:03:12.194 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2026-02-18T01:03:12.210 INFO:teuthology.task.internal:Duration was 2058.989855 seconds 2026-02-18T01:03:12.211 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2026-02-18T01:03:12.232 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2026-02-18T01:03:12.232 DEBUG:teuthology.orchestra.run.trial069:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-18T01:03:12.259 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2026-02-18T01:03:12.259 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial069.front.sepia.ceph.com 2026-02-18T01:03:12.259 DEBUG:teuthology.orchestra.run.trial069:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-18T01:03:12.308 INFO:teuthology.task.internal.syslog:Gathering journactl... 2026-02-18T01:03:12.308 DEBUG:teuthology.orchestra.run.trial069:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-18T01:03:12.514 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2026-02-18T01:03:12.514 DEBUG:teuthology.orchestra.run.trial069:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-18T01:03:12.522 INFO:teuthology.orchestra.run.trial069.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-18T01:03:12.524 INFO:teuthology.orchestra.run.trial069.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-18T01:03:12.524 INFO:teuthology.orchestra.run.trial069.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-18T01:03:12.524 INFO:teuthology.orchestra.run.trial069.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-18T01:03:12.524 INFO:teuthology.orchestra.run.trial069.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: /home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-18T01:03:12.573 INFO:teuthology.orchestra.run.trial069.stderr: 81.7% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-18T01:03:12.575 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2026-02-18T01:03:12.591 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2026-02-18T01:03:12.592 DEBUG:teuthology.orchestra.run.trial069:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-18T01:03:12.626 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2026-02-18T01:03:12.643 DEBUG:teuthology.orchestra.run.trial069:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-18T01:03:12.682 INFO:teuthology.orchestra.run.trial069.stdout:kernel.core_pattern = core 2026-02-18T01:03:12.690 DEBUG:teuthology.orchestra.run.trial069:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-18T01:03:12.737 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-18T01:03:12.738 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2026-02-18T01:03:12.749 INFO:teuthology.task.internal:Transferring archived files... 2026-02-18T01:03:12.752 DEBUG:teuthology.misc:Transferring archived files from trial069:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/yuriw-2026-02-17_21:14:21-rados-20.2.1_2.17.26-baseline_2-distro-default-trial/54158/remote/trial069 2026-02-18T01:03:12.753 DEBUG:teuthology.orchestra.run.trial069:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-18T01:03:12.811 INFO:teuthology.task.internal:Removing archive directory... 2026-02-18T01:03:12.811 DEBUG:teuthology.orchestra.run.trial069:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-18T01:03:12.842 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2026-02-18T01:03:12.859 INFO:teuthology.task.internal:Not uploading archives. 2026-02-18T01:03:12.859 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2026-02-18T01:03:12.874 INFO:teuthology.task.internal:Tidying up after the test... 2026-02-18T01:03:12.875 DEBUG:teuthology.orchestra.run.trial069:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-18T01:03:12.890 INFO:teuthology.orchestra.run.trial069.stdout: 1180192 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 18 01:03 /home/ubuntu/cephtest 2026-02-18T01:03:12.892 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2026-02-18T01:03:12.908 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2026-02-18T01:03:12.945 INFO:teuthology.run:Summary data: description: rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/misc} duration: 2058.9898545742035 flavor: default owner: scheduled_yuriw@soko04.front.sepia.ceph.com success: true 2026-02-18T01:03:12.945 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-18T01:03:13.060 INFO:teuthology.run:pass